| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
error-404-isvc-40523-predictor-57f4887bdf-rkfb5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-40523-predictor-57f4887bdf-rkfb5 to ip-10-0-133-209.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-8d2ee-predictor-6f9b7fbf65-8r9xm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-8d2ee-predictor-6f9b7fbf65-8r9xm to ip-10-0-133-209.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-68692-78776d6ccd-fsth8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-68692-78776d6ccd-fsth8 to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-c675b-predictor-5547c66cc5-ztplz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-c675b-predictor-5547c66cc5-ztplz to ip-10-0-133-209.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-866d764d98-72g5f |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-866d764d98-72g5f to ip-10-0-137-40.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-7b7ab-9fcfc967-k4fg6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-7b7ab-9fcfc967-k4fg6 to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-88827-predictor-66b8576947-28xrd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-88827-predictor-66b8576947-28xrd to ip-10-0-133-209.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-c559a-predictor-7c98468fff-9t7fx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-c559a-predictor-7c98468fff-9t7fx to ip-10-0-133-209.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-40523-predictor-54dbf486cb-2sn47 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-40523-predictor-54dbf486cb-2sn47 to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-09121-predictor-66bcd6b46-k2xnm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-09121-predictor-66bcd6b46-k2xnm to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-78590-85df59669f-6j9xq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-78590-85df59669f-6j9xq to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-09121-864f98c7fd-rj8ns |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-09121-864f98c7fd-rj8ns to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-c559a-57c5445779-r4zfm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-c559a-57c5445779-r4zfm to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw to ip-10-0-137-40.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-40523-6b6759674-ksx98 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-40523-6b6759674-ksx98 to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-c675b-768bbd884f-vxx9q |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-c675b-768bbd884f-vxx9q to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-c675b-predictor-7b8c7b5778-542pz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-c675b-predictor-7b8c7b5778-542pz to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-c559a-predictor-665765c694-bj667 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-c559a-predictor-665765c694-bj667 to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-8d2ee-predictor-5d9c964d96-7txl8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-8d2ee-predictor-5d9c964d96-7txl8 to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-68692-predictor-58887df78c-cmj9w |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-68692-predictor-58887df78c-cmj9w to ip-10-0-133-209.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-88827-56d8c9dfbf-5ll78 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-88827-56d8c9dfbf-5ll78 to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-88827-predictor-68bb654446-xn6vz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-88827-predictor-68bb654446-xn6vz to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-7b7ab-predictor-6cbf754778-jfbcx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-7b7ab-predictor-6cbf754778-jfbcx to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-78590-predictor-599b7b7f46-8r44l |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-78590-predictor-599b7b7f46-8r44l to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-6d218-predictor-6fbfd44c8-7cpcl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-6d218-predictor-6fbfd44c8-7cpcl to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-09121-predictor-78d4984875-8wwtg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-09121-predictor-78d4984875-8wwtg to ip-10-0-133-209.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-6d218-57587c6648-hpj45 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-6d218-57587c6648-hpj45 to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-78590-predictor-64948cf447-bmtpr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-78590-predictor-64948cf447-bmtpr to ip-10-0-133-209.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-59c85f56c9-2z4kl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-59c85f56c9-2z4kl to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-68692-predictor-98ddcc858-6r58m |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-68692-predictor-98ddcc858-6r58m to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-7b7ab-predictor-7d65578975-ghbgv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-7b7ab-predictor-7d65578975-ghbgv to ip-10-0-133-209.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-6d218-predictor-fc586b6c5-77mmt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-6d218-predictor-fc586b6c5-77mmt to ip-10-0-133-209.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-8d2ee-545b848957-x45gp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-8d2ee-545b848957-x45gp to ip-10-0-138-214.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-555fc69d56-72pkg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-72pkg to ip-10-0-137-40.ec2.internal | ||
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-40523-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-40523-predictor-57f4887bdf from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-866d764d98 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-40523-predictor-57f4887bdf |
SuccessfulCreate |
Created pod: error-404-isvc-40523-predictor-57f4887bdf-rkfb5 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-40523-predictor-54dbf486cb |
SuccessfulCreate |
Created pod: success-200-isvc-40523-predictor-54dbf486cb-2sn47 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40523-predictor-54dbf486cb-2sn47 |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1695" | |
kserve-ci-e2e-test |
multus |
success-200-isvc-40523-predictor-54dbf486cb-2sn47 |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-40523-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-40523-predictor-54dbf486cb from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-555fc69d56 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-555fc69d56-72pkg | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-866d764d98 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-866d764d98-72g5f | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-555fc69d56 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-72pkg |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cd2b86b0a2c9500aabe87a633c3b9bab30a880b19ff42859e99cc17f113ecdb0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-72pkg |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
error-404-isvc-40523-predictor-57f4887bdf-rkfb5 |
AddedInterface |
Add eth0 [10.133.0.18/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-555fc69d56-72pkg |
AddedInterface |
Add eth0 [10.132.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-sklearn-graph-2-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-555c647c7d from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40523-predictor-57f4887bdf-rkfb5 |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1695" | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-866d764d98-72g5f |
AddedInterface |
Add eth0 [10.132.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-72pkg |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-555c647c7d |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-866d764d98-72g5f |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cd2b86b0a2c9500aabe87a633c3b9bab30a880b19ff42859e99cc17f113ecdb0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-866d764d98-72g5f |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-866d764d98-72g5f |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw |
AddedInterface |
Add eth0 [10.132.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cd2b86b0a2c9500aabe87a633c3b9bab30a880b19ff42859e99cc17f113ecdb0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-72pkg |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-866d764d98-72g5f |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1695" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1695" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40523-predictor-54dbf486cb-2sn47 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40523-predictor-54dbf486cb-2sn47 |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1695" in 12.296s (12.296s including waiting). Image size: 1335687809 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40523-predictor-57f4887bdf-rkfb5 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40523-predictor-57f4887bdf-rkfb5 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40523-predictor-54dbf486cb-2sn47 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40523-predictor-54dbf486cb-2sn47 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40523-predictor-57f4887bdf-rkfb5 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40523-predictor-57f4887bdf-rkfb5 |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1695" in 12.295s (12.295s including waiting). Image size: 1334585467 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40523-predictor-54dbf486cb-2sn47 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40523-predictor-57f4887bdf-rkfb5 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.388s (2.388s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-40523-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40523-predictor-54dbf486cb-2sn47 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.257s (2.257s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40523-predictor-54dbf486cb-2sn47 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-40523-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40523-predictor-57f4887bdf-rkfb5 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40523-predictor-57f4887bdf-rkfb5 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1695" in 27.6s (27.6s including waiting). Image size: 1555877318 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-72pkg |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-72pkg |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-72pkg |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-72pkg |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 29.093s (29.093s including waiting). Image size: 1305293048 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-866d764d98-72g5f |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-866d764d98-72g5f |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-866d764d98-72g5f |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-866d764d98-72g5f |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1695" in 28.62s (28.62s including waiting). Image size: 1555877318 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-72pkg |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-72pkg |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.634s (2.634s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-866d764d98-72g5f |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 3.079s (3.079s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-866d764d98-72g5f |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-72pkg |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-866d764d98-72g5f |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 3.112s (3.112s including waiting). Image size: 211946088 bytes. | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-40523-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-40523-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-40523-predictor-54dbf486cb-2sn47 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.31:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-40523-predictor-57f4887bdf-rkfb5 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.18:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-40523 |
InferenceServiceReady |
InferenceService [success-200-isvc-40523] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-40523 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-40523 |
InferenceServiceReady |
InferenceService [error-404-isvc-40523] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-40523 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-40523-6b6759674 |
SuccessfulCreate |
Created pod: switch-graph-40523-6b6759674-ksx98 | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-40523 |
ScalingReplicaSet |
Scaled up replica set switch-graph-40523-6b6759674 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-40523-6b6759674-ksx98 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-40523-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-40523 |
InferenceGraphReady |
InferenceGraph [switch-graph-40523] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-40523-6b6759674-ksx98 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:b87693b966d6607544232e73341be0a7df8bc57efa51891457e864fb9d5cc954" | |
kserve-ci-e2e-test |
multus |
switch-graph-40523-6b6759674-ksx98 |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-40523-6b6759674-ksx98 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:b87693b966d6607544232e73341be0a7df8bc57efa51891457e864fb9d5cc954" in 2.718s (2.718s including waiting). Image size: 218068124 bytes. | |
kserve-ci-e2e-test |
kubelet |
switch-graph-40523-6b6759674-ksx98 |
Created |
Created container: switch-graph-40523 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-40523-6b6759674-ksx98 |
Started |
Started container switch-graph-40523 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-40523-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-40523-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-40523-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-40523-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-68692 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-68692": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-68692": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40523-predictor-57f4887bdf-rkfb5 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
switch-graph-40523-6b6759674-ksx98 |
Killing |
Stopping container switch-graph-40523 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40523-predictor-57f4887bdf-rkfb5 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40523-predictor-54dbf486cb-2sn47 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40523-predictor-54dbf486cb-2sn47 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-68692 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-68692": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-68692-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-68692-predictor-98ddcc858 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-68692-predictor-98ddcc858 |
SuccessfulCreate |
Created pod: success-200-isvc-68692-predictor-98ddcc858-6r58m | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-68692-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-68692-predictor-58887df78c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-68692-predictor-58887df78c |
SuccessfulCreate |
Created pod: error-404-isvc-68692-predictor-58887df78c-cmj9w | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-68692 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-68692": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-68692 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-68692": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-68692": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-68692-predictor-98ddcc858-6r58m |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-68692-predictor-98ddcc858-6r58m |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-68692-predictor-58887df78c-cmj9w |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-68692-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-68692-predictor-98ddcc858-6r58m |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-68692-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
error-404-isvc-68692-predictor-58887df78c-cmj9w |
AddedInterface |
Add eth0 [10.133.0.19/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-68692-predictor-98ddcc858-6r58m |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-68692-predictor-98ddcc858-6r58m |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-68692-predictor-98ddcc858-6r58m |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1695" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-68692-predictor-98ddcc858-6r58m |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-68692-predictor-58887df78c-cmj9w |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1695" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-68692-predictor-58887df78c-cmj9w |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-68692-predictor-58887df78c-cmj9w |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-68692-predictor-98ddcc858-6r58m |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-68692-predictor-58887df78c-cmj9w |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-68692-predictor-58887df78c-cmj9w |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-40523-predictor-54dbf486cb-2sn47 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.31:8643/healthz": dial tcp 10.134.0.31:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-68692-predictor-58887df78c-cmj9w |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-40523-predictor-57f4887bdf-rkfb5 |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.18:8643/healthz": dial tcp 10.133.0.18:8643: connect: connection refused | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-68692-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-68692-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-40523-6b6759674-ksx98 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-68692-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-68692-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
model-chainer-59c85f56c9-2z4kl |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "model-chainer-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-59c85f56c9 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-59c85f56c9 |
SuccessfulCreate |
Created pod: model-chainer-59c85f56c9-2z4kl | |
kserve-ci-e2e-test |
kubelet |
model-chainer-59c85f56c9-2z4kl |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-59c85f56c9-2z4kl |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-59c85f56c9-2z4kl |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:b87693b966d6607544232e73341be0a7df8bc57efa51891457e864fb9d5cc954" already present on machine | |
kserve-ci-e2e-test |
multus |
model-chainer-59c85f56c9-2z4kl |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-68692 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-68692 |
InferenceServiceReady |
InferenceService [success-200-isvc-68692] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-68692 |
InferenceServiceReady |
InferenceService [error-404-isvc-68692] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-68692 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-88827 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-88827": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-88827": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-866d764d98-72g5f |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-88827 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-88827": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-88827-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-88827-predictor-66b8576947 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
model-chainer-59c85f56c9-2z4kl |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-88827-predictor-68bb654446 |
SuccessfulCreate |
Created pod: success-200-isvc-88827-predictor-68bb654446-xn6vz | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-88827-predictor-66b8576947 |
SuccessfulCreate |
Created pod: error-404-isvc-88827-predictor-66b8576947-28xrd | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-866d764d98-72g5f |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-88827-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-88827-predictor-68bb654446 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-88827-predictor-66b8576947-28xrd |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-88827-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-88827-predictor-68bb654446-xn6vz |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-88827-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-72pkg |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-72pkg |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-88827-predictor-68bb654446-xn6vz |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-88827-predictor-68bb654446-xn6vz |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-88827-predictor-68bb654446-xn6vz |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-88827-predictor-68bb654446-xn6vz |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1695" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-88827-predictor-68bb654446-xn6vz |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-88827-predictor-66b8576947-28xrd |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-88827-predictor-68bb654446-xn6vz |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-88827-predictor-66b8576947-28xrd |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1695" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-88827-predictor-66b8576947-28xrd |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-88827-predictor-66b8576947-28xrd |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-88827-predictor-66b8576947-28xrd |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-88827-predictor-66b8576947-28xrd |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-88827-predictor-66b8576947-28xrd |
AddedInterface |
Add eth0 [10.133.0.20/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-88827-predictor-68bb654446-xn6vz |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-68692-78776d6ccd |
SuccessfulCreate |
Created pod: switch-graph-68692-78776d6ccd-fsth8 | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-68692 |
ScalingReplicaSet |
Scaled up replica set switch-graph-68692-78776d6ccd from 0 to 1 | |
| (x10) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.29:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555c647c7d-2z4lw |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.29:8643/healthz": dial tcp 10.132.0.29:8643: connect: connection refused | |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-72pkg |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.28:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-72pkg |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.28:8643/healthz": dial tcp 10.132.0.28:8643: connect: connection refused | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-68692 |
InferenceGraphReady |
InferenceGraph [switch-graph-68692] is Ready | |
kserve-ci-e2e-test |
multus |
switch-graph-68692-78776d6ccd-fsth8 |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-866d764d98-72g5f |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.27:8643/healthz": dial tcp 10.132.0.27:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
switch-graph-68692-78776d6ccd-fsth8 |
Created |
Created container: switch-graph-68692 | |
| (x10) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-866d764d98-72g5f |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.27:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
switch-graph-68692-78776d6ccd-fsth8 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:b87693b966d6607544232e73341be0a7df8bc57efa51891457e864fb9d5cc954" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-68692-78776d6ccd-fsth8 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-68692-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
switch-graph-68692-78776d6ccd-fsth8 |
Started |
Started container switch-graph-68692 | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-68692-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-68692-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-68692 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-68692-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-68692 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-68692-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-59c85f56c9-2z4kl |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-88827-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-88827-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-88827-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-88827-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-68692 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-68692 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-88827-predictor-66b8576947-28xrd |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.20:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-88827 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-88827 |
InferenceServiceReady |
InferenceService [success-200-isvc-88827] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-88827 |
InferenceServiceReady |
InferenceService [error-404-isvc-88827] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-88827 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-88827-56d8c9dfbf |
SuccessfulCreate |
Created pod: sequence-graph-88827-56d8c9dfbf-5ll78 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-88827 |
InferenceGraphReady |
InferenceGraph [sequence-graph-88827] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-88827 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-88827-56d8c9dfbf from 0 to 1 | |
kserve-ci-e2e-test |
multus |
sequence-graph-88827-56d8c9dfbf-5ll78 |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-88827-56d8c9dfbf-5ll78 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:b87693b966d6607544232e73341be0a7df8bc57efa51891457e864fb9d5cc954" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-88827-56d8c9dfbf-5ll78 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-88827-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-88827-56d8c9dfbf-5ll78 |
Started |
Started container sequence-graph-88827 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-88827-56d8c9dfbf-5ll78 |
Created |
Created container: sequence-graph-88827 | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-88827 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-88827 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-88827-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-88827-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-88827-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-88827-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-88827 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-88827 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c675b |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-c675b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c675b |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-c675b": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-c675b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c675b-predictor-7b8c7b5778-542pz |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-c675b-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-c675b-predictor-5547c66cc5 |
SuccessfulCreate |
Created pod: error-404-isvc-c675b-predictor-5547c66cc5-ztplz | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-68692-predictor-58887df78c-cmj9w |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-c675b-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-c675b-predictor-5547c66cc5 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c675b |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-c675b": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-c675b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-68692-predictor-58887df78c-cmj9w |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c675b-predictor-5547c66cc5-ztplz |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-c675b-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-c675b-predictor-7b8c7b5778 |
SuccessfulCreate |
Created pod: success-200-isvc-c675b-predictor-7b8c7b5778-542pz | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-c675b-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-c675b-predictor-7b8c7b5778 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-68692-78776d6ccd-fsth8 |
Killing |
Stopping container switch-graph-68692 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-68692-predictor-98ddcc858-6r58m |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-68692-predictor-98ddcc858-6r58m |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c675b |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-c675b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c675b-predictor-5547c66cc5-ztplz |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c675b-predictor-7b8c7b5778-542pz |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-c675b-predictor-7b8c7b5778-542pz |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c675b-predictor-7b8c7b5778-542pz |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1695" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c675b-predictor-7b8c7b5778-542pz |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c675b-predictor-7b8c7b5778-542pz |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c675b-predictor-7b8c7b5778-542pz |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c675b-predictor-7b8c7b5778-542pz |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c675b-predictor-5547c66cc5-ztplz |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c675b-predictor-5547c66cc5-ztplz |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c675b-predictor-5547c66cc5-ztplz |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c675b-predictor-5547c66cc5-ztplz |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c675b-predictor-5547c66cc5-ztplz |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1695" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-c675b-predictor-5547c66cc5-ztplz |
AddedInterface |
Add eth0 [10.133.0.21/23] from ovn-kubernetes | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-68692-predictor-98ddcc858-6r58m |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.33:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-68692-predictor-58887df78c-cmj9w |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.19:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-68692-predictor-98ddcc858-6r58m |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.33:8643/healthz": dial tcp 10.134.0.33:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-68692-predictor-58887df78c-cmj9w |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.19:8643/healthz": dial tcp 10.133.0.19:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-68692-78776d6ccd-fsth8 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c675b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c675b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c675b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c675b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-c675b-predictor-5547c66cc5-ztplz |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.21:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-c675b-predictor-7b8c7b5778-542pz |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.38:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c675b |
InferenceServiceReady |
InferenceService [error-404-isvc-c675b] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c675b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c675b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c675b |
InferenceServiceReady |
InferenceService [success-200-isvc-c675b] is Ready | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-88827-predictor-68bb654446-xn6vz |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-88827-predictor-66b8576947-28xrd |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-c559a-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-c559a-predictor-665765c694 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-c559a-predictor-7c98468fff |
SuccessfulCreate |
Created pod: error-404-isvc-c559a-predictor-7c98468fff-9t7fx | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-c559a-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-c559a-predictor-7c98468fff from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-88827-predictor-68bb654446-xn6vz |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-88827-predictor-66b8576947-28xrd |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-88827-56d8c9dfbf-5ll78 |
Killing |
Stopping container sequence-graph-88827 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c559a |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-c559a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c559a |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-c559a": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-c559a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c559a-predictor-665765c694-bj667 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-c559a-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-c559a-predictor-665765c694 |
SuccessfulCreate |
Created pod: success-200-isvc-c559a-predictor-665765c694-bj667 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c559a-predictor-7c98468fff-9t7fx |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-c559a-predictor-665765c694-bj667 |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
error-404-isvc-c559a-predictor-7c98468fff-9t7fx |
AddedInterface |
Add eth0 [10.133.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c559a-predictor-7c98468fff-9t7fx |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1695" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c559a-predictor-7c98468fff-9t7fx |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c559a-predictor-7c98468fff-9t7fx |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c559a-predictor-665765c694-bj667 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1695" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c559a-predictor-665765c694-bj667 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c559a-predictor-665765c694-bj667 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c559a-predictor-7c98468fff-9t7fx |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c559a-predictor-665765c694-bj667 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c559a-predictor-665765c694-bj667 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c559a-predictor-665765c694-bj667 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c559a-predictor-7c98468fff-9t7fx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-88827-predictor-68bb654446-xn6vz |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.35:8643/healthz": dial tcp 10.134.0.35:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-88827-predictor-68bb654446-xn6vz |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.35:8080: connect: connection refused |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-c675b |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-c675b-768bbd884f from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c675b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c675b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c675b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-c675b |
InferenceGraphReady |
InferenceGraph [ensemble-graph-c675b] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c675b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-c675b-768bbd884f |
SuccessfulCreate |
Created pod: ensemble-graph-c675b-768bbd884f-vxx9q | |
kserve-ci-e2e-test |
multus |
ensemble-graph-c675b-768bbd884f-vxx9q |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-c675b-768bbd884f-vxx9q |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:b87693b966d6607544232e73341be0a7df8bc57efa51891457e864fb9d5cc954" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-c675b-768bbd884f-vxx9q |
Created |
Created container: ensemble-graph-c675b | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-c675b-768bbd884f-vxx9q |
Started |
Started container ensemble-graph-c675b | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-7b7ab-predictor-6cbf754778 |
SuccessfulCreate |
Created pod: success-200-isvc-7b7ab-predictor-6cbf754778-jfbcx | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-7b7ab-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-7b7ab-predictor-6cbf754778 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c675b-predictor-5547c66cc5-ztplz |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7b7ab-predictor-6cbf754778-jfbcx |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-7b7ab-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7b7ab |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-7b7ab": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7b7ab |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-7b7ab": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-7b7ab": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-7b7ab-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-7b7ab-predictor-7d65578975 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c675b-predictor-7b8c7b5778-542pz |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-7b7ab-predictor-7d65578975 |
SuccessfulCreate |
Created pod: error-404-isvc-7b7ab-predictor-7d65578975-ghbgv | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c675b-predictor-7b8c7b5778-542pz |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c675b-predictor-5547c66cc5-ztplz |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-c675b-768bbd884f-vxx9q |
Killing |
Stopping container ensemble-graph-c675b | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7b7ab-predictor-6cbf754778-jfbcx |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-7b7ab-predictor-7d65578975-ghbgv |
AddedInterface |
Add eth0 [10.133.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c559a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c559a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7b7ab-predictor-6cbf754778-jfbcx |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7b7ab-predictor-6cbf754778-jfbcx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7b7ab-predictor-6cbf754778-jfbcx |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1695" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-7b7ab-predictor-6cbf754778-jfbcx |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7b7ab-predictor-7d65578975-ghbgv |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-7b7ab-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c675b-predictor-5547c66cc5-ztplz |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.21:8643/healthz": dial tcp 10.133.0.21:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7b7ab-predictor-7d65578975-ghbgv |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1695" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7b7ab-predictor-7d65578975-ghbgv |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7b7ab-predictor-7d65578975-ghbgv |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7b7ab-predictor-7d65578975-ghbgv |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7b7ab-predictor-7d65578975-ghbgv |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7b7ab-predictor-6cbf754778-jfbcx |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7b7ab-predictor-6cbf754778-jfbcx |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7b7ab-predictor-7d65578975-ghbgv |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c675b-predictor-7b8c7b5778-542pz |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.38:8643/healthz": dial tcp 10.134.0.38:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-88827-56d8c9dfbf-5ll78 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c559a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c559a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-c559a-predictor-7c98468fff-9t7fx |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.22:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-c559a-predictor-665765c694-bj667 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.39:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-c675b-768bbd884f-vxx9q |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7b7ab-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7b7ab-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7b7ab-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7b7ab-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c559a |
InferenceServiceReady |
InferenceService [error-404-isvc-c559a] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c559a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c559a |
InferenceServiceReady |
InferenceService [success-200-isvc-c559a] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c559a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-7b7ab-predictor-6cbf754778-jfbcx |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.41:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c559a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c559a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c559a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-c559a-57c5445779 |
SuccessfulCreate |
Created pod: sequence-graph-c559a-57c5445779-r4zfm | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-c559a |
InferenceGraphReady |
InferenceGraph [sequence-graph-c559a] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-c559a |
ScalingReplicaSet |
Scaled up replica set sequence-graph-c559a-57c5445779 from 0 to 1 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c559a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
multus |
sequence-graph-c559a-57c5445779-r4zfm |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-c559a-57c5445779-r4zfm |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:b87693b966d6607544232e73341be0a7df8bc57efa51891457e864fb9d5cc954" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-c559a-57c5445779-r4zfm |
Started |
Started container sequence-graph-c559a | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-c559a-57c5445779-r4zfm |
Created |
Created container: sequence-graph-c559a | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7b7ab |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7b7ab |
InferenceServiceReady |
InferenceService [success-200-isvc-7b7ab] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7b7ab |
InferenceServiceReady |
InferenceService [error-404-isvc-7b7ab] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7b7ab |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-6d218-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-6d218-predictor-6fbfd44c8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-c559a-57c5445779-r4zfm |
Killing |
Stopping container sequence-graph-c559a | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c559a-predictor-7c98468fff-9t7fx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c559a-predictor-7c98468fff-9t7fx |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6d218-predictor-6fbfd44c8-7cpcl |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c559a-predictor-665765c694-bj667 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6d218 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-6d218": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-6d218": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6d218 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-6d218": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6d218-predictor-6fbfd44c8-7cpcl |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6d218-predictor-6fbfd44c8-7cpcl |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c559a-predictor-665765c694-bj667 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-6d218-predictor-6fbfd44c8-7cpcl |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-6d218-predictor-6fbfd44c8 |
SuccessfulCreate |
Created pod: success-200-isvc-6d218-predictor-6fbfd44c8-7cpcl | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-6d218-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-6d218-predictor-fc586b6c5 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6d218-predictor-fc586b6c5-77mmt |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-6d218-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6d218-predictor-6fbfd44c8-7cpcl |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1695" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-6d218-predictor-fc586b6c5 |
SuccessfulCreate |
Created pod: error-404-isvc-6d218-predictor-fc586b6c5-77mmt | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6d218-predictor-6fbfd44c8-7cpcl |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6d218-predictor-6fbfd44c8-7cpcl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6d218-predictor-fc586b6c5-77mmt |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6d218-predictor-fc586b6c5-77mmt |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6d218-predictor-fc586b6c5-77mmt |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6d218-predictor-fc586b6c5-77mmt |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6d218-predictor-fc586b6c5-77mmt |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-6d218-predictor-fc586b6c5-77mmt |
AddedInterface |
Add eth0 [10.133.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6d218-predictor-fc586b6c5-77mmt |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1695" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c559a-predictor-7c98468fff-9t7fx |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.22:8643/healthz": dial tcp 10.133.0.22:8643: connect: connection refused | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7b7ab-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-7b7ab-9fcfc967 |
SuccessfulCreate |
Created pod: ensemble-graph-7b7ab-9fcfc967-k4fg6 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7b7ab-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-7b7ab |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-7b7ab-9fcfc967 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-7b7ab |
InferenceGraphReady |
InferenceGraph [ensemble-graph-7b7ab] is Ready | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-7b7ab-9fcfc967-k4fg6 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:b87693b966d6607544232e73341be0a7df8bc57efa51891457e864fb9d5cc954" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-7b7ab-9fcfc967-k4fg6 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-7b7ab-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
ensemble-graph-7b7ab-9fcfc967-k4fg6 |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-7b7ab-9fcfc967-k4fg6 |
Created |
Created container: ensemble-graph-7b7ab | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-7b7ab-9fcfc967-k4fg6 |
Started |
Started container ensemble-graph-7b7ab | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-7b7ab |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-7b7ab |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7b7ab-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7b7ab-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-c559a-57c5445779-r4zfm |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6d218-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6d218-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6d218-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6d218-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-7b7ab |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-7b7ab |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-6d218-predictor-6fbfd44c8-7cpcl |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.43:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-6d218-predictor-fc586b6c5-77mmt |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.24:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6d218 |
InferenceServiceReady |
InferenceService [success-200-isvc-6d218] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6d218 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6d218 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6d218 |
InferenceServiceReady |
InferenceService [error-404-isvc-6d218] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-6d218-57587c6648 |
SuccessfulCreate |
Created pod: sequence-graph-6d218-57587c6648-hpj45 | |
kserve-ci-e2e-test |
multus |
sequence-graph-6d218-57587c6648-hpj45 |
AddedInterface |
Add eth0 [10.134.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-6d218 |
InferenceGraphReady |
InferenceGraph [sequence-graph-6d218] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-6d218 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-6d218-57587c6648 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-6d218-57587c6648-hpj45 |
Started |
Started container sequence-graph-6d218 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6d218-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
sequence-graph-6d218-57587c6648-hpj45 |
Created |
Created container: sequence-graph-6d218 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-6d218-57587c6648-hpj45 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:b87693b966d6607544232e73341be0a7df8bc57efa51891457e864fb9d5cc954" already present on machine | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6d218-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6d218-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6d218-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-6d218 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-6d218 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-09121 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-09121": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-09121": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-09121-predictor-66bcd6b46 |
SuccessfulCreate |
Created pod: success-200-isvc-09121-predictor-66bcd6b46-k2xnm | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-09121 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-09121": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-09121 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-09121": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-7b7ab-9fcfc967-k4fg6 |
Killing |
Stopping container ensemble-graph-7b7ab | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-09121-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-09121-predictor-78d4984875 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-09121-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-09121-predictor-66bcd6b46 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7b7ab-predictor-6cbf754778-jfbcx |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7b7ab-predictor-6cbf754778-jfbcx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-09121-predictor-78d4984875 |
SuccessfulCreate |
Created pod: error-404-isvc-09121-predictor-78d4984875-8wwtg | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-09121 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-09121": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-09121": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-09121-predictor-78d4984875-8wwtg |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-09121-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-09121-predictor-66bcd6b46-k2xnm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7b7ab-predictor-7d65578975-ghbgv |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-09121-predictor-78d4984875-8wwtg |
AddedInterface |
Add eth0 [10.133.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-09121-predictor-66bcd6b46-k2xnm |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-09121-predictor-66bcd6b46-k2xnm |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-09121-predictor-66bcd6b46-k2xnm |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-09121-predictor-66bcd6b46-k2xnm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7b7ab-predictor-7d65578975-ghbgv |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-09121-predictor-66bcd6b46-k2xnm |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1695" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-09121-predictor-66bcd6b46-k2xnm |
AddedInterface |
Add eth0 [10.134.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-09121-predictor-78d4984875-8wwtg |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-09121-predictor-78d4984875-8wwtg |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-09121-predictor-78d4984875-8wwtg |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-09121-predictor-78d4984875-8wwtg |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-09121-predictor-78d4984875-8wwtg |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-09121-predictor-78d4984875-8wwtg |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1695" already present on machine | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-7b7ab-predictor-7d65578975-ghbgv |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.23:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7b7ab-predictor-7d65578975-ghbgv |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.23:8643/healthz": dial tcp 10.133.0.23:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-7b7ab-9fcfc967-k4fg6 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-09121-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-09121-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-09121-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-09121-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-09121-predictor-78d4984875-8wwtg |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.25:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-09121-predictor-66bcd6b46-k2xnm |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.46:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-09121 |
InferenceServiceReady |
InferenceService [error-404-isvc-09121] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-09121 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-09121 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-09121 |
InferenceServiceReady |
InferenceService [success-200-isvc-09121] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-8d2ee-predictor-6f9b7fbf65 |
SuccessfulCreate |
Created pod: error-404-isvc-8d2ee-predictor-6f9b7fbf65-8r9xm | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-8d2ee-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-8d2ee-predictor-5d9c964d96 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8d2ee |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-8d2ee": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-8d2ee-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-8d2ee-predictor-6f9b7fbf65 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-6d218-57587c6648-hpj45 |
Killing |
Stopping container sequence-graph-6d218 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6d218-predictor-6fbfd44c8-7cpcl |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6d218-predictor-6fbfd44c8-7cpcl |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-8d2ee-predictor-5d9c964d96 |
SuccessfulCreate |
Created pod: success-200-isvc-8d2ee-predictor-5d9c964d96-7txl8 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8d2ee |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-8d2ee": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-8d2ee": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d2ee-predictor-5d9c964d96-7txl8 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d2ee-predictor-5d9c964d96-7txl8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d2ee-predictor-5d9c964d96-7txl8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d2ee-predictor-5d9c964d96-7txl8 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1695" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-8d2ee-predictor-5d9c964d96-7txl8 |
AddedInterface |
Add eth0 [10.134.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d2ee-predictor-5d9c964d96-7txl8 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d2ee-predictor-5d9c964d96-7txl8 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6d218-predictor-fc586b6c5-77mmt |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6d218-predictor-fc586b6c5-77mmt |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-8d2ee-predictor-6f9b7fbf65-8r9xm |
AddedInterface |
Add eth0 [10.133.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d2ee-predictor-6f9b7fbf65-8r9xm |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-8d2ee-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d2ee-predictor-6f9b7fbf65-8r9xm |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d2ee-predictor-6f9b7fbf65-8r9xm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d2ee-predictor-6f9b7fbf65-8r9xm |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1695" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d2ee-predictor-6f9b7fbf65-8r9xm |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d2ee-predictor-6f9b7fbf65-8r9xm |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d2ee-predictor-6f9b7fbf65-8r9xm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-09121-864f98c7fd |
SuccessfulCreate |
Created pod: splitter-graph-09121-864f98c7fd-rj8ns | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-09121 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-09121-864f98c7fd from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-09121-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-09121-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-09121-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-09121-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
splitter-graph-09121-864f98c7fd-rj8ns |
Created |
Created container: splitter-graph-09121 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-09121-864f98c7fd-rj8ns |
Started |
Started container splitter-graph-09121 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-09121-864f98c7fd-rj8ns |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:b87693b966d6607544232e73341be0a7df8bc57efa51891457e864fb9d5cc954" already present on machine | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-09121 |
InferenceGraphReady |
InferenceGraph [splitter-graph-09121] is Ready | |
kserve-ci-e2e-test |
multus |
splitter-graph-09121-864f98c7fd-rj8ns |
AddedInterface |
Add eth0 [10.134.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-09121-864f98c7fd-rj8ns |
Killing |
Stopping container splitter-graph-09121 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-78590-predictor-64948cf447-bmtpr |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-78590-predictor-599b7b7f46-8r44l |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-78590 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-78590": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-78590": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-09121-predictor-78d4984875-8wwtg |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-09121-predictor-78d4984875-8wwtg |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-78590 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-78590": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-78590-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-78590-predictor-599b7b7f46 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-78590-predictor-599b7b7f46 |
SuccessfulCreate |
Created pod: success-200-isvc-78590-predictor-599b7b7f46-8r44l | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-78590-predictor-599b7b7f46-8r44l |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1695" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-78590-predictor-599b7b7f46-8r44l |
AddedInterface |
Add eth0 [10.134.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-78590-predictor-599b7b7f46-8r44l |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-09121-predictor-66bcd6b46-k2xnm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-09121-predictor-66bcd6b46-k2xnm |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-78590-predictor-599b7b7f46-8r44l |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-78590-predictor-599b7b7f46-8r44l |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-78590-predictor-64948cf447-bmtpr |
AddedInterface |
Add eth0 [10.133.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-78590-predictor-64948cf447-bmtpr |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1695" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-78590-predictor-64948cf447-bmtpr |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-78590-predictor-64948cf447-bmtpr |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-78590-predictor-64948cf447-bmtpr |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-78590-predictor-599b7b7f46-8r44l |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-78590-predictor-64948cf447-bmtpr |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-78590 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-78590": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-78590 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-78590": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-78590": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-78590-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-78590-predictor-64948cf447 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-78590-predictor-64948cf447 |
SuccessfulCreate |
Created pod: error-404-isvc-78590-predictor-64948cf447-bmtpr | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-09121-predictor-78d4984875-8wwtg |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.25:8643/healthz": dial tcp 10.133.0.25:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-6d218-57587c6648-hpj45 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8d2ee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8d2ee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d2ee-predictor-6f9b7fbf65-8r9xm |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.26:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d2ee-predictor-5d9c964d96-7txl8 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.47:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-09121-864f98c7fd-rj8ns |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-78590-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8d2ee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-78590-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8d2ee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8d2ee |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8d2ee |
InferenceServiceReady |
InferenceService [error-404-isvc-8d2ee] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8d2ee |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8d2ee |
InferenceServiceReady |
InferenceService [success-200-isvc-8d2ee] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-8d2ee |
ScalingReplicaSet |
Scaled up replica set switch-graph-8d2ee-545b848957 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-8d2ee |
InferenceGraphReady |
InferenceGraph [switch-graph-8d2ee] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-8d2ee-545b848957 |
SuccessfulCreate |
Created pod: switch-graph-8d2ee-545b848957-x45gp | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-78590 |
InferenceServiceReady |
InferenceService [success-200-isvc-78590] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-8d2ee-545b848957-x45gp |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:b87693b966d6607544232e73341be0a7df8bc57efa51891457e864fb9d5cc954" already present on machine | |
kserve-ci-e2e-test |
multus |
switch-graph-8d2ee-545b848957-x45gp |
AddedInterface |
Add eth0 [10.134.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-8d2ee-545b848957-x45gp |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-8d2ee-serving-cert" not found | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-78590 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-78590 |
InferenceServiceReady |
InferenceService [error-404-isvc-78590] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-8d2ee-545b848957-x45gp |
Created |
Created container: switch-graph-8d2ee | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-78590 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
kubelet |
switch-graph-8d2ee-545b848957-x45gp |
Started |
Started container switch-graph-8d2ee | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-78590-85df59669f |
SuccessfulCreate |
Created pod: splitter-graph-78590-85df59669f-6j9xq | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-78590-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8d2ee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
splitter-graph-78590-85df59669f-6j9xq |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-78590-serving-cert" not found | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8d2ee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-78590-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-78590 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-78590-85df59669f from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8d2ee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-78590-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-78590 |
InferenceGraphReady |
InferenceGraph [splitter-graph-78590] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-78590-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8d2ee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
splitter-graph-78590-85df59669f-6j9xq |
Created |
Created container: splitter-graph-78590 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-78590-85df59669f-6j9xq |
Started |
Started container splitter-graph-78590 | |
kserve-ci-e2e-test |
multus |
splitter-graph-78590-85df59669f-6j9xq |
AddedInterface |
Add eth0 [10.134.0.51/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-78590-85df59669f-6j9xq |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:b87693b966d6607544232e73341be0a7df8bc57efa51891457e864fb9d5cc954" already present on machine | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-78590 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-78590 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-8d2ee |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-8d2ee |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
splitter-graph-78590-85df59669f-6j9xq |
Killing |
Stopping container splitter-graph-78590 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-78590-predictor-599b7b7f46-8r44l |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-78590-predictor-599b7b7f46-8r44l |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-78590-predictor-64948cf447-bmtpr |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-78590-predictor-64948cf447-bmtpr |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-78590-predictor-599b7b7f46-8r44l |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.49:8643/healthz": dial tcp 10.134.0.49:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-78590-predictor-599b7b7f46-8r44l |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.49:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-78590-predictor-64948cf447-bmtpr |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.27:8643/healthz": dial tcp 10.133.0.27:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-78590-predictor-64948cf447-bmtpr |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.27:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-78590-85df59669f-6j9xq |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d2ee-predictor-6f9b7fbf65-8r9xm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
switch-graph-8d2ee-545b848957-x45gp |
Killing |
Stopping container switch-graph-8d2ee | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d2ee-predictor-5d9c964d96-7txl8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d2ee-predictor-5d9c964d96-7txl8 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d2ee-predictor-6f9b7fbf65-8r9xm |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d2ee-predictor-6f9b7fbf65-8r9xm |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.26:8643/healthz": context deadline exceeded | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-8d2ee-545b848957-x45gp |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |