| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
splitter-graph-05318-8558c6757d-frzqc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-05318-8558c6757d-frzqc to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-7eb51-predictor-695f658b7c-cmcvh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-7eb51-predictor-695f658b7c-cmcvh to ip-10-0-135-87.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-95b80-predictor-6d45f8d7f7-hlhtt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-95b80-predictor-6d45f8d7f7-hlhtt to ip-10-0-135-87.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-fdee6-predictor-9f587cb6d-sjqbk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-fdee6-predictor-9f587cb6d-sjqbk to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-d3ac8-predictor-59486dd895-2dj4n |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-d3ac8-predictor-59486dd895-2dj4n to ip-10-0-135-87.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-ea8a9-predictor-74877969-qprj9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-ea8a9-predictor-74877969-qprj9 to ip-10-0-135-87.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-7eb51-predictor-57447d7988-rk8g9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-7eb51-predictor-57447d7988-rk8g9 to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-7eb51-75dbc6577f-5fksf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-7eb51-75dbc6577f-5fksf to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-fdee6-predictor-67f7db74c7-mf4lm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-fdee6-predictor-67f7db74c7-mf4lm to ip-10-0-135-87.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-d3ac8-74c8fdd6dd-xmccm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-d3ac8-74c8fdd6dd-xmccm to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-fdee6-58647fdc98-8zx69 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-fdee6-58647fdc98-8zx69 to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-b95b6754-55kpx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-b95b6754-55kpx to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-4ab35-predictor-565c568f4b-ppcbg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-4ab35-predictor-565c568f4b-ppcbg to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-2e68f-predictor-96b67d9d6-c2ppj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-2e68f-predictor-96b67d9d6-c2ppj to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-4ab35-predictor-5897c6f9ff-ghl57 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-4ab35-predictor-5897c6f9ff-ghl57 to ip-10-0-135-87.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-6cbcd4578b-st5nv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6cbcd4578b-st5nv to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-2e68f-predictor-59fc976fc5-4bbnk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-2e68f-predictor-59fc976fc5-4bbnk to ip-10-0-135-87.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-555fc69d56-mb2dk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-mb2dk to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-05680-predictor-64bf589d5f-hrsh6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-05680-predictor-64bf589d5f-hrsh6 to ip-10-0-135-87.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-95b80-6db858f4b6-rs95t |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-95b80-6db858f4b6-rs95t to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-ea8a9-858fcbdc6b-vk5wz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-ea8a9-858fcbdc6b-vk5wz to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-05318-predictor-56fccfc459-lk7cr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-05318-predictor-56fccfc459-lk7cr to ip-10-0-135-87.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-05680-predictor-676fcf4866-kvtsw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-05680-predictor-676fcf4866-kvtsw to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-5b4bb9966-sq87t |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-5b4bb9966-sq87t to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-04bd4-predictor-5bf6d6f9fc-74sxd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-04bd4-predictor-5bf6d6f9fc-74sxd to ip-10-0-135-87.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-04bd4-7dcfc7455-bmt9g |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-04bd4-7dcfc7455-bmt9g to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-95b80-predictor-87f46f968-cf625 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-95b80-predictor-87f46f968-cf625 to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-d3ac8-predictor-5bfd49688b-wskcf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-d3ac8-predictor-5bfd49688b-wskcf to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-05318-predictor-6c8d5ffd46-8pjm9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-05318-predictor-6c8d5ffd46-8pjm9 to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-04bd4-predictor-5449bcfd5b-5l4kw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-04bd4-predictor-5449bcfd5b-5l4kw to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-ea8a9-predictor-7487c75d4d-trjdk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-ea8a9-predictor-7487c75d4d-trjdk to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-2e68f-6bb7f9788b-jxnzx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-2e68f-6bb7f9788b-jxnzx to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-05680-7c59cd8f45-tj96h |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-05680-7c59cd8f45-tj96h to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-4ab35-65f87f5997-7wmgp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-4ab35-65f87f5997-7wmgp to ip-10-0-130-107.ec2.internal | ||
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-b95b6754-55kpx |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-555fc69d56 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-555fc69d56-mb2dk | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7eb51-predictor-57447d7988-rk8g9 |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1718" | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-b95b6754-55kpx |
AddedInterface |
Add eth0 [10.134.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-7eb51-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-7eb51-predictor-695f658b7c from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-b95b6754-55kpx |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:2cc17867b5b866a90feccd95d1b7d2c2c966c59c496775c7d4238555c4abef16" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-b95b6754-55kpx |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-b95b6754 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-b95b6754-55kpx | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-b95b6754 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7eb51-predictor-695f658b7c-cmcvh |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-7eb51-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-7eb51-predictor-695f658b7c |
SuccessfulCreate |
Created pod: error-404-isvc-7eb51-predictor-695f658b7c-cmcvh | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-555fc69d56-mb2dk |
AddedInterface |
Add eth0 [10.134.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-555fc69d56 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-7eb51-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-7eb51-predictor-57447d7988 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-6cbcd4578b from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-7eb51-predictor-57447d7988-rk8g9 |
AddedInterface |
Add eth0 [10.134.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-6cbcd4578b |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-6cbcd4578b-st5nv | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-7eb51-predictor-57447d7988 |
SuccessfulCreate |
Created pod: success-200-isvc-7eb51-predictor-57447d7988-rk8g9 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-7eb51-predictor-695f658b7c-cmcvh |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7eb51-predictor-695f658b7c-cmcvh |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1718" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6cbcd4578b-st5nv |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6cbcd4578b-st5nv |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-mb2dk |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-mb2dk |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6cbcd4578b-st5nv |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:2cc17867b5b866a90feccd95d1b7d2c2c966c59c496775c7d4238555c4abef16" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-mb2dk |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:2cc17867b5b866a90feccd95d1b7d2c2c966c59c496775c7d4238555c4abef16" already present on machine | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-6cbcd4578b-st5nv |
AddedInterface |
Add eth0 [10.134.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-mb2dk |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-b95b6754-55kpx |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1718" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6cbcd4578b-st5nv |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1718" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7eb51-predictor-695f658b7c-cmcvh |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7eb51-predictor-695f658b7c-cmcvh |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1718" in 13.028s (13.028s including waiting). Image size: 1334626411 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7eb51-predictor-695f658b7c-cmcvh |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7eb51-predictor-695f658b7c-cmcvh |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7eb51-predictor-695f658b7c-cmcvh |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7eb51-predictor-695f658b7c-cmcvh |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7eb51-predictor-695f658b7c-cmcvh |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.351s (2.351s including waiting). Image size: 211946088 bytes. | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7eb51-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7eb51-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-b95b6754-55kpx |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7eb51-predictor-57447d7988-rk8g9 |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1718" in 31.329s (31.329s including waiting). Image size: 1335542386 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-b95b6754-55kpx |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1718" in 25.983s (25.983s including waiting). Image size: 1558048695 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6cbcd4578b-st5nv |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6cbcd4578b-st5nv |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6cbcd4578b-st5nv |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-b95b6754-55kpx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-b95b6754-55kpx |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7eb51-predictor-57447d7988-rk8g9 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6cbcd4578b-st5nv |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1718" in 25.992s (25.992s including waiting). Image size: 1558048695 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7eb51-predictor-57447d7988-rk8g9 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7eb51-predictor-57447d7988-rk8g9 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-mb2dk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-mb2dk |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 26.909s (26.909s including waiting). Image size: 1305579259 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-mb2dk |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-mb2dk |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7eb51-predictor-57447d7988-rk8g9 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-b95b6754-55kpx |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6cbcd4578b-st5nv |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 3.322s (3.322s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7eb51-predictor-57447d7988-rk8g9 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 3.34s (3.34s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6cbcd4578b-st5nv |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7eb51-predictor-57447d7988-rk8g9 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-mb2dk |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-mb2dk |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-mb2dk |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.397s (2.397s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6cbcd4578b-st5nv |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-b95b6754-55kpx |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-b95b6754-55kpx |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 3.286s (3.286s including waiting). Image size: 211946088 bytes. | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7eb51-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7eb51-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-7eb51-predictor-695f658b7c-cmcvh |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.28:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7eb51 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7eb51 |
InferenceServiceReady |
InferenceService [error-404-isvc-7eb51] is Ready | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7eb51 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7eb51 |
InferenceServiceReady |
InferenceService [success-200-isvc-7eb51] is Ready | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7eb51-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7eb51-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-7eb51 |
ScalingReplicaSet |
Scaled up replica set switch-graph-7eb51-75dbc6577f from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-7eb51-75dbc6577f |
SuccessfulCreate |
Created pod: switch-graph-7eb51-75dbc6577f-5fksf | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-7eb51 |
InferenceGraphReady |
InferenceGraph [switch-graph-7eb51] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-7eb51-75dbc6577f-5fksf |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:ca397e15b1543e93aa4e1a356a8044fcde053006c48bc96dcdc7be3239e40e13" | |
kserve-ci-e2e-test |
multus |
switch-graph-7eb51-75dbc6577f-5fksf |
AddedInterface |
Add eth0 [10.134.0.26/23] from ovn-kubernetes | |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-b95b6754-55kpx |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.22:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
switch-graph-7eb51-75dbc6577f-5fksf |
Started |
Started container switch-graph-7eb51 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-7eb51-75dbc6577f-5fksf |
Created |
Created container: switch-graph-7eb51 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-7eb51-75dbc6577f-5fksf |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:ca397e15b1543e93aa4e1a356a8044fcde053006c48bc96dcdc7be3239e40e13" in 2.625s (2.625s including waiting). Image size: 218071166 bytes. | |
| (x8) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7eb51-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7eb51-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ea8a9 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-ea8a9": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-ea8a9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-ea8a9-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-ea8a9-predictor-7487c75d4d from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7eb51-predictor-57447d7988-rk8g9 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ea8a9 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-ea8a9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ea8a9 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-ea8a9": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-ea8a9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
switch-graph-7eb51-75dbc6577f-5fksf |
Killing |
Stopping container switch-graph-7eb51 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ea8a9-predictor-74877969-qprj9 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-ea8a9-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-ea8a9-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-ea8a9-predictor-74877969 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-ea8a9-predictor-74877969 |
SuccessfulCreate |
Created pod: error-404-isvc-ea8a9-predictor-74877969-qprj9 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ea8a9 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-ea8a9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7eb51-predictor-695f658b7c-cmcvh |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7eb51-predictor-695f658b7c-cmcvh |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7eb51-predictor-57447d7988-rk8g9 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea8a9-predictor-7487c75d4d-trjdk |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-ea8a9-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-ea8a9-predictor-7487c75d4d |
SuccessfulCreate |
Created pod: success-200-isvc-ea8a9-predictor-7487c75d4d-trjdk | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea8a9-predictor-7487c75d4d-trjdk |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-ea8a9-predictor-74877969-qprj9 |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ea8a9-predictor-74877969-qprj9 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1718" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ea8a9-predictor-74877969-qprj9 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ea8a9-predictor-74877969-qprj9 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ea8a9-predictor-74877969-qprj9 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ea8a9-predictor-74877969-qprj9 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ea8a9-predictor-74877969-qprj9 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-ea8a9-predictor-7487c75d4d-trjdk |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea8a9-predictor-7487c75d4d-trjdk |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea8a9-predictor-7487c75d4d-trjdk |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea8a9-predictor-7487c75d4d-trjdk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea8a9-predictor-7487c75d4d-trjdk |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea8a9-predictor-7487c75d4d-trjdk |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1718" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7eb51-predictor-57447d7988-rk8g9 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.23:8643/healthz": dial tcp 10.134.0.23:8643: connect: connection refused | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-7eb51-predictor-57447d7988-rk8g9 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.23:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
model-chainer-5b4bb9966-sq87t |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "model-chainer-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-5b4bb9966 |
SuccessfulCreate |
Created pod: model-chainer-5b4bb9966-sq87t | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-5b4bb9966 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
multus |
model-chainer-5b4bb9966-sq87t |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
model-chainer-5b4bb9966-sq87t |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:ca397e15b1543e93aa4e1a356a8044fcde053006c48bc96dcdc7be3239e40e13" already present on machine | |
kserve-ci-e2e-test |
kubelet |
model-chainer-5b4bb9966-sq87t |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-5b4bb9966-sq87t |
Started |
Started container model-chainer | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-7eb51-75dbc6577f-5fksf |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6cbcd4578b-st5nv |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-04bd4-predictor-5449bcfd5b-5l4kw |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-04bd4-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-04bd4-predictor-5bf6d6f9fc from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-04bd4-predictor-5449bcfd5b-5l4kw |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
model-chainer-5b4bb9966-sq87t |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-04bd4-predictor-5449bcfd5b |
SuccessfulCreate |
Created pod: success-200-isvc-04bd4-predictor-5449bcfd5b-5l4kw | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-b95b6754-55kpx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-04bd4-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-04bd4-predictor-5449bcfd5b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-04bd4-predictor-5449bcfd5b-5l4kw |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-mb2dk |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-04bd4-predictor-5449bcfd5b-5l4kw |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-04bd4-predictor-5449bcfd5b-5l4kw |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-mb2dk |
Killing |
Stopping container kserve-container | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ea8a9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-b95b6754-55kpx |
Killing |
Stopping container kube-rbac-proxy | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ea8a9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-04bd4-predictor-5449bcfd5b-5l4kw |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1718" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6cbcd4578b-st5nv |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-04bd4-predictor-5bf6d6f9fc-74sxd |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-04bd4-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
success-200-isvc-04bd4-predictor-5449bcfd5b-5l4kw |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-04bd4-predictor-5bf6d6f9fc |
SuccessfulCreate |
Created pod: error-404-isvc-04bd4-predictor-5bf6d6f9fc-74sxd | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-04bd4-predictor-5bf6d6f9fc-74sxd |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-04bd4-predictor-5bf6d6f9fc-74sxd |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-04bd4-predictor-5bf6d6f9fc-74sxd |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-04bd4-predictor-5bf6d6f9fc-74sxd |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-04bd4-predictor-5bf6d6f9fc-74sxd |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-04bd4-predictor-5bf6d6f9fc-74sxd |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1718" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-04bd4-predictor-5bf6d6f9fc-74sxd |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-b95b6754-55kpx |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.22:8643/healthz": dial tcp 10.134.0.22:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6cbcd4578b-st5nv |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.25:8643/healthz": dial tcp 10.134.0.25:8643: connect: connection refused | |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-mb2dk |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.24:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-mb2dk |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.24:8643/healthz": dial tcp 10.134.0.24:8643: connect: connection refused | |
| (x10) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-6cbcd4578b-st5nv |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.25:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-b95b6754-55kpx |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.22:8080: i/o timeout | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-ea8a9-predictor-74877969-qprj9 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.29:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea8a9-predictor-7487c75d4d-trjdk |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.27:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ea8a9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ea8a9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ea8a9 |
InferenceServiceReady |
InferenceService [success-200-isvc-ea8a9] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ea8a9 |
InferenceServiceReady |
InferenceService [error-404-isvc-ea8a9] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ea8a9 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ea8a9 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-5b4bb9966-sq87t |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-ea8a9-858fcbdc6b |
SuccessfulCreate |
Created pod: switch-graph-ea8a9-858fcbdc6b-vk5wz | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-04bd4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-04bd4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-04bd4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-ea8a9 |
InferenceGraphReady |
InferenceGraph [switch-graph-ea8a9] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-04bd4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-ea8a9 |
ScalingReplicaSet |
Scaled up replica set switch-graph-ea8a9-858fcbdc6b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-ea8a9-858fcbdc6b-vk5wz |
Started |
Started container switch-graph-ea8a9 | |
kserve-ci-e2e-test |
multus |
switch-graph-ea8a9-858fcbdc6b-vk5wz |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-ea8a9-858fcbdc6b-vk5wz |
Created |
Created container: switch-graph-ea8a9 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-ea8a9-858fcbdc6b-vk5wz |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:ca397e15b1543e93aa4e1a356a8044fcde053006c48bc96dcdc7be3239e40e13" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-04bd4-predictor-5bf6d6f9fc-74sxd |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.30:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ea8a9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ea8a9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-ea8a9 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-ea8a9 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ea8a9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ea8a9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-04bd4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-04bd4 |
InferenceServiceReady |
InferenceService [success-200-isvc-04bd4] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-04bd4 |
InferenceServiceReady |
InferenceService [error-404-isvc-04bd4] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-04bd4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
kubelet |
sequence-graph-04bd4-7dcfc7455-bmt9g |
Started |
Started container sequence-graph-04bd4 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-04bd4 |
UpdateFailed |
Failed to update status for InferenceGraph "sequence-graph-04bd4": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-04bd4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-04bd4-7dcfc7455-bmt9g |
Created |
Created container: sequence-graph-04bd4 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-04bd4-7dcfc7455-bmt9g |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:ca397e15b1543e93aa4e1a356a8044fcde053006c48bc96dcdc7be3239e40e13" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-04bd4-7dcfc7455 |
SuccessfulCreate |
Created pod: sequence-graph-04bd4-7dcfc7455-bmt9g | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-ea8a9 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-ea8a9 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-04bd4 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-04bd4-7dcfc7455 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
sequence-graph-04bd4-7dcfc7455-bmt9g |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-04bd4 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-04bd4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-04bd4 |
InferenceGraphReady |
InferenceGraph [sequence-graph-04bd4] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-04bd4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-04bd4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-04bd4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-04bd4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-04bd4 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-04bd4 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d3ac8-predictor-5bfd49688b-wskcf |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d3ac8 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-d3ac8": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-d3ac8": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d3ac8-predictor-5bfd49688b-wskcf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d3ac8-predictor-5bfd49688b-wskcf |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1718" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d3ac8 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-d3ac8": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea8a9-predictor-7487c75d4d-trjdk |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-d3ac8-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-d3ac8-predictor-59486dd895 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-d3ac8-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-d3ac8-predictor-5bfd49688b from 0 to 1 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-d3ac8-predictor-59486dd895-2dj4n |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-ea8a9-858fcbdc6b-vk5wz |
Killing |
Stopping container switch-graph-ea8a9 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d3ac8-predictor-59486dd895-2dj4n |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d3ac8-predictor-59486dd895-2dj4n |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d3ac8-predictor-59486dd895-2dj4n |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ea8a9-predictor-74877969-qprj9 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d3ac8 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-d3ac8": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d3ac8 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-d3ac8": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-d3ac8": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d3ac8-predictor-5bfd49688b-wskcf |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-d3ac8-predictor-5bfd49688b-wskcf |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-d3ac8-predictor-59486dd895 |
SuccessfulCreate |
Created pod: error-404-isvc-d3ac8-predictor-59486dd895-2dj4n | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d3ac8-predictor-59486dd895-2dj4n |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1718" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-d3ac8-predictor-5bfd49688b |
SuccessfulCreate |
Created pod: success-200-isvc-d3ac8-predictor-5bfd49688b-wskcf | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d3ac8-predictor-5bfd49688b-wskcf |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ea8a9-predictor-74877969-qprj9 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d3ac8-predictor-5bfd49688b-wskcf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea8a9-predictor-7487c75d4d-trjdk |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d3ac8-predictor-59486dd895-2dj4n |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d3ac8-predictor-59486dd895-2dj4n |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d3ac8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d3ac8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-ea8a9-858fcbdc6b-vk5wz |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
sequence-graph-04bd4-7dcfc7455-bmt9g |
Killing |
Stopping container sequence-graph-04bd4 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2e68f-predictor-59fc976fc5-4bbnk |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2e68f-predictor-96b67d9d6-c2ppj |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-2e68f |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-2e68f": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-2e68f |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-2e68f": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-2e68f": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-04bd4-predictor-5449bcfd5b-5l4kw |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-04bd4-predictor-5449bcfd5b-5l4kw |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-2e68f-predictor-59fc976fc5-4bbnk |
AddedInterface |
Add eth0 [10.133.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2e68f-predictor-59fc976fc5-4bbnk |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1718" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2e68f-predictor-59fc976fc5-4bbnk |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2e68f-predictor-59fc976fc5-4bbnk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2e68f-predictor-59fc976fc5-4bbnk |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-2e68f-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-2e68f-predictor-96b67d9d6 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2e68f-predictor-59fc976fc5-4bbnk |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-2e68f |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-2e68f": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-2e68f |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-2e68f": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-2e68f": the object has been modified; please apply your changes to the latest version and try again | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d3ac8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d3ac8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-2e68f-predictor-96b67d9d6 |
SuccessfulCreate |
Created pod: success-200-isvc-2e68f-predictor-96b67d9d6-c2ppj | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2e68f-predictor-96b67d9d6-c2ppj |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-2e68f-predictor-96b67d9d6-c2ppj |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-2e68f-predictor-59fc976fc5 |
SuccessfulCreate |
Created pod: error-404-isvc-2e68f-predictor-59fc976fc5-4bbnk | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2e68f-predictor-96b67d9d6-c2ppj |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1718" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2e68f-predictor-96b67d9d6-c2ppj |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-2e68f-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-2e68f-predictor-59fc976fc5 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-04bd4-predictor-5bf6d6f9fc-74sxd |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-04bd4-predictor-5bf6d6f9fc-74sxd |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2e68f-predictor-96b67d9d6-c2ppj |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2e68f-predictor-96b67d9d6-c2ppj |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-04bd4-predictor-5449bcfd5b-5l4kw |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.29:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-04bd4-predictor-5449bcfd5b-5l4kw |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.29:8643/healthz": dial tcp 10.134.0.29:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-d3ac8-predictor-5bfd49688b-wskcf |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.32:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-d3ac8-predictor-59486dd895-2dj4n |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.31:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d3ac8 |
InferenceServiceReady |
InferenceService [success-200-isvc-d3ac8] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d3ac8 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d3ac8 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d3ac8 |
InferenceServiceReady |
InferenceService [error-404-isvc-d3ac8] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-04bd4-7dcfc7455-bmt9g |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d3ac8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-2e68f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d3ac8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d3ac8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d3ac8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-d3ac8 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-d3ac8] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-2e68f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-d3ac8-74c8fdd6dd |
SuccessfulCreate |
Created pod: ensemble-graph-d3ac8-74c8fdd6dd-xmccm | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-d3ac8 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-d3ac8-74c8fdd6dd from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-d3ac8-74c8fdd6dd-xmccm |
Started |
Started container ensemble-graph-d3ac8 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-d3ac8-74c8fdd6dd-xmccm |
Created |
Created container: ensemble-graph-d3ac8 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-d3ac8-74c8fdd6dd-xmccm |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:ca397e15b1543e93aa4e1a356a8044fcde053006c48bc96dcdc7be3239e40e13" already present on machine | |
kserve-ci-e2e-test |
multus |
ensemble-graph-d3ac8-74c8fdd6dd-xmccm |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-2e68f-predictor-59fc976fc5-4bbnk |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.32:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-2e68f-predictor-96b67d9d6-c2ppj |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.33:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d3ac8-predictor-5bfd49688b-wskcf |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-fdee6-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-fdee6-predictor-9f587cb6d from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-fdee6 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-fdee6": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-fdee6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-fdee6-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-fdee6-predictor-67f7db74c7 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-fdee6-predictor-67f7db74c7 |
SuccessfulCreate |
Created pod: error-404-isvc-fdee6-predictor-67f7db74c7-mf4lm | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-d3ac8-74c8fdd6dd-xmccm |
Killing |
Stopping container ensemble-graph-d3ac8 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-fdee6 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-fdee6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d3ac8-predictor-5bfd49688b-wskcf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-fdee6 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-fdee6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-fdee6 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-fdee6": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-fdee6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d3ac8-predictor-59486dd895-2dj4n |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d3ac8-predictor-59486dd895-2dj4n |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-fdee6-predictor-9f587cb6d |
SuccessfulCreate |
Created pod: success-200-isvc-fdee6-predictor-9f587cb6d-sjqbk | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fdee6-predictor-67f7db74c7-mf4lm |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1718" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fdee6-predictor-67f7db74c7-mf4lm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fdee6-predictor-9f587cb6d-sjqbk |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fdee6-predictor-67f7db74c7-mf4lm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d3ac8-predictor-5bfd49688b-wskcf |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.32:8643/healthz": dial tcp 10.134.0.32:8643: connect: connection refused | |
kserve-ci-e2e-test |
multus |
success-200-isvc-fdee6-predictor-9f587cb6d-sjqbk |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fdee6-predictor-67f7db74c7-mf4lm |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-fdee6-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
error-404-isvc-fdee6-predictor-67f7db74c7-mf4lm |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fdee6-predictor-9f587cb6d-sjqbk |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fdee6-predictor-9f587cb6d-sjqbk |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fdee6-predictor-9f587cb6d-sjqbk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fdee6-predictor-9f587cb6d-sjqbk |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fdee6-predictor-9f587cb6d-sjqbk |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1718" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fdee6-predictor-67f7db74c7-mf4lm |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fdee6-predictor-67f7db74c7-mf4lm |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fdee6-predictor-67f7db74c7-mf4lm |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d3ac8-predictor-59486dd895-2dj4n |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.31:8643/healthz": dial tcp 10.133.0.31:8643: connect: connection refused | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-2e68f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-2e68f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-2e68f |
InferenceServiceReady |
InferenceService [error-404-isvc-2e68f] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-2e68f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-2e68f |
InferenceServiceReady |
InferenceService [success-200-isvc-2e68f] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-2e68f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-2e68f-6bb7f9788b |
SuccessfulCreate |
Created pod: sequence-graph-2e68f-6bb7f9788b-jxnzx | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-2e68f-6bb7f9788b-jxnzx |
Started |
Started container sequence-graph-2e68f | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-2e68f-6bb7f9788b-jxnzx |
Created |
Created container: sequence-graph-2e68f | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-2e68f |
ScalingReplicaSet |
Scaled up replica set sequence-graph-2e68f-6bb7f9788b from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-2e68f |
InferenceGraphReady |
InferenceGraph [sequence-graph-2e68f] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-2e68f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-2e68f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
sequence-graph-2e68f-6bb7f9788b-jxnzx |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:ca397e15b1543e93aa4e1a356a8044fcde053006c48bc96dcdc7be3239e40e13" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-2e68f-6bb7f9788b-jxnzx |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-2e68f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-2e68f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-d3ac8-74c8fdd6dd-xmccm |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
sequence-graph-2e68f-6bb7f9788b-jxnzx |
Killing |
Stopping container sequence-graph-2e68f | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-4ab35-predictor-5897c6f9ff |
SuccessfulCreate |
Created pod: error-404-isvc-4ab35-predictor-5897c6f9ff-ghl57 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-fdee6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-fdee6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2e68f-predictor-96b67d9d6-c2ppj |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2e68f-predictor-59fc976fc5-4bbnk |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2e68f-predictor-96b67d9d6-c2ppj |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-4ab35-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-4ab35-predictor-5897c6f9ff from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-4ab35-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-4ab35-predictor-565c568f4b from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4ab35 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-4ab35": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-4ab35": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4ab35 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-4ab35": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2e68f-predictor-59fc976fc5-4bbnk |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-4ab35-predictor-565c568f4b |
SuccessfulCreate |
Created pod: success-200-isvc-4ab35-predictor-565c568f4b-ppcbg | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4ab35-predictor-5897c6f9ff-ghl57 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4ab35-predictor-565c568f4b-ppcbg |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1718" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4ab35-predictor-565c568f4b-ppcbg |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-4ab35-predictor-565c568f4b-ppcbg |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4ab35-predictor-5897c6f9ff-ghl57 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4ab35-predictor-565c568f4b-ppcbg |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4ab35-predictor-5897c6f9ff-ghl57 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4ab35-predictor-5897c6f9ff-ghl57 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4ab35-predictor-5897c6f9ff-ghl57 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4ab35-predictor-565c568f4b-ppcbg |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4ab35-predictor-565c568f4b-ppcbg |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4ab35-predictor-5897c6f9ff-ghl57 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1718" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-4ab35-predictor-5897c6f9ff-ghl57 |
AddedInterface |
Add eth0 [10.133.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4ab35-predictor-565c568f4b-ppcbg |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2e68f-predictor-96b67d9d6-c2ppj |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.33:8643/healthz": dial tcp 10.134.0.33:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2e68f-predictor-59fc976fc5-4bbnk |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.32:8643/healthz": dial tcp 10.133.0.32:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-fdee6-predictor-67f7db74c7-mf4lm |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.33:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-fdee6-predictor-9f587cb6d-sjqbk |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.35:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4ab35-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4ab35-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-fdee6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-fdee6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-fdee6 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-fdee6 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-fdee6 |
InferenceServiceReady |
InferenceService [error-404-isvc-fdee6] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-fdee6 |
InferenceServiceReady |
InferenceService [success-200-isvc-fdee6] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-2e68f-6bb7f9788b-jxnzx |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-fdee6-58647fdc98 |
SuccessfulCreate |
Created pod: ensemble-graph-fdee6-58647fdc98-8zx69 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-fdee6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-fdee6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4ab35-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4ab35-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-fdee6 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-fdee6] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-fdee6 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-fdee6-58647fdc98 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
ensemble-graph-fdee6-58647fdc98-8zx69 |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-fdee6-58647fdc98-8zx69 |
Created |
Created container: ensemble-graph-fdee6 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-fdee6-58647fdc98-8zx69 |
Started |
Started container ensemble-graph-fdee6 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-fdee6-58647fdc98-8zx69 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:ca397e15b1543e93aa4e1a356a8044fcde053006c48bc96dcdc7be3239e40e13" already present on machine | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-fdee6 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-fdee6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-fdee6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-fdee6 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-4ab35 |
InferenceServiceReady |
InferenceService [success-200-isvc-4ab35] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-4ab35 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4ab35 |
InferenceServiceReady |
InferenceService [error-404-isvc-4ab35] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4ab35 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-fdee6 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-4ab35 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-4ab35-65f87f5997 from 0 to 1 | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-fdee6 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
multus |
sequence-graph-4ab35-65f87f5997-7wmgp |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-4ab35-65f87f5997 |
SuccessfulCreate |
Created pod: sequence-graph-4ab35-65f87f5997-7wmgp | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-4ab35 |
InferenceGraphReady |
InferenceGraph [sequence-graph-4ab35] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-4ab35-65f87f5997-7wmgp |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:ca397e15b1543e93aa4e1a356a8044fcde053006c48bc96dcdc7be3239e40e13" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-4ab35-65f87f5997-7wmgp |
Created |
Created container: sequence-graph-4ab35 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-4ab35-65f87f5997-7wmgp |
Started |
Started container sequence-graph-4ab35 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4ab35-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-4ab35 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4ab35-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-4ab35 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4ab35-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4ab35-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-4ab35 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-4ab35 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-fdee6-58647fdc98-8zx69 |
Killing |
Stopping container ensemble-graph-fdee6 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-05680 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-05680": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-05680-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-05680-predictor-64bf589d5f from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fdee6-predictor-67f7db74c7-mf4lm |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fdee6-predictor-9f587cb6d-sjqbk |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fdee6-predictor-67f7db74c7-mf4lm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-05680-predictor-676fcf4866 |
SuccessfulCreate |
Created pod: success-200-isvc-05680-predictor-676fcf4866-kvtsw | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-05680-predictor-64bf589d5f |
SuccessfulCreate |
Created pod: error-404-isvc-05680-predictor-64bf589d5f-hrsh6 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-05680-predictor-64bf589d5f-hrsh6 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-05680-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fdee6-predictor-9f587cb6d-sjqbk |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-05680-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-05680-predictor-676fcf4866 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-05680 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-05680": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-05680": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-05680 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-05680": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-05680": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-05680 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-05680": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-05680-predictor-676fcf4866-kvtsw |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-05680-predictor-676fcf4866-kvtsw |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
error-404-isvc-05680-predictor-64bf589d5f-hrsh6 |
AddedInterface |
Add eth0 [10.133.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-05680-predictor-64bf589d5f-hrsh6 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-05680-predictor-64bf589d5f-hrsh6 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-05680-predictor-64bf589d5f-hrsh6 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1718" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-05680-predictor-64bf589d5f-hrsh6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-05680-predictor-64bf589d5f-hrsh6 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-05680-predictor-676fcf4866-kvtsw |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1718" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-05680-predictor-676fcf4866-kvtsw |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-05680-predictor-676fcf4866-kvtsw |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-05680-predictor-676fcf4866-kvtsw |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-05680-predictor-676fcf4866-kvtsw |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-05680-predictor-64bf589d5f-hrsh6 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fdee6-predictor-67f7db74c7-mf4lm |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.33:8643/healthz": context deadline exceeded | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fdee6-predictor-67f7db74c7-mf4lm |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.33:8080: i/o timeout | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-05680-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-05680-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-fdee6-58647fdc98-8zx69 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4ab35-predictor-565c568f4b-ppcbg |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-95b80-predictor-87f46f968 |
SuccessfulCreate |
Created pod: success-200-isvc-95b80-predictor-87f46f968-cf625 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4ab35-predictor-565c568f4b-ppcbg |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-95b80-predictor-6d45f8d7f7 |
SuccessfulCreate |
Created pod: error-404-isvc-95b80-predictor-6d45f8d7f7-hlhtt | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4ab35-predictor-5897c6f9ff-ghl57 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4ab35-predictor-5897c6f9ff-ghl57 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-95b80-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-95b80-predictor-6d45f8d7f7 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-95b80 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-95b80": the object has been modified; please apply your changes to the latest version and try again | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-05680-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-05680-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-95b80 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-95b80": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-95b80": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-95b80 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-95b80": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-95b80": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-95b80 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-95b80": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-95b80-predictor-6d45f8d7f7-hlhtt |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-95b80-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-95b80-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-95b80-predictor-87f46f968 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-4ab35-65f87f5997-7wmgp |
Killing |
Stopping container sequence-graph-4ab35 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-95b80-predictor-87f46f968-cf625 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-95b80-predictor-6d45f8d7f7-hlhtt |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-95b80-predictor-87f46f968-cf625 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1718" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-95b80-predictor-87f46f968-cf625 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-95b80-predictor-87f46f968-cf625 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-95b80-predictor-87f46f968-cf625 |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-95b80-predictor-87f46f968-cf625 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-95b80-predictor-87f46f968-cf625 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-95b80-predictor-6d45f8d7f7-hlhtt |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-95b80-predictor-6d45f8d7f7-hlhtt |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-95b80-predictor-6d45f8d7f7-hlhtt |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1718" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-95b80-predictor-6d45f8d7f7-hlhtt |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-95b80-predictor-6d45f8d7f7-hlhtt |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-95b80-predictor-6d45f8d7f7-hlhtt |
AddedInterface |
Add eth0 [10.133.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4ab35-predictor-565c568f4b-ppcbg |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.37:8643/healthz": dial tcp 10.134.0.37:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-4ab35-predictor-565c568f4b-ppcbg |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.37:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4ab35-predictor-5897c6f9ff-ghl57 |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.34:8643/healthz": dial tcp 10.133.0.34:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-4ab35-predictor-5897c6f9ff-ghl57 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.34:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-05680-predictor-676fcf4866-kvtsw |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.40:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-05680-predictor-64bf589d5f-hrsh6 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.35:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-95b80-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-95b80-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-05680 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-05680 |
InferenceServiceReady |
InferenceService [success-200-isvc-05680] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-05680 |
InferenceServiceReady |
InferenceService [error-404-isvc-05680] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-05680 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-4ab35-65f87f5997-7wmgp |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-05680-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-05680 |
InferenceGraphReady |
InferenceGraph [splitter-graph-05680] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-05680-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-95b80-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-95b80-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-05680-7c59cd8f45 |
SuccessfulCreate |
Created pod: splitter-graph-05680-7c59cd8f45-tj96h | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-05680-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-05680-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-05680 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-05680-7c59cd8f45 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
splitter-graph-05680-7c59cd8f45-tj96h |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-05680-7c59cd8f45-tj96h |
Started |
Started container splitter-graph-05680 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-05680-7c59cd8f45-tj96h |
Created |
Created container: splitter-graph-05680 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-05680-7c59cd8f45-tj96h |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:ca397e15b1543e93aa4e1a356a8044fcde053006c48bc96dcdc7be3239e40e13" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-95b80-predictor-87f46f968-cf625 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.41:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-95b80-predictor-6d45f8d7f7-hlhtt |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.36:8080: connect: connection refused |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-05318-predictor-6c8d5ffd46 |
SuccessfulCreate |
Created pod: success-200-isvc-05318-predictor-6c8d5ffd46-8pjm9 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-05680-7c59cd8f45-tj96h |
Killing |
Stopping container splitter-graph-05680 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-05318 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-05318": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-05318": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-05318 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-05318": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-05680-predictor-676fcf4866-kvtsw |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-05680-predictor-676fcf4866-kvtsw |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-05318-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-05318-predictor-6c8d5ffd46 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-05318-predictor-6c8d5ffd46-8pjm9 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-05318-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-05318-predictor-56fccfc459-lk7cr |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-05318-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-05318-predictor-56fccfc459 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-05318-predictor-56fccfc459 |
SuccessfulCreate |
Created pod: error-404-isvc-05318-predictor-56fccfc459-lk7cr | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-05318-predictor-56fccfc459-lk7cr |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-05318-predictor-56fccfc459-lk7cr |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-05318-predictor-56fccfc459-lk7cr |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-05680-predictor-64bf589d5f-hrsh6 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-05318-predictor-56fccfc459-lk7cr |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-05318-predictor-56fccfc459-lk7cr |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1718" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-05318 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-05318": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-05318 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-05318": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-05318": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-05680-predictor-64bf589d5f-hrsh6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-05318-predictor-56fccfc459-lk7cr |
AddedInterface |
Add eth0 [10.133.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
success-200-isvc-05318-predictor-6c8d5ffd46-8pjm9 |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-05318-predictor-6c8d5ffd46-8pjm9 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-05680-predictor-676fcf4866-kvtsw |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.40:8643/healthz": dial tcp 10.134.0.40:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-05318-predictor-6c8d5ffd46-8pjm9 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-05318-predictor-6c8d5ffd46-8pjm9 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-05318-predictor-6c8d5ffd46-8pjm9 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-05318-predictor-6c8d5ffd46-8pjm9 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-05318-predictor-6c8d5ffd46-8pjm9 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1718" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-95b80 |
InferenceServiceReady |
InferenceService [success-200-isvc-95b80] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-95b80 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-95b80 |
InferenceServiceReady |
InferenceService [error-404-isvc-95b80] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-95b80 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-95b80-6db858f4b6 |
SuccessfulCreate |
Created pod: switch-graph-95b80-6db858f4b6-rs95t | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-95b80-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-95b80 |
InferenceGraphReady |
InferenceGraph [switch-graph-95b80] is Ready | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-95b80 |
UpdateFailed |
Failed to update status for InferenceGraph "switch-graph-95b80": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-95b80": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-95b80 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-95b80": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-95b80 |
ScalingReplicaSet |
Scaled up replica set switch-graph-95b80-6db858f4b6 from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-95b80-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
switch-graph-95b80-6db858f4b6-rs95t |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-95b80-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
switch-graph-95b80-6db858f4b6-rs95t |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-95b80-6db858f4b6-rs95t |
Started |
Started container switch-graph-95b80 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-95b80-6db858f4b6-rs95t |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:ca397e15b1543e93aa4e1a356a8044fcde053006c48bc96dcdc7be3239e40e13" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-95b80-6db858f4b6-rs95t |
Created |
Created container: switch-graph-95b80 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-05680-7c59cd8f45-tj96h |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-05318-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-05318-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-95b80-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-95b80 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-95b80 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-95b80-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-05318-predictor-56fccfc459-lk7cr |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.37:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-05318-predictor-6c8d5ffd46-8pjm9 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.43:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-05318 |
InferenceServiceReady |
InferenceService [error-404-isvc-05318] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-05318 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-05318 |
InferenceServiceReady |
InferenceService [success-200-isvc-05318] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-95b80 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-95b80 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-05318 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-05318 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-05318-8558c6757d from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-05318 |
InferenceGraphReady |
InferenceGraph [splitter-graph-05318] is Ready | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-05318-8558c6757d-frzqc |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-05318-serving-cert" not found | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-05318-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-05318-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-05318-8558c6757d |
SuccessfulCreate |
Created pod: splitter-graph-05318-8558c6757d-frzqc | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-05318-8558c6757d-frzqc |
Created |
Created container: splitter-graph-05318 | |
kserve-ci-e2e-test |
multus |
splitter-graph-05318-8558c6757d-frzqc |
AddedInterface |
Add eth0 [10.134.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-05318-8558c6757d-frzqc |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:ca397e15b1543e93aa4e1a356a8044fcde053006c48bc96dcdc7be3239e40e13" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-05318-8558c6757d-frzqc |
Started |
Started container splitter-graph-05318 | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-05318-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-05318-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-05318 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-05318 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-05318-predictor-6c8d5ffd46-8pjm9 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-05318-predictor-6c8d5ffd46-8pjm9 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-05318-predictor-56fccfc459-lk7cr |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-05318-predictor-56fccfc459-lk7cr |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-05318-8558c6757d-frzqc |
Killing |
Stopping container splitter-graph-05318 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-05318-8558c6757d-frzqc |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
switch-graph-95b80-6db858f4b6-rs95t |
Killing |
Stopping container switch-graph-95b80 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-95b80-predictor-6d45f8d7f7-hlhtt |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-95b80-predictor-87f46f968-cf625 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-95b80-predictor-87f46f968-cf625 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-95b80-predictor-6d45f8d7f7-hlhtt |
Killing |
Stopping container kserve-container | |
| (x5) | kserve-ci-e2e-test |
kubelet |
switch-graph-95b80-6db858f4b6-rs95t |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |