| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
ensemble-graph-0213e-9d9695dfb-m2mzx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-0213e-9d9695dfb-m2mzx to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-b2ca6-predictor-6f7678757b-q5b8k |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-b2ca6-predictor-6f7678757b-q5b8k to ip-10-0-129-145.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-0c611-predictor-55867b6f47-7ssmc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-0c611-predictor-55867b6f47-7ssmc to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-1be4a-predictor-789bcb6475-x8cl6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-1be4a-predictor-789bcb6475-x8cl6 to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-0c611-predictor-54f6b9dc8b-hmvmh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-0c611-predictor-54f6b9dc8b-hmvmh to ip-10-0-129-145.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-0c611-7c9746c8d4-fmcpt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-0c611-7c9746c8d4-fmcpt to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-7d5c8-predictor-595fbbfc94-q5ghv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-7d5c8-predictor-595fbbfc94-q5ghv to ip-10-0-129-145.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-0213e-predictor-6b5fb55459-7xg9m |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-0213e-predictor-6b5fb55459-7xg9m to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-784cb989b8-xx2ph |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-784cb989b8-xx2ph to ip-10-0-129-175.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-7988f94697-hbhs6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7988f94697-hbhs6 to ip-10-0-129-175.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-b2ca6-predictor-5c9ff77945-6n7qt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-b2ca6-predictor-5c9ff77945-6n7qt to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-7d5c8-predictor-db8d55f47-79f75 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-7d5c8-predictor-db8d55f47-79f75 to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-62743-predictor-54cbd885cb-cz89z |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-62743-predictor-54cbd885cb-cz89z to ip-10-0-129-145.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-62743-7bf7944f9c-pj267 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-62743-7bf7944f9c-pj267 to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-44fda-predictor-68df868f8b-md6rk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-44fda-predictor-68df868f8b-md6rk to ip-10-0-129-145.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-3becf-predictor-5fd4d7b59-qf97h |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-3becf-predictor-5fd4d7b59-qf97h to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-22a3d-predictor-86595f965c-2vstd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-22a3d-predictor-86595f965c-2vstd to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-44fda-85c85c6697-bn7lk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-44fda-85c85c6697-bn7lk to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-22a3d-predictor-69444449fb-mvct7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-22a3d-predictor-69444449fb-mvct7 to ip-10-0-129-145.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-65828-predictor-b79ff5787-mv5m4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-65828-predictor-b79ff5787-mv5m4 to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-1be4a-predictor-7d9f6f6594-wlg8z |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-1be4a-predictor-7d9f6f6594-wlg8z to ip-10-0-129-145.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-1be4a-d6b9df876-tkptz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-1be4a-d6b9df876-tkptz to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-5dfcf87bd5-vw8nd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5dfcf87bd5-vw8nd to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-65828-75747dbbc6-px2gk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-65828-75747dbbc6-px2gk to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-b2ca6-6684fd76f-4dcj5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-b2ca6-6684fd76f-4dcj5 to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-0213e-predictor-6bb556f566-44hqn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-0213e-predictor-6bb556f566-44hqn to ip-10-0-129-145.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-766d6fc4c8-mvrn7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-766d6fc4c8-mvrn7 to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-65828-predictor-7fc45d4b74-sspp4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-65828-predictor-7fc45d4b74-sspp4 to ip-10-0-129-145.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-7d5c8-5fbffdc9c5-g5xfd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-7d5c8-5fbffdc9c5-g5xfd to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-44fda-predictor-7b4b7f6c87-bs9s8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-44fda-predictor-7b4b7f6c87-bs9s8 to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-3becf-689b8c8984-dxw8k |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-3becf-689b8c8984-dxw8k to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-22a3d-5498b7b956-qwg8j |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-22a3d-5498b7b956-qwg8j to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-62743-predictor-56cb884845-x67tw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-62743-predictor-56cb884845-x67tw to ip-10-0-143-198.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-3becf-predictor-7846f6d998-8q6cb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-3becf-predictor-7846f6d998-8q6cb to ip-10-0-129-145.ec2.internal | ||
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-b2ca6-predictor-5c9ff77945 |
SuccessfulCreate |
Created pod: success-200-isvc-b2ca6-predictor-5c9ff77945-6n7qt | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b2ca6 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-b2ca6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b2ca6 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-b2ca6": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-b2ca6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-b2ca6-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-b2ca6-predictor-5c9ff77945 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-7988f94697-hbhs6 |
AddedInterface |
Add eth0 [10.132.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-b2ca6-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-b2ca6-predictor-6f7678757b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-7988f94697 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-7988f94697-hbhs6 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7988f94697-hbhs6 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:bcc18d6872a741f58ad083af8b7b38f37e5e040b083e0c0f5222178cff3c7b39" | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-7988f94697 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2ca6-predictor-5c9ff77945-6n7qt |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1256" | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-5dfcf87bd5 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-5dfcf87bd5-vw8nd |
AddedInterface |
Add eth0 [10.134.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-b2ca6-predictor-6f7678757b |
SuccessfulCreate |
Created pod: error-404-isvc-b2ca6-predictor-6f7678757b-q5b8k | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-xx2ph |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:bcc18d6872a741f58ad083af8b7b38f37e5e040b083e0c0f5222178cff3c7b39" | |
kserve-ci-e2e-test |
multus |
success-200-isvc-b2ca6-predictor-5c9ff77945-6n7qt |
AddedInterface |
Add eth0 [10.134.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
error-404-isvc-b2ca6-predictor-6f7678757b-q5b8k |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-784cb989b8-xx2ph |
AddedInterface |
Add eth0 [10.132.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-784cb989b8 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-784cb989b8 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-784cb989b8-xx2ph | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2ca6-predictor-6f7678757b-q5b8k |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1256" | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-5dfcf87bd5 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-5dfcf87bd5-vw8nd | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5dfcf87bd5-vw8nd |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:bcc18d6872a741f58ad083af8b7b38f37e5e040b083e0c0f5222178cff3c7b39" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7988f94697-hbhs6 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:bcc18d6872a741f58ad083af8b7b38f37e5e040b083e0c0f5222178cff3c7b39" in 4.226s (4.226s including waiting). Image size: 299660181 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7988f94697-hbhs6 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-xx2ph |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:bcc18d6872a741f58ad083af8b7b38f37e5e040b083e0c0f5222178cff3c7b39" in 4.055s (4.055s including waiting). Image size: 299660181 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7988f94697-hbhs6 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-xx2ph |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-xx2ph |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5dfcf87bd5-vw8nd |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:bcc18d6872a741f58ad083af8b7b38f37e5e040b083e0c0f5222178cff3c7b39" in 6.051s (6.051s including waiting). Image size: 299660181 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5dfcf87bd5-vw8nd |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5dfcf87bd5-vw8nd |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7988f94697-hbhs6 |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1256" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-xx2ph |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5dfcf87bd5-vw8nd |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1256" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2ca6-predictor-6f7678757b-q5b8k |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2ca6-predictor-6f7678757b-q5b8k |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2ca6-predictor-5c9ff77945-6n7qt |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1256" in 14.045s (14.045s including waiting). Image size: 1334198883 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2ca6-predictor-5c9ff77945-6n7qt |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2ca6-predictor-6f7678757b-q5b8k |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1256" in 14.068s (14.068s including waiting). Image size: 1334191706 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2ca6-predictor-5c9ff77945-6n7qt |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5dfcf87bd5-vw8nd |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5dfcf87bd5-vw8nd |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5dfcf87bd5-vw8nd |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1256" in 6.701s (6.701s including waiting). Image size: 1565185957 bytes. | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b2ca6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b2ca6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7988f94697-hbhs6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7988f94697-hbhs6 |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1256" in 23.993s (23.993s including waiting). Image size: 1565185957 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-xx2ph |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 24.303s (24.303s including waiting). Image size: 1306326779 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-xx2ph |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-xx2ph |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7988f94697-hbhs6 |
Started |
Started container kserve-container | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b2ca6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b2ca6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b2ca6 |
InferenceServiceReady |
InferenceService [success-200-isvc-b2ca6] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b2ca6 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b2ca6 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b2ca6 |
InferenceServiceReady |
InferenceService [error-404-isvc-b2ca6] is Ready | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-b2ca6-6684fd76f |
SuccessfulCreate |
Created pod: switch-graph-b2ca6-6684fd76f-4dcj5 | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-b2ca6 |
ScalingReplicaSet |
Scaled up replica set switch-graph-b2ca6-6684fd76f from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-b2ca6 |
InferenceGraphReady |
InferenceGraph [switch-graph-b2ca6] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b2ca6-6684fd76f-4dcj5 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:3341034f2c7f09c96ac29004b065539fcf20ad6ad51aa1f097312ef91f6a2299" | |
kserve-ci-e2e-test |
multus |
switch-graph-b2ca6-6684fd76f-4dcj5 |
AddedInterface |
Add eth0 [10.134.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-b2ca6 |
UpdateFailed |
Failed to update status for InferenceGraph "switch-graph-b2ca6": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-b2ca6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-b2ca6 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-b2ca6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b2ca6-6684fd76f-4dcj5 |
Created |
Created container: switch-graph-b2ca6 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b2ca6-6684fd76f-4dcj5 |
Started |
Started container switch-graph-b2ca6 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b2ca6-6684fd76f-4dcj5 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:3341034f2c7f09c96ac29004b065539fcf20ad6ad51aa1f097312ef91f6a2299" in 2.897s (2.897s including waiting). Image size: 216232508 bytes. | |
| (x7) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-xx2ph |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.24:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b2ca6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b2ca6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b2ca6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b2ca6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1be4a |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-1be4a": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-1be4a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1be4a-predictor-7d9f6f6594-wlg8z |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1256" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1be4a |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-1be4a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1be4a-predictor-789bcb6475-x8cl6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1be4a-predictor-789bcb6475-x8cl6 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-1be4a-predictor-789bcb6475 |
SuccessfulCreate |
Created pod: success-200-isvc-1be4a-predictor-789bcb6475-x8cl6 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-1be4a-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-1be4a-predictor-789bcb6475 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-1be4a-predictor-789bcb6475-x8cl6 |
AddedInterface |
Add eth0 [10.134.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2ca6-predictor-5c9ff77945-6n7qt |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1be4a-predictor-789bcb6475-x8cl6 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1256" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b2ca6-6684fd76f-4dcj5 |
Killing |
Stopping container switch-graph-b2ca6 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2ca6-predictor-6f7678757b-q5b8k |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-1be4a-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-1be4a-predictor-7d9f6f6594 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1be4a |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-1be4a": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-1be4a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-1be4a-predictor-7d9f6f6594 |
SuccessfulCreate |
Created pod: error-404-isvc-1be4a-predictor-7d9f6f6594-wlg8z | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1be4a |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-1be4a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1be4a-predictor-7d9f6f6594-wlg8z |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1be4a-predictor-7d9f6f6594-wlg8z |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-1be4a-predictor-7d9f6f6594-wlg8z |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-b2ca6-predictor-5c9ff77945-6n7qt |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.23:8080: connect: connection refused |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7988f94697-hbhs6 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.23:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-b2ca6-predictor-6f7678757b-q5b8k |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.28:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1be4a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1be4a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-b2ca6-6684fd76f-4dcj5 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-766d6fc4c8 |
SuccessfulCreate |
Created pod: model-chainer-766d6fc4c8-mvrn7 | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-766d6fc4c8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
model-chainer-766d6fc4c8-mvrn7 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "model-chainer-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
kubelet |
model-chainer-766d6fc4c8-mvrn7 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3341034f2c7f09c96ac29004b065539fcf20ad6ad51aa1f097312ef91f6a2299" already present on machine | |
kserve-ci-e2e-test |
kubelet |
model-chainer-766d6fc4c8-mvrn7 |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-766d6fc4c8-mvrn7 |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
multus |
model-chainer-766d6fc4c8-mvrn7 |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-1be4a-predictor-789bcb6475-x8cl6 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.26:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-1be4a-predictor-7d9f6f6594-wlg8z |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.29:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1be4a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1be4a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-22a3d-predictor-69444449fb-mvct7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-22a3d-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-22a3d-predictor-69444449fb from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-22a3d |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-22a3d": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-22a3d |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-22a3d": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-22a3d": the object has been modified; please apply your changes to the latest version and try again | |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5dfcf87bd5-vw8nd |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.24:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5dfcf87bd5-vw8nd |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-22a3d-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-22a3d-predictor-86595f965c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-22a3d-predictor-86595f965c |
SuccessfulCreate |
Created pod: success-200-isvc-22a3d-predictor-86595f965c-2vstd | |
kserve-ci-e2e-test |
kubelet |
model-chainer-766d6fc4c8-mvrn7 |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7988f94697-hbhs6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-22a3d-predictor-86595f965c-2vstd |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-22a3d-predictor-86595f965c-2vstd |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-22a3d-predictor-86595f965c-2vstd |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1256" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-22a3d-predictor-86595f965c-2vstd |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-xx2ph |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-22a3d-predictor-69444449fb |
SuccessfulCreate |
Created pod: error-404-isvc-22a3d-predictor-69444449fb-mvct7 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-22a3d-predictor-69444449fb-mvct7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-22a3d-predictor-69444449fb-mvct7 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1256" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-22a3d-predictor-69444449fb-mvct7 |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1be4a |
InferenceServiceReady |
InferenceService [success-200-isvc-1be4a] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1be4a |
InferenceServiceReady |
InferenceService [error-404-isvc-1be4a] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1be4a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1be4a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
multus |
switch-graph-1be4a-d6b9df876-tkptz |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-1be4a-d6b9df876-tkptz |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3341034f2c7f09c96ac29004b065539fcf20ad6ad51aa1f097312ef91f6a2299" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-1be4a-d6b9df876-tkptz |
Created |
Created container: switch-graph-1be4a | |
kserve-ci-e2e-test |
kubelet |
switch-graph-1be4a-d6b9df876-tkptz |
Started |
Started container switch-graph-1be4a | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-1be4a |
InferenceGraphReady |
InferenceGraph [switch-graph-1be4a] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-1be4a-d6b9df876 |
SuccessfulCreate |
Created pod: switch-graph-1be4a-d6b9df876-tkptz | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-1be4a |
ScalingReplicaSet |
Scaled up replica set switch-graph-1be4a-d6b9df876 from 0 to 1 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-766d6fc4c8-mvrn7 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1be4a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1be4a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1be4a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1be4a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-22a3d-predictor-69444449fb-mvct7 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.30:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-22a3d-predictor-86595f965c-2vstd |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.28:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-22a3d |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-22a3d |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-22a3d |
InferenceServiceReady |
InferenceService [success-200-isvc-22a3d] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-22a3d |
InferenceServiceReady |
InferenceService [error-404-isvc-22a3d] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-1be4a |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-1be4a |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-22a3d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-22a3d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-22a3d-5498b7b956 |
SuccessfulCreate |
Created pod: sequence-graph-22a3d-5498b7b956-qwg8j | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-22a3d |
ScalingReplicaSet |
Scaled up replica set sequence-graph-22a3d-5498b7b956 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-22a3d |
InferenceGraphReady |
InferenceGraph [sequence-graph-22a3d] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-22a3d-5498b7b956-qwg8j |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-22a3d-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-22a3d-5498b7b956-qwg8j |
Started |
Started container sequence-graph-22a3d | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-22a3d-5498b7b956-qwg8j |
Created |
Created container: sequence-graph-22a3d | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-22a3d-5498b7b956-qwg8j |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3341034f2c7f09c96ac29004b065539fcf20ad6ad51aa1f097312ef91f6a2299" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-22a3d-5498b7b956-qwg8j |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-22a3d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-22a3d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-22a3d |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-22a3d |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0213e |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-0213e": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-0213e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0213e-predictor-6b5fb55459-7xg9m |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0213e-predictor-6bb556f566-44hqn |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0213e-predictor-6bb556f566-44hqn |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1256" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-0213e-predictor-6b5fb55459-7xg9m |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0213e-predictor-6b5fb55459-7xg9m |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1256" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0213e-predictor-6b5fb55459-7xg9m |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-0213e-predictor-6bb556f566-44hqn |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-0213e-predictor-6bb556f566 |
SuccessfulCreate |
Created pod: error-404-isvc-0213e-predictor-6bb556f566-44hqn | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-0213e-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-0213e-predictor-6bb556f566 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1be4a-predictor-7d9f6f6594-wlg8z |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
switch-graph-1be4a-d6b9df876-tkptz |
Killing |
Stopping container switch-graph-1be4a | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-0213e-predictor-6b5fb55459 |
SuccessfulCreate |
Created pod: success-200-isvc-0213e-predictor-6b5fb55459-7xg9m | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-0213e-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-0213e-predictor-6b5fb55459 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0213e-predictor-6bb556f566-44hqn |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1be4a-predictor-789bcb6475-x8cl6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0213e |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-0213e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0213e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0213e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-1be4a-d6b9df876-tkptz |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0213e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0213e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3becf |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-3becf": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-3becf-predictor-5fd4d7b59 |
SuccessfulCreate |
Created pod: success-200-isvc-3becf-predictor-5fd4d7b59-qf97h | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3becf |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-3becf": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-3becf": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-22a3d-predictor-69444449fb-mvct7 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-22a3d-predictor-86595f965c-2vstd |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3becf-predictor-7846f6d998-8q6cb |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1256" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3becf-predictor-7846f6d998-8q6cb |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3becf-predictor-5fd4d7b59-qf97h |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1256" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3becf-predictor-5fd4d7b59-qf97h |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-3becf-predictor-5fd4d7b59-qf97h |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3becf-predictor-5fd4d7b59-qf97h |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-3becf-predictor-7846f6d998-8q6cb |
AddedInterface |
Add eth0 [10.133.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-3becf-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-3becf-predictor-5fd4d7b59 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3becf |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-3becf": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3becf-predictor-7846f6d998-8q6cb |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-22a3d-5498b7b956-qwg8j |
Killing |
Stopping container sequence-graph-22a3d | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-3becf-predictor-7846f6d998 |
SuccessfulCreate |
Created pod: error-404-isvc-3becf-predictor-7846f6d998-8q6cb | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3becf |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-3becf": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-3becf": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-3becf-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-3becf-predictor-7846f6d998 from 0 to 1 | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0213e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0213e |
InferenceServiceReady |
InferenceService [success-200-isvc-0213e] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0213e |
InferenceServiceReady |
InferenceService [error-404-isvc-0213e] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0213e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-0213e-9d9695dfb |
SuccessfulCreate |
Created pod: ensemble-graph-0213e-9d9695dfb-m2mzx | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-0213e |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "ensemble-graph-0213e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-0213e |
UpdateFailed |
Failed to update status for InferenceGraph "ensemble-graph-0213e": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "ensemble-graph-0213e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-0213e |
InferenceGraphReady |
InferenceGraph [ensemble-graph-0213e] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-0213e |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-0213e-9d9695dfb from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-0213e-9d9695dfb-m2mzx |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-0213e-serving-cert" not found |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0213e-9d9695dfb-m2mzx |
Started |
Started container ensemble-graph-0213e | |
kserve-ci-e2e-test |
multus |
ensemble-graph-0213e-9d9695dfb-m2mzx |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0213e-9d9695dfb-m2mzx |
Created |
Created container: ensemble-graph-0213e | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0213e-9d9695dfb-m2mzx |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3341034f2c7f09c96ac29004b065539fcf20ad6ad51aa1f097312ef91f6a2299" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-22a3d-5498b7b956-qwg8j |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0213e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0213e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0213e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0213e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3becf-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3becf-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3becf-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3becf-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-62743-predictor-54cbd885cb-cz89z |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-62743-predictor-56cb884845-x67tw |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-62743-predictor-56cb884845-x67tw |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0213e-predictor-6b5fb55459-7xg9m |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-62743-predictor-56cb884845-x67tw |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1256" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-62743 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-62743": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-62743 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-62743": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-62743": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-62743-predictor-56cb884845-x67tw |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-62743-predictor-56cb884845 |
SuccessfulCreate |
Created pod: success-200-isvc-62743-predictor-56cb884845-x67tw | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0213e-predictor-6bb556f566-44hqn |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-62743-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-62743-predictor-56cb884845 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-62743-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-62743-predictor-54cbd885cb from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-62743-predictor-54cbd885cb |
SuccessfulCreate |
Created pod: error-404-isvc-62743-predictor-54cbd885cb-cz89z | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-62743-predictor-54cbd885cb-cz89z |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-62743-predictor-54cbd885cb-cz89z |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-62743-predictor-54cbd885cb-cz89z |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1256" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0213e-9d9695dfb-m2mzx |
Killing |
Stopping container ensemble-graph-0213e | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-0213e-predictor-6b5fb55459-7xg9m |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.31:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-0213e-predictor-6bb556f566-44hqn |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.31:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-62743-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-62743-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3becf |
InferenceServiceReady |
InferenceService [error-404-isvc-3becf] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3becf |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3becf |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3becf |
InferenceServiceReady |
InferenceService [success-200-isvc-3becf] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-0213e-9d9695dfb-m2mzx |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
sequence-graph-3becf-689b8c8984-dxw8k |
Created |
Created container: sequence-graph-3becf | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-3becf-689b8c8984-dxw8k |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3341034f2c7f09c96ac29004b065539fcf20ad6ad51aa1f097312ef91f6a2299" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-3becf-689b8c8984 |
SuccessfulCreate |
Created pod: sequence-graph-3becf-689b8c8984-dxw8k | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-3becf-689b8c8984-dxw8k |
Started |
Started container sequence-graph-3becf | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-3becf |
InferenceGraphReady |
InferenceGraph [sequence-graph-3becf] is Ready | |
kserve-ci-e2e-test |
multus |
sequence-graph-3becf-689b8c8984-dxw8k |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-3becf |
ScalingReplicaSet |
Scaled up replica set sequence-graph-3becf-689b8c8984 from 0 to 1 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3becf-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3becf-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3becf-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3becf-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-62743-predictor-54cbd885cb-cz89z |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.33:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-62743-predictor-56cb884845-x67tw |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.34:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7d5c8-predictor-595fbbfc94-q5ghv |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-7d5c8-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-7d5c8-predictor-db8d55f47 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-7d5c8-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-7d5c8-predictor-595fbbfc94 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-7d5c8-predictor-595fbbfc94 |
SuccessfulCreate |
Created pod: error-404-isvc-7d5c8-predictor-595fbbfc94-q5ghv | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7d5c8-predictor-595fbbfc94-q5ghv |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-3becf-689b8c8984-dxw8k |
Killing |
Stopping container sequence-graph-3becf | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7d5c8 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-7d5c8": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7d5c8 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-7d5c8": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-7d5c8": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7d5c8-predictor-595fbbfc94-q5ghv |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1256" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-7d5c8-predictor-595fbbfc94-q5ghv |
AddedInterface |
Add eth0 [10.133.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3becf-predictor-7846f6d998-8q6cb |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3becf-predictor-5fd4d7b59-qf97h |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7d5c8 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-7d5c8": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7d5c8 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-7d5c8": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-7d5c8": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7d5c8-predictor-db8d55f47-79f75 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1256" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-7d5c8-predictor-db8d55f47-79f75 |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7d5c8-predictor-db8d55f47-79f75 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7d5c8-predictor-db8d55f47-79f75 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-7d5c8-predictor-db8d55f47 |
SuccessfulCreate |
Created pod: success-200-isvc-7d5c8-predictor-db8d55f47-79f75 | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-3becf-predictor-5fd4d7b59-qf97h |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.32:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-3becf-predictor-7846f6d998-8q6cb |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.32:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-62743 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-62743 |
InferenceServiceReady |
InferenceService [success-200-isvc-62743] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-62743 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-62743 |
InferenceServiceReady |
InferenceService [error-404-isvc-62743] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-62743-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-62743-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7d5c8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7d5c8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-62743 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-62743-7bf7944f9c from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-62743 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-62743] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-62743-7bf7944f9c |
SuccessfulCreate |
Created pod: ensemble-graph-62743-7bf7944f9c-pj267 | |
kserve-ci-e2e-test |
multus |
ensemble-graph-62743-7bf7944f9c-pj267 |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-62743-7bf7944f9c-pj267 |
Started |
Started container ensemble-graph-62743 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-62743-7bf7944f9c-pj267 |
Created |
Created container: ensemble-graph-62743 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-62743-7bf7944f9c-pj267 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3341034f2c7f09c96ac29004b065539fcf20ad6ad51aa1f097312ef91f6a2299" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-3becf-689b8c8984-dxw8k |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7d5c8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7d5c8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-7d5c8-predictor-db8d55f47-79f75 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.36:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-7d5c8-predictor-595fbbfc94-q5ghv |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.34:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-62743-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-62743-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-62743-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-62743-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7d5c8 |
InferenceServiceReady |
InferenceService [success-200-isvc-7d5c8] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7d5c8 |
InferenceServiceReady |
InferenceService [error-404-isvc-7d5c8] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7d5c8 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7d5c8 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-62743 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-62743 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7d5c8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7d5c8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7d5c8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7d5c8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-7d5c8-5fbffdc9c5 |
SuccessfulCreate |
Created pod: sequence-graph-7d5c8-5fbffdc9c5-g5xfd | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-7d5c8 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-7d5c8-5fbffdc9c5 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-7d5c8 |
InferenceGraphReady |
InferenceGraph [sequence-graph-7d5c8] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-7d5c8-5fbffdc9c5-g5xfd |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3341034f2c7f09c96ac29004b065539fcf20ad6ad51aa1f097312ef91f6a2299" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-7d5c8-5fbffdc9c5-g5xfd |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-7d5c8-5fbffdc9c5-g5xfd |
Created |
Created container: sequence-graph-7d5c8 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-7d5c8-5fbffdc9c5-g5xfd |
Started |
Started container sequence-graph-7d5c8 | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-7d5c8 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-7d5c8 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-7d5c8 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-7d5c8 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-44fda |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-44fda": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-44fda": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-44fda-predictor-68df868f8b-md6rk |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-62743-predictor-54cbd885cb-cz89z |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-44fda-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-44fda-predictor-68df868f8b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-44fda-predictor-68df868f8b |
SuccessfulCreate |
Created pod: error-404-isvc-44fda-predictor-68df868f8b-md6rk | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-44fda |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-44fda": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-62743-predictor-56cb884845-x67tw |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-44fda-predictor-68df868f8b-md6rk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-62743-7bf7944f9c-pj267 |
Killing |
Stopping container ensemble-graph-62743 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-44fda-predictor-7b4b7f6c87-bs9s8 |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-44fda-predictor-68df868f8b-md6rk |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1256" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-44fda-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-44fda-predictor-7b4b7f6c87 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-44fda-predictor-7b4b7f6c87 |
SuccessfulCreate |
Created pod: success-200-isvc-44fda-predictor-7b4b7f6c87-bs9s8 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-44fda-predictor-68df868f8b-md6rk |
AddedInterface |
Add eth0 [10.133.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-44fda-predictor-7b4b7f6c87-bs9s8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-44fda-predictor-7b4b7f6c87-bs9s8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-44fda-predictor-7b4b7f6c87-bs9s8 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1256" already present on machine | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-44fda-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-44fda-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-62743-7bf7944f9c-pj267 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-44fda-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-44fda-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
success-200-isvc-65828-predictor-b79ff5787-mv5m4 |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-65828-predictor-7fc45d4b74-sspp4 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-65828-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-65828-predictor-b79ff5787 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-65828-predictor-b79ff5787 |
SuccessfulCreate |
Created pod: success-200-isvc-65828-predictor-b79ff5787-mv5m4 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-65828-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-65828-predictor-7fc45d4b74 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7d5c8-predictor-db8d55f47-79f75 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7d5c8-predictor-595fbbfc94-q5ghv |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-65828-predictor-b79ff5787-mv5m4 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-65828-predictor-b79ff5787-mv5m4 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-65828-predictor-b79ff5787-mv5m4 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1256" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-65828-predictor-7fc45d4b74-sspp4 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-65828-predictor-7fc45d4b74-sspp4 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1256" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-65828-predictor-7fc45d4b74-sspp4 |
AddedInterface |
Add eth0 [10.133.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-65828-predictor-7fc45d4b74 |
SuccessfulCreate |
Created pod: error-404-isvc-65828-predictor-7fc45d4b74-sspp4 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-7d5c8-5fbffdc9c5-g5xfd |
Killing |
Stopping container sequence-graph-7d5c8 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-65828 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-65828": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-65828": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-65828 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-65828": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-44fda |
InferenceServiceReady |
InferenceService [success-200-isvc-44fda] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-44fda |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-44fda |
InferenceServiceReady |
InferenceService [error-404-isvc-44fda] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-44fda |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-44fda |
InferenceGraphReady |
InferenceGraph [splitter-graph-44fda] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-44fda |
ScalingReplicaSet |
Scaled up replica set splitter-graph-44fda-85c85c6697 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-44fda-85c85c6697 |
SuccessfulCreate |
Created pod: splitter-graph-44fda-85c85c6697-bn7lk | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-44fda |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "splitter-graph-44fda": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
splitter-graph-44fda-85c85c6697-bn7lk |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-44fda |
UpdateFailed |
Failed to update status for InferenceGraph "splitter-graph-44fda": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "splitter-graph-44fda": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-44fda-85c85c6697-bn7lk |
Started |
Started container splitter-graph-44fda | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-44fda-85c85c6697-bn7lk |
Created |
Created container: splitter-graph-44fda | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-44fda-85c85c6697-bn7lk |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3341034f2c7f09c96ac29004b065539fcf20ad6ad51aa1f097312ef91f6a2299" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-7d5c8-5fbffdc9c5-g5xfd |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-44fda-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-44fda-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-44fda-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-44fda-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0c611-predictor-55867b6f47-7ssmc |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1256" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-0c611-predictor-54f6b9dc8b |
SuccessfulCreate |
Created pod: error-404-isvc-0c611-predictor-54f6b9dc8b-hmvmh | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-0c611-predictor-55867b6f47 |
SuccessfulCreate |
Created pod: success-200-isvc-0c611-predictor-55867b6f47-7ssmc | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-44fda-85c85c6697-bn7lk |
Killing |
Stopping container splitter-graph-44fda | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-44fda-predictor-68df868f8b-md6rk |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-44fda-predictor-7b4b7f6c87-bs9s8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0c611 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-0c611": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-0c611-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-0c611-predictor-55867b6f47 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0c611-predictor-55867b6f47-7ssmc |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0c611 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-0c611": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-0c611": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
success-200-isvc-0c611-predictor-55867b6f47-7ssmc |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-0c611-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-0c611-predictor-54f6b9dc8b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0c611-predictor-55867b6f47-7ssmc |
Started |
Started container kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-44fda-predictor-7b4b7f6c87-bs9s8 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.39:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0c611-predictor-54f6b9dc8b-hmvmh |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1256" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0c611-predictor-54f6b9dc8b-hmvmh |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0c611-predictor-54f6b9dc8b-hmvmh |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-0c611-predictor-54f6b9dc8b-hmvmh |
AddedInterface |
Add eth0 [10.133.0.37/23] from ovn-kubernetes | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-44fda-predictor-68df868f8b-md6rk |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.35:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-65828-predictor-b79ff5787-mv5m4 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.40:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-65828 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-65828 |
InferenceServiceReady |
InferenceService [error-404-isvc-65828] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-65828 |
InferenceServiceReady |
InferenceService [success-200-isvc-65828] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-65828 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-65828-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-65828-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-44fda-85c85c6697-bn7lk |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-65828 |
ScalingReplicaSet |
Scaled up replica set switch-graph-65828-75747dbbc6 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-65828 |
InferenceGraphReady |
InferenceGraph [switch-graph-65828] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-65828-75747dbbc6 |
SuccessfulCreate |
Created pod: switch-graph-65828-75747dbbc6-px2gk | |
| (x2) | kserve-ci-e2e-test |
kubelet |
switch-graph-65828-75747dbbc6-px2gk |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-65828-serving-cert" not found |
kserve-ci-e2e-test |
kubelet |
switch-graph-65828-75747dbbc6-px2gk |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3341034f2c7f09c96ac29004b065539fcf20ad6ad51aa1f097312ef91f6a2299" already present on machine | |
kserve-ci-e2e-test |
multus |
switch-graph-65828-75747dbbc6-px2gk |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-65828-75747dbbc6-px2gk |
Started |
Started container switch-graph-65828 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-65828-75747dbbc6-px2gk |
Created |
Created container: switch-graph-65828 | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-65828-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-65828-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-0c611-predictor-55867b6f47-7ssmc |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.42:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-0c611-predictor-54f6b9dc8b-hmvmh |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.37:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0c611-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0c611-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0c611-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0c611-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-65828 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-65828 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0c611 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0c611 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0c611 |
InferenceServiceReady |
InferenceService [error-404-isvc-0c611] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0c611 |
InferenceServiceReady |
InferenceService [success-200-isvc-0c611] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-65828-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-65828-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-65828-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-65828-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-65828 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-65828 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-0c611-7c9746c8d4 |
SuccessfulCreate |
Created pod: splitter-graph-0c611-7c9746c8d4-fmcpt | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-0c611 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-0c611-7c9746c8d4 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-0c611 |
InferenceGraphReady |
InferenceGraph [splitter-graph-0c611] is Ready | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-0c611-7c9746c8d4-fmcpt |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3341034f2c7f09c96ac29004b065539fcf20ad6ad51aa1f097312ef91f6a2299" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-0c611-7c9746c8d4-fmcpt |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-0c611-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-0c611-7c9746c8d4-fmcpt |
Created |
Created container: splitter-graph-0c611 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-0c611-7c9746c8d4-fmcpt |
Started |
Started container splitter-graph-0c611 | |
kserve-ci-e2e-test |
multus |
splitter-graph-0c611-7c9746c8d4-fmcpt |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0c611-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0c611-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-0c611 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-0c611 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0c611-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0c611-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-0c611 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-0c611 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0c611-predictor-55867b6f47-7ssmc |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0c611-predictor-54f6b9dc8b-hmvmh |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-0c611-7c9746c8d4-fmcpt |
Killing |
Stopping container splitter-graph-0c611 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-0c611-7c9746c8d4-fmcpt |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-65828-predictor-b79ff5787-mv5m4 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-65828-predictor-7fc45d4b74-sspp4 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
switch-graph-65828-75747dbbc6-px2gk |
Killing |
Stopping container switch-graph-65828 | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-65828-predictor-7fc45d4b74-sspp4 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.36:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-65828-predictor-b79ff5787-mv5m4 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.40:8080: i/o timeout | |
| (x4) | kserve-ci-e2e-test |
kubelet |
switch-graph-65828-75747dbbc6-px2gk |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |