| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
error-404-isvc-0f5d9-predictor-67c84f489d-xh7g8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-0f5d9-predictor-67c84f489d-xh7g8 to ip-10-0-128-74.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-091ad-8999dbf5b-s5rpc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-091ad-8999dbf5b-s5rpc to ip-10-0-134-167.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-56ec1-696b76c44b-v9dvq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-56ec1-696b76c44b-v9dvq to ip-10-0-134-167.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-ebde8-7c98c9c67-6zzq2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-ebde8-7c98c9c67-6zzq2 to ip-10-0-134-167.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-091ad-predictor-bd77f565-lmnzk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-091ad-predictor-bd77f565-lmnzk to ip-10-0-138-88.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-979d7-565d6b4454-s4t4v |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-979d7-565d6b4454-s4t4v to ip-10-0-134-167.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-0f5d9-59b945f668-6xvgw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-0f5d9-59b945f668-6xvgw to ip-10-0-134-167.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-79c585885d-665ck |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-79c585885d-665ck to ip-10-0-134-167.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-6138a-predictor-57b886cd85-wlhjl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-6138a-predictor-57b886cd85-wlhjl to ip-10-0-138-88.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-976d9-predictor-85bdbdc997-7jqm9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-976d9-predictor-85bdbdc997-7jqm9 to ip-10-0-138-88.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-976d9-5dd8566c9d-lqx8z |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-976d9-5dd8566c9d-lqx8z to ip-10-0-134-167.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-b16e7-predictor-75968db7b-fhfcp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-b16e7-predictor-75968db7b-fhfcp to ip-10-0-128-74.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-3596a-predictor-7fd7565d7-hcqrb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-3596a-predictor-7fd7565d7-hcqrb to ip-10-0-138-88.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-5aeb1-predictor-6985d9467-7ss66 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-5aeb1-predictor-6985d9467-7ss66 to ip-10-0-138-88.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-56ec1-predictor-785d9fcb47-mml5g |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-56ec1-predictor-785d9fcb47-mml5g to ip-10-0-138-88.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-6138a-predictor-64d77c84bd-gcvtv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-6138a-predictor-64d77c84bd-gcvtv to ip-10-0-128-74.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-979d7-predictor-79bb6798c8-ssnff |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-979d7-predictor-79bb6798c8-ssnff to ip-10-0-128-74.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-3596a-5c45cb7657-nxb8c |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-3596a-5c45cb7657-nxb8c to ip-10-0-134-167.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-5aeb1-predictor-6455bd6978-5jrrb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-5aeb1-predictor-6455bd6978-5jrrb to ip-10-0-128-74.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-ebde8-predictor-67b74b47f-mdvsd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-ebde8-predictor-67b74b47f-mdvsd to ip-10-0-138-88.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-56ec1-predictor-f476465cd-bqvv7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-56ec1-predictor-f476465cd-bqvv7 to ip-10-0-128-74.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-6138a-58844c49d4-gm2wj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-6138a-58844c49d4-gm2wj to ip-10-0-134-167.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-091ad-predictor-8bbcb8548-l26p2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-091ad-predictor-8bbcb8548-l26p2 to ip-10-0-128-74.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-ebde8-predictor-97d45866-x4f8w |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-ebde8-predictor-97d45866-x4f8w to ip-10-0-128-74.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-3596a-predictor-79bf5f4878-g9cdk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-3596a-predictor-79bf5f4878-g9cdk to ip-10-0-128-74.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-784cb989b8-kl7jj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-784cb989b8-kl7jj to ip-10-0-134-167.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-5aeb1-658b497c45-rh6fs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-5aeb1-658b497c45-rh6fs to ip-10-0-134-167.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-555687cc47-vzzzx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-555687cc47-vzzzx to ip-10-0-138-88.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-976d9-predictor-6bd5967d8d-g7jhq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-976d9-predictor-6bd5967d8d-g7jhq to ip-10-0-128-74.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-979d7-predictor-7fc6dfb459-cs6wc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-979d7-predictor-7fc6dfb459-cs6wc to ip-10-0-138-88.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-0f5d9-predictor-5bc668d579-ggjbg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-0f5d9-predictor-5bc668d579-ggjbg to ip-10-0-138-88.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-b16e7-649b6f987b-vl7zs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-b16e7-649b6f987b-vl7zs to ip-10-0-134-167.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-b16e7-predictor-57c5fdffb5-gqhls |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-b16e7-predictor-57c5fdffb5-gqhls to ip-10-0-138-88.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-84f646df87-bffbt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-84f646df87-bffbt to ip-10-0-134-167.ec2.internal | ||
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-84f646df87 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-84f646df87-bffbt | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-784cb989b8 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-3596a-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-3596a-predictor-79bf5f4878 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-3596a-predictor-79bf5f4878 |
SuccessfulCreate |
Created pod: error-404-isvc-3596a-predictor-79bf5f4878-g9cdk | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-784cb989b8 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-784cb989b8-kl7jj | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-3596a-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-3596a-predictor-7fd7565d7 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-3596a-predictor-7fd7565d7-hcqrb |
AddedInterface |
Add eth0 [10.133.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3596a-predictor-7fd7565d7-hcqrb |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1324" | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-3596a-predictor-7fd7565d7 |
SuccessfulCreate |
Created pod: success-200-isvc-3596a-predictor-7fd7565d7-hcqrb | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-84f646df87 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-3596a-predictor-79bf5f4878-g9cdk |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-784cb989b8-kl7jj |
AddedInterface |
Add eth0 [10.132.0.18/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-kl7jj |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:7891564b4e51a5ce092a1e9384ed42f60185d9ae7d08ed1c84a6936d5b51591b" | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-84f646df87-bffbt |
AddedInterface |
Add eth0 [10.132.0.17/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-555687cc47-vzzzx |
AddedInterface |
Add eth0 [10.133.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-84f646df87-bffbt |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:7891564b4e51a5ce092a1e9384ed42f60185d9ae7d08ed1c84a6936d5b51591b" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555687cc47-vzzzx |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:7891564b4e51a5ce092a1e9384ed42f60185d9ae7d08ed1c84a6936d5b51591b" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3596a-predictor-79bf5f4878-g9cdk |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1324" | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-555687cc47 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-555687cc47 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-555687cc47-vzzzx | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-kl7jj |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-kl7jj |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:7891564b4e51a5ce092a1e9384ed42f60185d9ae7d08ed1c84a6936d5b51591b" in 3.872s (3.872s including waiting). Image size: 301288371 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-kl7jj |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-84f646df87-bffbt |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-84f646df87-bffbt |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:7891564b4e51a5ce092a1e9384ed42f60185d9ae7d08ed1c84a6936d5b51591b" in 4.118s (4.118s including waiting). Image size: 301288371 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-84f646df87-bffbt |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-84f646df87-bffbt |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1324" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-kl7jj |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3596a-predictor-79bf5f4878-g9cdk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3596a-predictor-79bf5f4878-g9cdk |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3596a-predictor-79bf5f4878-g9cdk |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1324" in 11.965s (11.965s including waiting). Image size: 1333165160 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555687cc47-vzzzx |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555687cc47-vzzzx |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3596a-predictor-7fd7565d7-hcqrb |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1324" in 13.847s (13.847s including waiting). Image size: 1331750510 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555687cc47-vzzzx |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:7891564b4e51a5ce092a1e9384ed42f60185d9ae7d08ed1c84a6936d5b51591b" in 13.006s (13.006s including waiting). Image size: 301288371 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3596a-predictor-7fd7565d7-hcqrb |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3596a-predictor-7fd7565d7-hcqrb |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555687cc47-vzzzx |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1324" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555687cc47-vzzzx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555687cc47-vzzzx |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555687cc47-vzzzx |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1324" in 5.554s (5.554s including waiting). Image size: 1560816050 bytes. | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3596a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3596a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-84f646df87-bffbt |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1324" in 23.322s (23.322s including waiting). Image size: 1560816050 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-kl7jj |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 23.701s (23.701s including waiting). Image size: 1306229499 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-84f646df87-bffbt |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-84f646df87-bffbt |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-kl7jj |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-kl7jj |
Started |
Started container kserve-container | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3596a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3596a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-3596a-predictor-79bf5f4878-g9cdk |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.34:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-3596a-predictor-7fd7565d7-hcqrb |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.23:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3596a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3596a |
InferenceServiceReady |
InferenceService [error-404-isvc-3596a] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3596a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3596a |
InferenceServiceReady |
InferenceService [success-200-isvc-3596a] is Ready | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-3596a-5c45cb7657 |
SuccessfulCreate |
Created pod: switch-graph-3596a-5c45cb7657-nxb8c | |
kserve-ci-e2e-test |
kubelet |
switch-graph-3596a-5c45cb7657-nxb8c |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-3596a-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-3596a |
ScalingReplicaSet |
Scaled up replica set switch-graph-3596a-5c45cb7657 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-3596a |
InferenceGraphReady |
InferenceGraph [switch-graph-3596a] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-3596a-5c45cb7657-nxb8c |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:3b3b115d46eef70b552cbfe98b8bff65aa58d128941ae255587d75b0e6a21c53" | |
kserve-ci-e2e-test |
multus |
switch-graph-3596a-5c45cb7657-nxb8c |
AddedInterface |
Add eth0 [10.132.0.19/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-3596a-5c45cb7657-nxb8c |
Created |
Created container: switch-graph-3596a | |
| (x7) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-kl7jj |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.18:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
switch-graph-3596a-5c45cb7657-nxb8c |
Started |
Started container switch-graph-3596a | |
kserve-ci-e2e-test |
kubelet |
switch-graph-3596a-5c45cb7657-nxb8c |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:3b3b115d46eef70b552cbfe98b8bff65aa58d128941ae255587d75b0e6a21c53" in 2.464s (2.464s including waiting). Image size: 216207958 bytes. | |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555687cc47-vzzzx |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.24:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3596a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3596a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
switch-graph-3596a-5c45cb7657-nxb8c |
Killing |
Stopping container switch-graph-3596a | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3596a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6138a-predictor-64d77c84bd-gcvtv |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-6138a-predictor-64d77c84bd |
SuccessfulCreate |
Created pod: error-404-isvc-6138a-predictor-64d77c84bd-gcvtv | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-6138a-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-6138a-predictor-64d77c84bd from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3596a-predictor-7fd7565d7-hcqrb |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6138a |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-6138a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6138a |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-6138a": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-6138a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-6138a-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-6138a-predictor-57b886cd85 from 0 to 1 | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3596a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6138a |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-6138a": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-6138a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6138a |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-6138a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3596a-predictor-79bf5f4878-g9cdk |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-6138a-predictor-57b886cd85 |
SuccessfulCreate |
Created pod: success-200-isvc-6138a-predictor-57b886cd85-wlhjl | |
kserve-ci-e2e-test |
multus |
error-404-isvc-6138a-predictor-64d77c84bd-gcvtv |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6138a-predictor-64d77c84bd-gcvtv |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1324" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6138a-predictor-57b886cd85-wlhjl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6138a-predictor-57b886cd85-wlhjl |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6138a-predictor-57b886cd85-wlhjl |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1324" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-6138a-predictor-57b886cd85-wlhjl |
AddedInterface |
Add eth0 [10.133.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6138a-predictor-64d77c84bd-gcvtv |
Started |
Started container kserve-container | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-3596a-5c45cb7657-nxb8c |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6138a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6138a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6138a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6138a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "model-chainer": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-79c585885d |
SuccessfulCreate |
Created pod: model-chainer-79c585885d-665ck | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-79c585885d from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
UpdateFailed |
Failed to update status for InferenceGraph "model-chainer": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "model-chainer": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
kubelet |
model-chainer-79c585885d-665ck |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
multus |
model-chainer-79c585885d-665ck |
AddedInterface |
Add eth0 [10.132.0.20/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
model-chainer-79c585885d-665ck |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3b3b115d46eef70b552cbfe98b8bff65aa58d128941ae255587d75b0e6a21c53" already present on machine | |
kserve-ci-e2e-test |
kubelet |
model-chainer-79c585885d-665ck |
Created |
Created container: model-chainer | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-6138a-predictor-57b886cd85-wlhjl |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.25:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-6138a-predictor-64d77c84bd-gcvtv |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.35:8080: connect: connection refused |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-b16e7-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-b16e7-predictor-57c5fdffb5 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-555687cc47-vzzzx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
model-chainer-79c585885d-665ck |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
multus |
success-200-isvc-b16e7-predictor-57c5fdffb5-gqhls |
AddedInterface |
Add eth0 [10.133.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-kl7jj |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-b16e7-predictor-75968db7b |
SuccessfulCreate |
Created pod: error-404-isvc-b16e7-predictor-75968db7b-fhfcp | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-b16e7-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-b16e7-predictor-75968db7b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-84f646df87-bffbt |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-b16e7-predictor-57c5fdffb5 |
SuccessfulCreate |
Created pod: success-200-isvc-b16e7-predictor-57c5fdffb5-gqhls | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b16e7-predictor-57c5fdffb5-gqhls |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b16e7-predictor-57c5fdffb5-gqhls |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1324" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b16e7-predictor-57c5fdffb5-gqhls |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b16e7-predictor-75968db7b-fhfcp |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b16e7-predictor-75968db7b-fhfcp |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b16e7-predictor-75968db7b-fhfcp |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1324" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-b16e7-predictor-75968db7b-fhfcp |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6138a |
InferenceServiceReady |
InferenceService [success-200-isvc-6138a] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6138a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-84f646df87-bffbt |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.17:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6138a |
InferenceServiceReady |
InferenceService [error-404-isvc-6138a] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6138a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b16e7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b16e7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b16e7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b16e7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
switch-graph-6138a-58844c49d4-gm2wj |
Started |
Started container switch-graph-6138a | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-6138a |
InferenceGraphReady |
InferenceGraph [switch-graph-6138a] is Ready | |
kserve-ci-e2e-test |
multus |
switch-graph-6138a-58844c49d4-gm2wj |
AddedInterface |
Add eth0 [10.132.0.21/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-6138a-58844c49d4-gm2wj |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3b3b115d46eef70b552cbfe98b8bff65aa58d128941ae255587d75b0e6a21c53" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-6138a-58844c49d4-gm2wj |
Created |
Created container: switch-graph-6138a | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-6138a-58844c49d4 |
SuccessfulCreate |
Created pod: switch-graph-6138a-58844c49d4-gm2wj | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-6138a |
ScalingReplicaSet |
Scaled up replica set switch-graph-6138a-58844c49d4 from 0 to 1 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6138a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6138a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6138a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6138a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-79c585885d-665ck |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-b16e7-predictor-57c5fdffb5-gqhls |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.26:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-b16e7-predictor-75968db7b-fhfcp |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.36:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-6138a |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-6138a |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b16e7 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b16e7 |
InferenceServiceReady |
InferenceService [success-200-isvc-b16e7] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b16e7 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b16e7 |
InferenceServiceReady |
InferenceService [error-404-isvc-b16e7] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-b16e7-649b6f987b |
SuccessfulCreate |
Created pod: sequence-graph-b16e7-649b6f987b-vl7zs | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-b16e7 |
InferenceGraphReady |
InferenceGraph [sequence-graph-b16e7] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-b16e7 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-b16e7-649b6f987b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-b16e7-649b6f987b-vl7zs |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3b3b115d46eef70b552cbfe98b8bff65aa58d128941ae255587d75b0e6a21c53" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-b16e7-649b6f987b-vl7zs |
Created |
Created container: sequence-graph-b16e7 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-b16e7-649b6f987b-vl7zs |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-b16e7-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
sequence-graph-b16e7-649b6f987b-vl7zs |
AddedInterface |
Add eth0 [10.132.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-b16e7-649b6f987b-vl7zs |
Started |
Started container sequence-graph-b16e7 | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b16e7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b16e7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b16e7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b16e7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-b16e7 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-b16e7 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
switch-graph-6138a-58844c49d4-gm2wj |
Killing |
Stopping container switch-graph-6138a | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-091ad-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-091ad-predictor-bd77f565 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6138a-predictor-57b886cd85-wlhjl |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-091ad |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-091ad": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-091ad": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-091ad |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-091ad": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-091ad-predictor-8bbcb8548-l26p2 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1324" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-091ad-predictor-bd77f565 |
SuccessfulCreate |
Created pod: success-200-isvc-091ad-predictor-bd77f565-lmnzk | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-091ad-predictor-8bbcb8548 |
SuccessfulCreate |
Created pod: error-404-isvc-091ad-predictor-8bbcb8548-l26p2 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-091ad-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-091ad-predictor-8bbcb8548 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-091ad-predictor-bd77f565-lmnzk |
AddedInterface |
Add eth0 [10.133.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-091ad-predictor-bd77f565-lmnzk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-091ad-predictor-8bbcb8548-l26p2 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-091ad |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-091ad": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-091ad": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
error-404-isvc-091ad-predictor-8bbcb8548-l26p2 |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-091ad |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-091ad": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-091ad-predictor-bd77f565-lmnzk |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-091ad-predictor-bd77f565-lmnzk |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1324" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6138a-predictor-64d77c84bd-gcvtv |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-091ad-predictor-8bbcb8548-l26p2 |
Started |
Started container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-6138a-58844c49d4-gm2wj |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-091ad-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-091ad-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-091ad-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-091ad-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0f5d9 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-0f5d9": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-0f5d9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0f5d9 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-0f5d9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0f5d9-predictor-5bc668d579-ggjbg |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1324" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0f5d9-predictor-67c84f489d-xh7g8 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1324" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0f5d9-predictor-5bc668d579-ggjbg |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0f5d9-predictor-5bc668d579-ggjbg |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-0f5d9-predictor-5bc668d579 |
SuccessfulCreate |
Created pod: success-200-isvc-0f5d9-predictor-5bc668d579-ggjbg | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b16e7-predictor-75968db7b-fhfcp |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-0f5d9-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-0f5d9-predictor-5bc668d579 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-0f5d9-predictor-67c84f489d-xh7g8 |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0f5d9 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-0f5d9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b16e7-predictor-57c5fdffb5-gqhls |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-b16e7-649b6f987b-vl7zs |
Killing |
Stopping container sequence-graph-b16e7 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0f5d9 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-0f5d9": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-0f5d9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
success-200-isvc-0f5d9-predictor-5bc668d579-ggjbg |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-0f5d9-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-0f5d9-predictor-67c84f489d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-0f5d9-predictor-67c84f489d |
SuccessfulCreate |
Created pod: error-404-isvc-0f5d9-predictor-67c84f489d-xh7g8 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0f5d9-predictor-67c84f489d-xh7g8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0f5d9-predictor-67c84f489d-xh7g8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-091ad |
InferenceServiceReady |
InferenceService [error-404-isvc-091ad] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-091ad |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-091ad |
InferenceServiceReady |
InferenceService [success-200-isvc-091ad] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-091ad |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0f5d9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0f5d9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-091ad-8999dbf5b-s5rpc |
Created |
Created container: ensemble-graph-091ad | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-091ad |
InferenceGraphReady |
InferenceGraph [ensemble-graph-091ad] is Ready | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-091ad-8999dbf5b-s5rpc |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3b3b115d46eef70b552cbfe98b8bff65aa58d128941ae255587d75b0e6a21c53" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-091ad-8999dbf5b |
SuccessfulCreate |
Created pod: ensemble-graph-091ad-8999dbf5b-s5rpc | |
kserve-ci-e2e-test |
multus |
ensemble-graph-091ad-8999dbf5b-s5rpc |
AddedInterface |
Add eth0 [10.132.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-091ad-8999dbf5b-s5rpc |
Started |
Started container ensemble-graph-091ad | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-091ad |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-091ad-8999dbf5b from 0 to 1 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-091ad-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-091ad-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-091ad-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-091ad-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-b16e7-649b6f987b-vl7zs |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-976d9-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-976d9-predictor-6bd5967d8d from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-976d9-predictor-85bdbdc997-7jqm9 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1324" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-976d9 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-976d9": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-976d9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-976d9 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-976d9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-976d9-predictor-6bd5967d8d |
SuccessfulCreate |
Created pod: error-404-isvc-976d9-predictor-6bd5967d8d-g7jhq | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-976d9-predictor-6bd5967d8d-g7jhq |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-976d9-predictor-6bd5967d8d-g7jhq |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-091ad-8999dbf5b-s5rpc |
Killing |
Stopping container ensemble-graph-091ad | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-976d9-predictor-6bd5967d8d-g7jhq |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1324" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-976d9-predictor-6bd5967d8d-g7jhq |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
success-200-isvc-976d9-predictor-85bdbdc997-7jqm9 |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-091ad-predictor-8bbcb8548-l26p2 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-976d9-predictor-85bdbdc997-7jqm9 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-976d9-predictor-85bdbdc997-7jqm9 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-976d9-predictor-85bdbdc997 |
SuccessfulCreate |
Created pod: success-200-isvc-976d9-predictor-85bdbdc997-7jqm9 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-976d9-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-976d9-predictor-85bdbdc997 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-091ad-predictor-bd77f565-lmnzk |
Killing |
Stopping container kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-091ad-predictor-8bbcb8548-l26p2 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.37:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-091ad-predictor-bd77f565-lmnzk |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.27:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-976d9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-976d9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0f5d9 |
InferenceServiceReady |
InferenceService [success-200-isvc-0f5d9] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0f5d9 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0f5d9 |
InferenceServiceReady |
InferenceService [error-404-isvc-0f5d9] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0f5d9 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-091ad-8999dbf5b-s5rpc |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0f5d9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0f5d9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-976d9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-976d9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-0f5d9 |
UpdateFailed |
Failed to update status for InferenceGraph "sequence-graph-0f5d9": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-0f5d9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-0f5d9-59b945f668 |
SuccessfulCreate |
Created pod: sequence-graph-0f5d9-59b945f668-6xvgw | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-0f5d9-59b945f668-6xvgw |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-0f5d9-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-0f5d9 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-0f5d9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-0f5d9 |
InferenceGraphReady |
InferenceGraph [sequence-graph-0f5d9] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-0f5d9 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-0f5d9-59b945f668 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-0f5d9-59b945f668-6xvgw |
Created |
Created container: sequence-graph-0f5d9 | |
kserve-ci-e2e-test |
multus |
sequence-graph-0f5d9-59b945f668-6xvgw |
AddedInterface |
Add eth0 [10.132.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-0f5d9-59b945f668-6xvgw |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3b3b115d46eef70b552cbfe98b8bff65aa58d128941ae255587d75b0e6a21c53" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-0f5d9-59b945f668-6xvgw |
Started |
Started container sequence-graph-0f5d9 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-976d9-predictor-6bd5967d8d-g7jhq |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.39:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-976d9-predictor-85bdbdc997-7jqm9 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.29:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0f5d9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0f5d9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0f5d9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0f5d9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-5aeb1 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-5aeb1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-5aeb1-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-5aeb1-predictor-6985d9467 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0f5d9-predictor-5bc668d579-ggjbg |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0f5d9-predictor-67c84f489d-xh7g8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-5aeb1-predictor-6985d9467 |
SuccessfulCreate |
Created pod: success-200-isvc-5aeb1-predictor-6985d9467-7ss66 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-0f5d9-59b945f668-6xvgw |
Killing |
Stopping container sequence-graph-0f5d9 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-5aeb1 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-5aeb1": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-5aeb1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-5aeb1-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-5aeb1-predictor-6455bd6978 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5aeb1-predictor-6985d9467-7ss66 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1324" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5aeb1-predictor-6455bd6978-5jrrb |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-5aeb1-predictor-6455bd6978-5jrrb |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5aeb1-predictor-6455bd6978-5jrrb |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5aeb1-predictor-6985d9467-7ss66 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-5aeb1-predictor-6985d9467-7ss66 |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5aeb1-predictor-6985d9467-7ss66 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5aeb1-predictor-6455bd6978-5jrrb |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1324" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-5aeb1-predictor-6455bd6978 |
SuccessfulCreate |
Created pod: error-404-isvc-5aeb1-predictor-6455bd6978-5jrrb | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-0f5d9-predictor-5bc668d579-ggjbg |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.28:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-976d9 |
InferenceServiceReady |
InferenceService [error-404-isvc-976d9] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-976d9 |
InferenceServiceReady |
InferenceService [success-200-isvc-976d9] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-976d9 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-976d9 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-0f5d9-predictor-67c84f489d-xh7g8 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.38:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5aeb1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5aeb1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5aeb1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5aeb1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-976d9-5dd8566c9d-lqx8z |
Started |
Started container ensemble-graph-976d9 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-976d9-5dd8566c9d-lqx8z |
Created |
Created container: ensemble-graph-976d9 | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-976d9 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-976d9-5dd8566c9d from 0 to 1 | |
kserve-ci-e2e-test |
multus |
ensemble-graph-976d9-5dd8566c9d-lqx8z |
AddedInterface |
Add eth0 [10.132.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-976d9 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-976d9] is Ready | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-976d9-5dd8566c9d-lqx8z |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3b3b115d46eef70b552cbfe98b8bff65aa58d128941ae255587d75b0e6a21c53" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-976d9-5dd8566c9d |
SuccessfulCreate |
Created pod: ensemble-graph-976d9-5dd8566c9d-lqx8z | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-976d9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-976d9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-976d9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-976d9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-0f5d9-59b945f668-6xvgw |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-5aeb1-predictor-6455bd6978-5jrrb |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.40:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-5aeb1-predictor-6985d9467-7ss66 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.30:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-5aeb1 |
InferenceServiceReady |
InferenceService [error-404-isvc-5aeb1] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-5aeb1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-5aeb1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-5aeb1 |
InferenceServiceReady |
InferenceService [success-200-isvc-5aeb1] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-976d9 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-976d9 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-5aeb1 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-5aeb1-658b497c45 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-5aeb1-658b497c45 |
SuccessfulCreate |
Created pod: sequence-graph-5aeb1-658b497c45-rh6fs | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-5aeb1-658b497c45-rh6fs |
Created |
Created container: sequence-graph-5aeb1 | |
kserve-ci-e2e-test |
multus |
sequence-graph-5aeb1-658b497c45-rh6fs |
AddedInterface |
Add eth0 [10.132.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-5aeb1-658b497c45-rh6fs |
Started |
Started container sequence-graph-5aeb1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-5aeb1 |
InferenceGraphReady |
InferenceGraph [sequence-graph-5aeb1] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-5aeb1-658b497c45-rh6fs |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3b3b115d46eef70b552cbfe98b8bff65aa58d128941ae255587d75b0e6a21c53" already present on machine | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5aeb1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5aeb1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5aeb1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5aeb1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-5aeb1 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-5aeb1 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ebde8-predictor-97d45866-x4f8w |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-ebde8-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-ebde8-predictor-67b74b47f from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ebde8-predictor-97d45866-x4f8w |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1324" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-976d9-5dd8566c9d-lqx8z |
Killing |
Stopping container ensemble-graph-976d9 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-976d9-predictor-6bd5967d8d-g7jhq |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ebde8-predictor-97d45866-x4f8w |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ebde8 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-ebde8": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ebde8 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-ebde8": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-ebde8": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-976d9-predictor-85bdbdc997-7jqm9 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ebde8 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-ebde8": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ebde8 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-ebde8": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-ebde8": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
error-404-isvc-ebde8-predictor-97d45866-x4f8w |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-ebde8-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-ebde8-predictor-97d45866 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-ebde8-predictor-67b74b47f |
SuccessfulCreate |
Created pod: success-200-isvc-ebde8-predictor-67b74b47f-mdvsd | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ebde8-predictor-67b74b47f-mdvsd |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ebde8-predictor-67b74b47f-mdvsd |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ebde8-predictor-67b74b47f-mdvsd |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1324" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-ebde8-predictor-67b74b47f-mdvsd |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-ebde8-predictor-97d45866 |
SuccessfulCreate |
Created pod: error-404-isvc-ebde8-predictor-97d45866-x4f8w | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ebde8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ebde8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-976d9-5dd8566c9d-lqx8z |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ebde8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ebde8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
success-200-isvc-979d7-predictor-7fc6dfb459-cs6wc |
AddedInterface |
Add eth0 [10.133.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5aeb1-predictor-6455bd6978-5jrrb |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-979d7-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-979d7-predictor-79bb6798c8 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-979d7-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-979d7-predictor-7fc6dfb459 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-979d7-predictor-7fc6dfb459 |
SuccessfulCreate |
Created pod: success-200-isvc-979d7-predictor-7fc6dfb459-cs6wc | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-5aeb1-658b497c45-rh6fs |
Killing |
Stopping container sequence-graph-5aeb1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5aeb1-predictor-6985d9467-7ss66 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-979d7-predictor-7fc6dfb459-cs6wc |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1324" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-979d7 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-979d7": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-979d7": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-979d7 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-979d7": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
error-404-isvc-979d7-predictor-79bb6798c8-ssnff |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-979d7-predictor-79bb6798c8 |
SuccessfulCreate |
Created pod: error-404-isvc-979d7-predictor-79bb6798c8-ssnff | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-979d7-predictor-79bb6798c8-ssnff |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-979d7-predictor-79bb6798c8-ssnff |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-979d7-predictor-79bb6798c8-ssnff |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1324" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-979d7-predictor-7fc6dfb459-cs6wc |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-979d7-predictor-7fc6dfb459-cs6wc |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ebde8 |
InferenceServiceReady |
InferenceService [error-404-isvc-ebde8] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ebde8 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ebde8 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ebde8 |
InferenceServiceReady |
InferenceService [success-200-isvc-ebde8] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-979d7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-979d7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-ebde8-7c98c9c67 |
SuccessfulCreate |
Created pod: splitter-graph-ebde8-7c98c9c67-6zzq2 | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-ebde8 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-ebde8-7c98c9c67 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-ebde8-7c98c9c67-6zzq2 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3b3b115d46eef70b552cbfe98b8bff65aa58d128941ae255587d75b0e6a21c53" already present on machine | |
kserve-ci-e2e-test |
multus |
splitter-graph-ebde8-7c98c9c67-6zzq2 |
AddedInterface |
Add eth0 [10.132.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-ebde8-7c98c9c67-6zzq2 |
Created |
Created container: splitter-graph-ebde8 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-ebde8-7c98c9c67-6zzq2 |
Started |
Started container splitter-graph-ebde8 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-ebde8 |
InferenceGraphReady |
InferenceGraph [splitter-graph-ebde8] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ebde8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ebde8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ebde8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ebde8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-5aeb1-658b497c45-rh6fs |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-979d7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-979d7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-56ec1 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-56ec1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-56ec1-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-56ec1-predictor-f476465cd from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-56ec1 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-56ec1": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-56ec1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
error-404-isvc-56ec1-predictor-f476465cd-bqvv7 |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-56ec1-predictor-f476465cd-bqvv7 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1324" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-56ec1-predictor-785d9fcb47-mml5g |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1324" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-56ec1-predictor-785d9fcb47-mml5g |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-56ec1-predictor-785d9fcb47-mml5g |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-56ec1-predictor-f476465cd-bqvv7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-56ec1-predictor-f476465cd |
SuccessfulCreate |
Created pod: error-404-isvc-56ec1-predictor-f476465cd-bqvv7 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-ebde8-7c98c9c67-6zzq2 |
Killing |
Stopping container splitter-graph-ebde8 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-56ec1-predictor-f476465cd-bqvv7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-56ec1 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-56ec1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-56ec1 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-56ec1": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-56ec1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-56ec1-predictor-785d9fcb47-mml5g |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ebde8-predictor-97d45866-x4f8w |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-56ec1-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-56ec1-predictor-785d9fcb47 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-56ec1-predictor-785d9fcb47 |
SuccessfulCreate |
Created pod: success-200-isvc-56ec1-predictor-785d9fcb47-mml5g | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ebde8-predictor-67b74b47f-mdvsd |
Killing |
Stopping container kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-ebde8-predictor-97d45866-x4f8w |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.41:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-ebde8-predictor-67b74b47f-mdvsd |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.31:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-979d7 |
InferenceServiceReady |
InferenceService [error-404-isvc-979d7] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-979d7 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-979d7 |
InferenceServiceReady |
InferenceService [success-200-isvc-979d7] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-979d7 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-ebde8-7c98c9c67-6zzq2 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-979d7 |
InferenceGraphReady |
InferenceGraph [switch-graph-979d7] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-979d7-565d6b4454 |
SuccessfulCreate |
Created pod: switch-graph-979d7-565d6b4454-s4t4v | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-979d7 |
ScalingReplicaSet |
Scaled up replica set switch-graph-979d7-565d6b4454 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-979d7-565d6b4454-s4t4v |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3b3b115d46eef70b552cbfe98b8bff65aa58d128941ae255587d75b0e6a21c53" already present on machine | |
kserve-ci-e2e-test |
multus |
switch-graph-979d7-565d6b4454-s4t4v |
AddedInterface |
Add eth0 [10.132.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-979d7-565d6b4454-s4t4v |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-979d7-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
switch-graph-979d7-565d6b4454-s4t4v |
Created |
Created container: switch-graph-979d7 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-979d7-565d6b4454-s4t4v |
Started |
Started container switch-graph-979d7 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-56ec1-predictor-f476465cd-bqvv7 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.43:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-56ec1-predictor-785d9fcb47-mml5g |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.33:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-979d7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-979d7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-979d7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-979d7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-56ec1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-56ec1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-56ec1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-56ec1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-56ec1 |
InferenceServiceReady |
InferenceService [error-404-isvc-56ec1] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-56ec1 |
InferenceServiceReady |
InferenceService [success-200-isvc-56ec1] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-56ec1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-56ec1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-979d7 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-979d7 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-56ec1 |
UpdateFailed |
Failed to update status for InferenceGraph "splitter-graph-56ec1": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "splitter-graph-56ec1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-56ec1 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-56ec1-696b76c44b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-56ec1-696b76c44b |
SuccessfulCreate |
Created pod: splitter-graph-56ec1-696b76c44b-v9dvq | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-56ec1 |
InferenceGraphReady |
InferenceGraph [splitter-graph-56ec1] is Ready | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-56ec1-696b76c44b-v9dvq |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-56ec1-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-56ec1 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "splitter-graph-56ec1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-56ec1-696b76c44b-v9dvq |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:3b3b115d46eef70b552cbfe98b8bff65aa58d128941ae255587d75b0e6a21c53" already present on machine | |
kserve-ci-e2e-test |
multus |
splitter-graph-56ec1-696b76c44b-v9dvq |
AddedInterface |
Add eth0 [10.132.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-56ec1-696b76c44b-v9dvq |
Started |
Started container splitter-graph-56ec1 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-56ec1-696b76c44b-v9dvq |
Created |
Created container: splitter-graph-56ec1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-56ec1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-56ec1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-56ec1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-56ec1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-56ec1 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-56ec1 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
splitter-graph-56ec1-696b76c44b-v9dvq |
Killing |
Stopping container splitter-graph-56ec1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-56ec1-predictor-785d9fcb47-mml5g |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-56ec1-predictor-f476465cd-bqvv7 |
Killing |
Stopping container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-56ec1-696b76c44b-v9dvq |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-979d7-predictor-7fc6dfb459-cs6wc |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-979d7-predictor-79bb6798c8-ssnff |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
switch-graph-979d7-565d6b4454-s4t4v |
Killing |
Stopping container switch-graph-979d7 | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-979d7-predictor-79bb6798c8-ssnff |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.42:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-979d7-predictor-7fc6dfb459-cs6wc |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.32:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
kubelet |
switch-graph-979d7-565d6b4454-s4t4v |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |