| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
success-200-isvc-f7779-predictor-7699bb9fb4-rxwrz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-f7779-predictor-7699bb9fb4-rxwrz to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-d5b84-predictor-5f6dbb578-r92lm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-d5b84-predictor-5f6dbb578-r92lm to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-9e32c-776f64f998-nnrn7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-9e32c-776f64f998-nnrn7 to ip-10-0-131-216.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-47293-predictor-5dfbf9fb9d-n6bpk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-47293-predictor-5dfbf9fb9d-n6bpk to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-5e366-predictor-5878ff6f5d-xxlgz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-5e366-predictor-5878ff6f5d-xxlgz to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-d5b84-69cb89b9ff-82nhw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-d5b84-69cb89b9ff-82nhw to ip-10-0-131-216.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-71827-6d595bf6fb-cdhrr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-71827-6d595bf6fb-cdhrr to ip-10-0-131-216.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-0cfc3-6c948f8f4d-9c9p8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-0cfc3-6c948f8f4d-9c9p8 to ip-10-0-131-216.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-5e366-554dbc9dc6-g4svh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-5e366-554dbc9dc6-g4svh to ip-10-0-131-216.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-577dc58474-plfqd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-577dc58474-plfqd to ip-10-0-131-216.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-47293-5d9c7b45db-4knmv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-47293-5d9c7b45db-4knmv to ip-10-0-131-216.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-96b39-559b467444-k8w82 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-96b39-559b467444-k8w82 to ip-10-0-131-216.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-67b80-76b69489d8-fzvmr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-67b80-76b69489d8-fzvmr to ip-10-0-131-216.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-0cfc3-predictor-54bcbf5466-s6kjh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-0cfc3-predictor-54bcbf5466-s6kjh to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-7cfc94c67b-rdvnd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7cfc94c67b-rdvnd to ip-10-0-131-216.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-f7779-predictor-647c4cfbf7-2hn4m |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-f7779-predictor-647c4cfbf7-2hn4m to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-784cb989b8-j9rbj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-784cb989b8-j9rbj to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-67b80-predictor-868fcc489f-swmll |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-67b80-predictor-868fcc489f-swmll to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-b7286-654f5769bf-b9kf6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-b7286-654f5769bf-b9kf6 to ip-10-0-131-216.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-67b80-predictor-5856fd8c6b-q6tmf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-67b80-predictor-5856fd8c6b-q6tmf to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-9e32c-predictor-fc768b47c-zgmgj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-9e32c-predictor-fc768b47c-zgmgj to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-f7779-7d4b88fb5-rlzs9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-f7779-7d4b88fb5-rlzs9 to ip-10-0-131-216.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-96b39-predictor-f7d9bd579-jz7pz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-96b39-predictor-f7d9bd579-jz7pz to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-71827-predictor-5df7cd677f-v5rws |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-71827-predictor-5df7cd677f-v5rws to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-5e366-predictor-6c46fdfff9-ngkdt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-5e366-predictor-6c46fdfff9-ngkdt to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-0cfc3-predictor-5f76954b8c-4ft79 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-0cfc3-predictor-5f76954b8c-4ft79 to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-71827-predictor-6cd7d94bb6-bvhmq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-71827-predictor-6cd7d94bb6-bvhmq to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-47293-predictor-558b7974ff-4dtvs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-47293-predictor-558b7974ff-4dtvs to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-d5b84-predictor-585896bd67-xqbm5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-d5b84-predictor-585896bd67-xqbm5 to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-54dccdcc4-n2tq7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54dccdcc4-n2tq7 to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-b7286-predictor-55b765f954-w76bk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-b7286-predictor-55b765f954-w76bk to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-9e32c-predictor-5f45f67fc6-7wnjm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-9e32c-predictor-5f45f67fc6-7wnjm to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-b7286-predictor-7759f757c9-grvmd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-b7286-predictor-7759f757c9-grvmd to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-96b39-predictor-c56f676c4-v9szb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-96b39-predictor-c56f676c4-v9szb to ip-10-0-129-34.ec2.internal | ||
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-f7779-predictor-7699bb9fb4 |
SuccessfulCreate |
Created pod: success-200-isvc-f7779-predictor-7699bb9fb4-rxwrz | |
kserve-ci-e2e-test |
multus |
success-200-isvc-f7779-predictor-7699bb9fb4-rxwrz |
AddedInterface |
Add eth0 [10.132.0.18/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-f7779-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-f7779-predictor-7699bb9fb4 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-f7779 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-f7779": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-f7779": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-f7779 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-f7779": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-j9rbj |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:3370fbcd366f44a8710ac5ab5a02712bec0322005baa64fee46cbff50aae7c18" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54dccdcc4-n2tq7 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:3370fbcd366f44a8710ac5ab5a02712bec0322005baa64fee46cbff50aae7c18" | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-784cb989b8 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-f7779-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-f7779-predictor-647c4cfbf7 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-784cb989b8 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-784cb989b8-j9rbj | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-784cb989b8-j9rbj |
AddedInterface |
Add eth0 [10.132.0.20/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f7779-predictor-647c4cfbf7-2hn4m |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1433" | |
kserve-ci-e2e-test |
multus |
error-404-isvc-f7779-predictor-647c4cfbf7-2hn4m |
AddedInterface |
Add eth0 [10.132.0.19/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-7cfc94c67b-rdvnd |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7cfc94c67b-rdvnd |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:3370fbcd366f44a8710ac5ab5a02712bec0322005baa64fee46cbff50aae7c18" | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-54dccdcc4 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-54dccdcc4 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-54dccdcc4-n2tq7 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f7779-predictor-7699bb9fb4-rxwrz |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1433" | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-f7779-predictor-647c4cfbf7 |
SuccessfulCreate |
Created pod: error-404-isvc-f7779-predictor-647c4cfbf7-2hn4m | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-7cfc94c67b |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-7cfc94c67b-rdvnd | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-7cfc94c67b from 0 to 1 | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-54dccdcc4-n2tq7 |
AddedInterface |
Add eth0 [10.132.0.21/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7cfc94c67b-rdvnd |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:3370fbcd366f44a8710ac5ab5a02712bec0322005baa64fee46cbff50aae7c18" in 4.186s (4.186s including waiting). Image size: 300957076 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7cfc94c67b-rdvnd |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7cfc94c67b-rdvnd |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7cfc94c67b-rdvnd |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1433" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f7779-predictor-7699bb9fb4-rxwrz |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1433" in 17.083s (17.083s including waiting). Image size: 1332291676 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f7779-predictor-7699bb9fb4-rxwrz |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54dccdcc4-n2tq7 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54dccdcc4-n2tq7 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54dccdcc4-n2tq7 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:3370fbcd366f44a8710ac5ab5a02712bec0322005baa64fee46cbff50aae7c18" in 16.07s (16.07s including waiting). Image size: 300957076 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f7779-predictor-7699bb9fb4-rxwrz |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f7779-predictor-647c4cfbf7-2hn4m |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1433" in 16.794s (16.794s including waiting). Image size: 1333460052 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-j9rbj |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:3370fbcd366f44a8710ac5ab5a02712bec0322005baa64fee46cbff50aae7c18" in 16.335s (16.335s including waiting). Image size: 300957076 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-j9rbj |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-j9rbj |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f7779-predictor-647c4cfbf7-2hn4m |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f7779-predictor-647c4cfbf7-2hn4m |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-j9rbj |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54dccdcc4-n2tq7 |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1433" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7cfc94c67b-rdvnd |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1433" in 13.142s (13.142s including waiting). Image size: 1560705952 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7cfc94c67b-rdvnd |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7cfc94c67b-rdvnd |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54dccdcc4-n2tq7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54dccdcc4-n2tq7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54dccdcc4-n2tq7 |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1433" in 6.494s (6.494s including waiting). Image size: 1560705952 bytes. | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-f7779-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-f7779-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-f7779-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-f7779-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-j9rbj |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-j9rbj |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 21.053s (21.053s including waiting). Image size: 1306417403 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-j9rbj |
Created |
Created container: kserve-container | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-f7779-predictor-647c4cfbf7-2hn4m |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.19:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-f7779-predictor-7699bb9fb4-rxwrz |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.18:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-f7779 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-f7779 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-f7779 |
InferenceServiceReady |
InferenceService [error-404-isvc-f7779] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-f7779 |
InferenceServiceReady |
InferenceService [success-200-isvc-f7779] is Ready | |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7cfc94c67b-rdvnd |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.34:8080: connect: connection refused |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54dccdcc4-n2tq7 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.21:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-f7779-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-f7779 |
InferenceGraphReady |
InferenceGraph [switch-graph-f7779] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-f7779 |
ScalingReplicaSet |
Scaled up replica set switch-graph-f7779-7d4b88fb5 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-f7779-7d4b88fb5 |
SuccessfulCreate |
Created pod: switch-graph-f7779-7d4b88fb5-rlzs9 | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-f7779-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-f7779-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-f7779-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
switch-graph-f7779-7d4b88fb5-rlzs9 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:fefd1106bb22731cc766906fbe03e5e23570e9f66dd8c9e94ebe1e7e3a916c30" | |
kserve-ci-e2e-test |
multus |
switch-graph-f7779-7d4b88fb5-rlzs9 |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-f7779-7d4b88fb5-rlzs9 |
Started |
Started container switch-graph-f7779 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-f7779-7d4b88fb5-rlzs9 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:fefd1106bb22731cc766906fbe03e5e23570e9f66dd8c9e94ebe1e7e3a916c30" in 2.886s (2.886s including waiting). Image size: 216232505 bytes. | |
kserve-ci-e2e-test |
kubelet |
switch-graph-f7779-7d4b88fb5-rlzs9 |
Created |
Created container: switch-graph-f7779 | |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-96b39-predictor-c56f676c4-v9szb |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1433" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-96b39-predictor-f7d9bd579-jz7pz |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f7779-predictor-647c4cfbf7-2hn4m |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
switch-graph-f7779-7d4b88fb5-rlzs9 |
Killing |
Stopping container switch-graph-f7779 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f7779-predictor-7699bb9fb4-rxwrz |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-96b39-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-96b39-predictor-f7d9bd579 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-96b39-predictor-f7d9bd579 |
SuccessfulCreate |
Created pod: error-404-isvc-96b39-predictor-f7d9bd579-jz7pz | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-96b39-predictor-c56f676c4 |
SuccessfulCreate |
Created pod: success-200-isvc-96b39-predictor-c56f676c4-v9szb | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-96b39-predictor-f7d9bd579-jz7pz |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-96b39-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-96b39-predictor-c56f676c4 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-96b39-predictor-c56f676c4-v9szb |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-96b39-predictor-c56f676c4-v9szb |
AddedInterface |
Add eth0 [10.132.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-96b39-predictor-f7d9bd579-jz7pz |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1433" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-96b39-predictor-f7d9bd579-jz7pz |
AddedInterface |
Add eth0 [10.132.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-96b39-predictor-c56f676c4-v9szb |
Created |
Created container: kserve-container | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-f7779-7d4b88fb5-rlzs9 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-577dc58474 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-577dc58474 |
SuccessfulCreate |
Created pod: model-chainer-577dc58474-plfqd | |
kserve-ci-e2e-test |
kubelet |
model-chainer-577dc58474-plfqd |
Created |
Created container: model-chainer | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-96b39-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
model-chainer-577dc58474-plfqd |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:fefd1106bb22731cc766906fbe03e5e23570e9f66dd8c9e94ebe1e7e3a916c30" already present on machine | |
kserve-ci-e2e-test |
multus |
model-chainer-577dc58474-plfqd |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
model-chainer-577dc58474-plfqd |
Started |
Started container model-chainer | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-96b39-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-96b39-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-96b39-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
multus |
success-200-isvc-71827-predictor-6cd7d94bb6-bvhmq |
AddedInterface |
Add eth0 [10.132.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-71827-predictor-6cd7d94bb6-bvhmq |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1433" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-71827-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-71827-predictor-6cd7d94bb6 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-71827-predictor-6cd7d94bb6 |
SuccessfulCreate |
Created pod: success-200-isvc-71827-predictor-6cd7d94bb6-bvhmq | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-71827-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-71827-predictor-5df7cd677f from 0 to 1 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-71827-predictor-5df7cd677f-v5rws |
AddedInterface |
Add eth0 [10.132.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-71827-predictor-5df7cd677f-v5rws |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1433" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-71827-predictor-6cd7d94bb6-bvhmq |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-71827-predictor-6cd7d94bb6-bvhmq |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7cfc94c67b-rdvnd |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-71827-predictor-5df7cd677f |
SuccessfulCreate |
Created pod: error-404-isvc-71827-predictor-5df7cd677f-v5rws | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-j9rbj |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54dccdcc4-n2tq7 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-71827-predictor-5df7cd677f-v5rws |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
model-chainer-577dc58474-plfqd |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-71827-predictor-5df7cd677f-v5rws |
Created |
Created container: kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-96b39-predictor-c56f676c4-v9szb |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.22:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-96b39-predictor-f7d9bd579-jz7pz |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.23:8080: connect: connection refused |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-j9rbj |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.20:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-96b39 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-96b39 |
InferenceServiceReady |
InferenceService [success-200-isvc-96b39] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-96b39 |
InferenceServiceReady |
InferenceService [error-404-isvc-96b39] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-96b39 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-577dc58474-plfqd |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-96b39 |
InferenceGraphReady |
InferenceGraph [switch-graph-96b39] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-96b39-559b467444-k8w82 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-96b39-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-96b39 |
ScalingReplicaSet |
Scaled up replica set switch-graph-96b39-559b467444 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-96b39-559b467444 |
SuccessfulCreate |
Created pod: switch-graph-96b39-559b467444-k8w82 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-96b39-559b467444-k8w82 |
Started |
Started container switch-graph-96b39 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-96b39-559b467444-k8w82 |
Created |
Created container: switch-graph-96b39 | |
kserve-ci-e2e-test |
multus |
switch-graph-96b39-559b467444-k8w82 |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-96b39-559b467444-k8w82 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:fefd1106bb22731cc766906fbe03e5e23570e9f66dd8c9e94ebe1e7e3a916c30" already present on machine | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-96b39-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-96b39-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-96b39-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-96b39-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-71827-predictor-6cd7d94bb6-bvhmq |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.24:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-71827-predictor-5df7cd677f-v5rws |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.25:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-71827-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-71827-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-96b39 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-96b39 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-71827-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-71827-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-71827 |
InferenceServiceReady |
InferenceService [success-200-isvc-71827] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-71827 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-71827 |
InferenceServiceReady |
InferenceService [error-404-isvc-71827] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-71827 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-96b39 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-96b39 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-71827 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-71827-6d595bf6fb from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-71827-6d595bf6fb-cdhrr |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:fefd1106bb22731cc766906fbe03e5e23570e9f66dd8c9e94ebe1e7e3a916c30" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-71827-6d595bf6fb-cdhrr |
Started |
Started container sequence-graph-71827 | |
kserve-ci-e2e-test |
multus |
sequence-graph-71827-6d595bf6fb-cdhrr |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-71827-6d595bf6fb |
SuccessfulCreate |
Created pod: sequence-graph-71827-6d595bf6fb-cdhrr | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-71827-6d595bf6fb-cdhrr |
Created |
Created container: sequence-graph-71827 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-71827 |
InferenceGraphReady |
InferenceGraph [sequence-graph-71827] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-71827 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-71827 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-71827-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-71827-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-71827-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-71827-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-71827 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-71827 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0cfc3 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-0cfc3": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-0cfc3": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-96b39-predictor-c56f676c4-v9szb |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-0cfc3-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-0cfc3-predictor-54bcbf5466 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-96b39-559b467444-k8w82 |
Killing |
Stopping container switch-graph-96b39 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0cfc3 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-0cfc3": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
error-404-isvc-0cfc3-predictor-5f76954b8c-4ft79 |
AddedInterface |
Add eth0 [10.132.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0cfc3-predictor-5f76954b8c-4ft79 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1433" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-0cfc3-predictor-54bcbf5466-s6kjh |
AddedInterface |
Add eth0 [10.132.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-0cfc3-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-0cfc3-predictor-5f76954b8c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-0cfc3-predictor-5f76954b8c |
SuccessfulCreate |
Created pod: error-404-isvc-0cfc3-predictor-5f76954b8c-4ft79 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-0cfc3-predictor-54bcbf5466 |
SuccessfulCreate |
Created pod: success-200-isvc-0cfc3-predictor-54bcbf5466-s6kjh | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0cfc3-predictor-54bcbf5466-s6kjh |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0cfc3 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-0cfc3": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-0cfc3": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0cfc3-predictor-5f76954b8c-4ft79 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0cfc3-predictor-5f76954b8c-4ft79 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0cfc3-predictor-54bcbf5466-s6kjh |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0cfc3-predictor-54bcbf5466-s6kjh |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1433" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-96b39-predictor-f7d9bd579-jz7pz |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0cfc3 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-0cfc3": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0cfc3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0cfc3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0cfc3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0cfc3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-96b39-559b467444-k8w82 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-5e366 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-5e366": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-71827-predictor-6cd7d94bb6-bvhmq |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-5e366 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-5e366": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-5e366": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-5e366-predictor-5878ff6f5d |
SuccessfulCreate |
Created pod: success-200-isvc-5e366-predictor-5878ff6f5d-xxlgz | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-5e366-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-5e366-predictor-5878ff6f5d from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-71827-6d595bf6fb-cdhrr |
Killing |
Stopping container sequence-graph-71827 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-5e366-predictor-6c46fdfff9 |
SuccessfulCreate |
Created pod: error-404-isvc-5e366-predictor-6c46fdfff9-ngkdt | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-71827-predictor-5df7cd677f-v5rws |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-5e366-predictor-5878ff6f5d-xxlgz |
AddedInterface |
Add eth0 [10.132.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5e366-predictor-6c46fdfff9-ngkdt |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5e366-predictor-5878ff6f5d-xxlgz |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1433" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5e366-predictor-6c46fdfff9-ngkdt |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1433" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-5e366-predictor-6c46fdfff9-ngkdt |
AddedInterface |
Add eth0 [10.132.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5e366-predictor-5878ff6f5d-xxlgz |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-5e366 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-5e366": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-5e366": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5e366-predictor-5878ff6f5d-xxlgz |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-5e366 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-5e366": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-5e366-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-5e366-predictor-6c46fdfff9 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5e366-predictor-6c46fdfff9-ngkdt |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0cfc3 |
InferenceServiceReady |
InferenceService [success-200-isvc-0cfc3] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0cfc3 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0cfc3 |
InferenceServiceReady |
InferenceService [error-404-isvc-0cfc3] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0cfc3 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5e366-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5e366-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-71827-6d595bf6fb-cdhrr |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-0cfc3 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-0cfc3-6c948f8f4d from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5e366-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
ensemble-graph-0cfc3-6c948f8f4d-9c9p8 |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-0cfc3-6c948f8f4d |
SuccessfulCreate |
Created pod: ensemble-graph-0cfc3-6c948f8f4d-9c9p8 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0cfc3-6c948f8f4d-9c9p8 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:fefd1106bb22731cc766906fbe03e5e23570e9f66dd8c9e94ebe1e7e3a916c30" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0cfc3-6c948f8f4d-9c9p8 |
Created |
Created container: ensemble-graph-0cfc3 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0cfc3-6c948f8f4d-9c9p8 |
Started |
Started container ensemble-graph-0cfc3 | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-0cfc3 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-0cfc3] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5e366-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0cfc3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0cfc3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0cfc3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0cfc3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-47293-predictor-5dfbf9fb9d-n6bpk |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-47293-predictor-558b7974ff-4dtvs |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-47293-predictor-558b7974ff-4dtvs |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1433" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0cfc3-6c948f8f4d-9c9p8 |
Killing |
Stopping container ensemble-graph-0cfc3 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-47293-predictor-558b7974ff-4dtvs |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-47293-predictor-558b7974ff |
SuccessfulCreate |
Created pod: error-404-isvc-47293-predictor-558b7974ff-4dtvs | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0cfc3-predictor-5f76954b8c-4ft79 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-47293-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-47293-predictor-5dfbf9fb9d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-47293-predictor-5dfbf9fb9d |
SuccessfulCreate |
Created pod: success-200-isvc-47293-predictor-5dfbf9fb9d-n6bpk | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-47293-predictor-5dfbf9fb9d-n6bpk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-47293-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-47293-predictor-558b7974ff from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-47293-predictor-5dfbf9fb9d-n6bpk |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1433" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-47293-predictor-5dfbf9fb9d-n6bpk |
AddedInterface |
Add eth0 [10.132.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-47293 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-47293": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-47293": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-47293 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-47293": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
error-404-isvc-47293-predictor-558b7974ff-4dtvs |
AddedInterface |
Add eth0 [10.132.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0cfc3-predictor-54bcbf5466-s6kjh |
Killing |
Stopping container kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-0cfc3-predictor-54bcbf5466-s6kjh |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.26:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-0cfc3-predictor-5f76954b8c-4ft79 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.27:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-5e366 |
InferenceServiceReady |
InferenceService [success-200-isvc-5e366] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-5e366 |
InferenceServiceReady |
InferenceService [error-404-isvc-5e366] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-5e366 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-5e366 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-47293-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-47293-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-0cfc3-6c948f8f4d-9c9p8 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-5e366-554dbc9dc6 |
SuccessfulCreate |
Created pod: sequence-graph-5e366-554dbc9dc6-g4svh | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-5e366-554dbc9dc6-g4svh |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-5e366-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-5e366 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-5e366-554dbc9dc6 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-5e366 |
InferenceGraphReady |
InferenceGraph [sequence-graph-5e366] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-47293-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-47293-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
sequence-graph-5e366-554dbc9dc6-g4svh |
Created |
Created container: sequence-graph-5e366 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-5e366-554dbc9dc6-g4svh |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:fefd1106bb22731cc766906fbe03e5e23570e9f66dd8c9e94ebe1e7e3a916c30" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-5e366-554dbc9dc6-g4svh |
Started |
Started container sequence-graph-5e366 | |
kserve-ci-e2e-test |
multus |
sequence-graph-5e366-554dbc9dc6-g4svh |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5e366-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5e366-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5e366-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5e366-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d5b84-predictor-585896bd67-xqbm5 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d5b84-predictor-585896bd67-xqbm5 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-d5b84-predictor-585896bd67-xqbm5 |
AddedInterface |
Add eth0 [10.132.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-d5b84-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-d5b84-predictor-585896bd67 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-d5b84-predictor-5f6dbb578-r92lm |
AddedInterface |
Add eth0 [10.132.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-d5b84-predictor-585896bd67 |
SuccessfulCreate |
Created pod: error-404-isvc-d5b84-predictor-585896bd67-xqbm5 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d5b84-predictor-585896bd67-xqbm5 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1433" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-5e366-554dbc9dc6-g4svh |
Killing |
Stopping container sequence-graph-5e366 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5e366-predictor-5878ff6f5d-xxlgz |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d5b84-predictor-5f6dbb578-r92lm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d5b84-predictor-5f6dbb578-r92lm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d5b84-predictor-5f6dbb578-r92lm |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1433" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-d5b84-predictor-5f6dbb578 |
SuccessfulCreate |
Created pod: success-200-isvc-d5b84-predictor-5f6dbb578-r92lm | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-d5b84-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-d5b84-predictor-5f6dbb578 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5e366-predictor-6c46fdfff9-ngkdt |
Killing |
Stopping container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-47293-predictor-5dfbf9fb9d-n6bpk |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.30:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-5e366-predictor-6c46fdfff9-ngkdt |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.29:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-47293-predictor-558b7974ff-4dtvs |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.31:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-5e366-predictor-5878ff6f5d-xxlgz |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.28:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-47293 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-47293 |
InferenceServiceReady |
InferenceService [error-404-isvc-47293] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-47293 |
InferenceServiceReady |
InferenceService [success-200-isvc-47293] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-47293 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d5b84-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d5b84-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d5b84-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d5b84-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-5e366-554dbc9dc6-g4svh |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-47293 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-47293] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-47293 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-47293-5d9c7b45db from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-47293-5d9c7b45db |
SuccessfulCreate |
Created pod: ensemble-graph-47293-5d9c7b45db-4knmv | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-47293-5d9c7b45db-4knmv |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-47293-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-47293-5d9c7b45db-4knmv |
Started |
Started container ensemble-graph-47293 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-47293-5d9c7b45db-4knmv |
Created |
Created container: ensemble-graph-47293 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-47293-5d9c7b45db-4knmv |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:fefd1106bb22731cc766906fbe03e5e23570e9f66dd8c9e94ebe1e7e3a916c30" already present on machine | |
kserve-ci-e2e-test |
multus |
ensemble-graph-47293-5d9c7b45db-4knmv |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-47293-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-47293-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-47293-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-47293-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-d5b84-predictor-5f6dbb578-r92lm |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.32:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-d5b84-predictor-585896bd67-xqbm5 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.33:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-47293 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-47293 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d5b84 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d5b84 |
InferenceServiceReady |
InferenceService [error-404-isvc-d5b84] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d5b84 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d5b84 |
InferenceServiceReady |
InferenceService [success-200-isvc-d5b84] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-d5b84 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-d5b84-69cb89b9ff from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-d5b84 |
UpdateFailed |
Failed to update status for InferenceGraph "sequence-graph-d5b84": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-d5b84": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-d5b84-69cb89b9ff |
SuccessfulCreate |
Created pod: sequence-graph-d5b84-69cb89b9ff-82nhw | |
kserve-ci-e2e-test |
multus |
sequence-graph-d5b84-69cb89b9ff-82nhw |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-d5b84-69cb89b9ff-82nhw |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:fefd1106bb22731cc766906fbe03e5e23570e9f66dd8c9e94ebe1e7e3a916c30" already present on machine | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-d5b84 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-d5b84": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-d5b84 |
InferenceGraphReady |
InferenceGraph [sequence-graph-d5b84] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-d5b84-69cb89b9ff-82nhw |
Created |
Created container: sequence-graph-d5b84 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-d5b84-69cb89b9ff-82nhw |
Started |
Started container sequence-graph-d5b84 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-47293 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d5b84-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d5b84-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-47293 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-d5b84 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-d5b84 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d5b84-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d5b84-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-d5b84 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-d5b84 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-b7286-predictor-55b765f954 |
SuccessfulCreate |
Created pod: success-200-isvc-b7286-predictor-55b765f954-w76bk | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b7286 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-b7286": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b7286-predictor-55b765f954-w76bk |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1433" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b7286-predictor-55b765f954-w76bk |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-b7286-predictor-7759f757c9-grvmd |
AddedInterface |
Add eth0 [10.132.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-47293-5d9c7b45db-4knmv |
Killing |
Stopping container ensemble-graph-47293 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b7286-predictor-55b765f954-w76bk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-b7286-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-b7286-predictor-55b765f954 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-47293-predictor-558b7974ff-4dtvs |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b7286 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-b7286": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-b7286": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
success-200-isvc-b7286-predictor-55b765f954-w76bk |
AddedInterface |
Add eth0 [10.132.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b7286-predictor-7759f757c9-grvmd |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1433" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-47293-predictor-5dfbf9fb9d-n6bpk |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b7286-predictor-7759f757c9-grvmd |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b7286-predictor-7759f757c9-grvmd |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-b7286-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-b7286-predictor-7759f757c9 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-b7286-predictor-7759f757c9 |
SuccessfulCreate |
Created pod: error-404-isvc-b7286-predictor-7759f757c9-grvmd | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b7286 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-b7286": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-b7286": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b7286 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-b7286": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b7286-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b7286-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-47293-5d9c7b45db-4knmv |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
sequence-graph-d5b84-69cb89b9ff-82nhw |
Killing |
Stopping container sequence-graph-d5b84 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-67b80-predictor-868fcc489f-swmll |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-67b80 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-67b80": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-67b80-predictor-5856fd8c6b-q6tmf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-67b80-predictor-868fcc489f-swmll |
AddedInterface |
Add eth0 [10.132.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-67b80-predictor-868fcc489f-swmll |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1433" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-67b80-predictor-5856fd8c6b |
SuccessfulCreate |
Created pod: success-200-isvc-67b80-predictor-5856fd8c6b-q6tmf | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-67b80-predictor-868fcc489f-swmll |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-67b80-predictor-868fcc489f |
SuccessfulCreate |
Created pod: error-404-isvc-67b80-predictor-868fcc489f-swmll | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-67b80-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-67b80-predictor-868fcc489f from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d5b84-predictor-5f6dbb578-r92lm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-67b80-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-67b80-predictor-5856fd8c6b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-67b80-predictor-5856fd8c6b-q6tmf |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1433" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-67b80 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-67b80": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-67b80": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-67b80-predictor-5856fd8c6b-q6tmf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-67b80-predictor-5856fd8c6b-q6tmf |
AddedInterface |
Add eth0 [10.132.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-67b80 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-67b80": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-67b80": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d5b84-predictor-585896bd67-xqbm5 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-67b80 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-67b80": the object has been modified; please apply your changes to the latest version and try again | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b7286-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b7286-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b7286 |
InferenceServiceReady |
InferenceService [error-404-isvc-b7286] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b7286 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b7286 |
InferenceServiceReady |
InferenceService [success-200-isvc-b7286] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b7286 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-d5b84-69cb89b9ff-82nhw |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-67b80-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-b7286-654f5769bf |
SuccessfulCreate |
Created pod: splitter-graph-b7286-654f5769bf-b9kf6 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-67b80-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-67b80-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
splitter-graph-b7286-654f5769bf-b9kf6 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-b7286-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-b7286 |
InferenceGraphReady |
InferenceGraph [splitter-graph-b7286] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-b7286 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-b7286-654f5769bf from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-67b80-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
splitter-graph-b7286-654f5769bf-b9kf6 |
Started |
Started container splitter-graph-b7286 | |
kserve-ci-e2e-test |
multus |
splitter-graph-b7286-654f5769bf-b9kf6 |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-b7286-654f5769bf-b9kf6 |
Created |
Created container: splitter-graph-b7286 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-b7286-654f5769bf-b9kf6 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:fefd1106bb22731cc766906fbe03e5e23570e9f66dd8c9e94ebe1e7e3a916c30" already present on machine | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b7286-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b7286-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b7286-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b7286-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
multus |
success-200-isvc-9e32c-predictor-5f45f67fc6-7wnjm |
AddedInterface |
Add eth0 [10.132.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9e32c-predictor-fc768b47c-zgmgj |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1433" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b7286-predictor-55b765f954-w76bk |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-b7286-654f5769bf-b9kf6 |
Killing |
Stopping container splitter-graph-b7286 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-9e32c-predictor-fc768b47c |
SuccessfulCreate |
Created pod: error-404-isvc-9e32c-predictor-fc768b47c-zgmgj | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b7286-predictor-7759f757c9-grvmd |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9e32c |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-9e32c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9e32c |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-9e32c": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-9e32c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9e32c |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-9e32c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9e32c |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-9e32c": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-9e32c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-9e32c-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-9e32c-predictor-fc768b47c from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9e32c-predictor-5f45f67fc6-7wnjm |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1433" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9e32c-predictor-5f45f67fc6-7wnjm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-9e32c-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-9e32c-predictor-5f45f67fc6 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-9e32c-predictor-5f45f67fc6 |
SuccessfulCreate |
Created pod: success-200-isvc-9e32c-predictor-5f45f67fc6-7wnjm | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9e32c-predictor-5f45f67fc6-7wnjm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-9e32c-predictor-fc768b47c-zgmgj |
AddedInterface |
Add eth0 [10.132.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9e32c-predictor-fc768b47c-zgmgj |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9e32c-predictor-fc768b47c-zgmgj |
Created |
Created container: kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-b7286-predictor-7759f757c9-grvmd |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.35:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-b7286-predictor-55b765f954-w76bk |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.34:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-67b80-predictor-868fcc489f-swmll |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.37:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-67b80-predictor-5856fd8c6b-q6tmf |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.36:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-67b80 |
InferenceServiceReady |
InferenceService [success-200-isvc-67b80] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-67b80 |
InferenceServiceReady |
InferenceService [error-404-isvc-67b80] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-67b80 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-67b80 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9e32c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9e32c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9e32c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9e32c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-b7286-654f5769bf-b9kf6 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-67b80-76b69489d8 |
SuccessfulCreate |
Created pod: switch-graph-67b80-76b69489d8-fzvmr | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-67b80 |
InferenceGraphReady |
InferenceGraph [switch-graph-67b80] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-67b80 |
ScalingReplicaSet |
Scaled up replica set switch-graph-67b80-76b69489d8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-67b80-76b69489d8-fzvmr |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-67b80-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
switch-graph-67b80-76b69489d8-fzvmr |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-67b80-76b69489d8-fzvmr |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:fefd1106bb22731cc766906fbe03e5e23570e9f66dd8c9e94ebe1e7e3a916c30" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-67b80-76b69489d8-fzvmr |
Created |
Created container: switch-graph-67b80 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-67b80-76b69489d8-fzvmr |
Started |
Started container switch-graph-67b80 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-67b80-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-67b80-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-67b80-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-67b80-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-9e32c-predictor-fc768b47c-zgmgj |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.39:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-9e32c-predictor-5f45f67fc6-7wnjm |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.38:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-67b80 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-67b80 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9e32c |
InferenceServiceReady |
InferenceService [error-404-isvc-9e32c] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9e32c |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9e32c |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9e32c |
InferenceServiceReady |
InferenceService [success-200-isvc-9e32c] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-67b80 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-67b80 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-9e32c-776f64f998 |
SuccessfulCreate |
Created pod: splitter-graph-9e32c-776f64f998-nnrn7 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-9e32c-776f64f998-nnrn7 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:fefd1106bb22731cc766906fbe03e5e23570e9f66dd8c9e94ebe1e7e3a916c30" already present on machine | |
kserve-ci-e2e-test |
multus |
splitter-graph-9e32c-776f64f998-nnrn7 |
AddedInterface |
Add eth0 [10.134.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-9e32c |
ScalingReplicaSet |
Scaled up replica set splitter-graph-9e32c-776f64f998 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-9e32c |
InferenceGraphReady |
InferenceGraph [splitter-graph-9e32c] is Ready | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-9e32c-776f64f998-nnrn7 |
Started |
Started container splitter-graph-9e32c | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-9e32c-776f64f998-nnrn7 |
Created |
Created container: splitter-graph-9e32c | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9e32c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9e32c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9e32c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9e32c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-9e32c |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-9e32c |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-9e32c-776f64f998-nnrn7 |
Killing |
Stopping container splitter-graph-9e32c | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9e32c-predictor-fc768b47c-zgmgj |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9e32c-predictor-5f45f67fc6-7wnjm |
Killing |
Stopping container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-9e32c-776f64f998-nnrn7 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-67b80-predictor-868fcc489f-swmll |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-67b80-predictor-5856fd8c6b-q6tmf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
switch-graph-67b80-76b69489d8-fzvmr |
Killing |
Stopping container switch-graph-67b80 | |
| (x5) | kserve-ci-e2e-test |
kubelet |
switch-graph-67b80-76b69489d8-fzvmr |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |