| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
error-404-isvc-258c6-predictor-79cbb6745d-lwxf6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-258c6-predictor-79cbb6745d-lwxf6 to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-e8429-predictor-7dc75fffbc-spl94 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-e8429-predictor-7dc75fffbc-spl94 to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-b4346-6b777556b4-xkcl7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-b4346-6b777556b4-xkcl7 to ip-10-0-129-84.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-c50a0-predictor-ff85bf888-w2827 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-c50a0-predictor-ff85bf888-w2827 to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-932d4-predictor-c79874459-rn8v8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-932d4-predictor-c79874459-rn8v8 to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-42a8c-predictor-5bffc845f9-8clt7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-42a8c-predictor-5bffc845f9-8clt7 to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-3f0d8-predictor-d56d46fd9-5wdh8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-3f0d8-predictor-d56d46fd9-5wdh8 to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-ce2f4-predictor-668bdfbd7d-swrp4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-ce2f4-predictor-668bdfbd7d-swrp4 to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-42a8c-predictor-5d964846d6-lkxg6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-42a8c-predictor-5d964846d6-lkxg6 to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-c50a0-predictor-b6f8dfcbf-tfgv8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-c50a0-predictor-b6f8dfcbf-tfgv8 to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-258c6-predictor-868bd945f5-k9mzq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-258c6-predictor-868bd945f5-k9mzq to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-e8429-56f48fd547-2nhfm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-e8429-56f48fd547-2nhfm to ip-10-0-129-84.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-c50a0-7b8946587d-pz8fb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-c50a0-7b8946587d-pz8fb to ip-10-0-129-84.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-b394f-predictor-547b67dbcf-vjh55 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-b394f-predictor-547b67dbcf-vjh55 to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-b394f-predictor-5978fdbfd6-dhspp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-b394f-predictor-5978fdbfd6-dhspp to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-e8429-predictor-7f7756df8b-vh46g |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-e8429-predictor-7f7756df8b-vh46g to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-b394f-7475f7f5f8-xt62m |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-b394f-7475f7f5f8-xt62m to ip-10-0-129-84.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-b4346-predictor-5f9c4767fb-4xxhm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-b4346-predictor-5f9c4767fb-4xxhm to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-784cb989b8-hqh7l |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-784cb989b8-hqh7l to ip-10-0-129-84.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-ce2f4-779b99dd69-zgpqn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-ce2f4-779b99dd69-zgpqn to ip-10-0-129-84.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-258c6-b67dc4465-ct42v |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-258c6-b67dc4465-ct42v to ip-10-0-129-84.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-3f0d8-predictor-567d69bfc6-x22j4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-3f0d8-predictor-567d69bfc6-x22j4 to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-cd9c7-predictor-fdc5479f4-bh6v9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-cd9c7-predictor-fdc5479f4-bh6v9 to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-42a8c-86c8649578-qg926 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-42a8c-86c8649578-qg926 to ip-10-0-129-84.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-7459dc5d7-kfblx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-7459dc5d7-kfblx to ip-10-0-129-84.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-5dfd9559ff-wznm5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5dfd9559ff-wznm5 to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-b4346-predictor-6c9795b877-t7kx4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-b4346-predictor-6c9795b877-t7kx4 to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-ce2f4-predictor-54fdc77bf9-zfzjf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-ce2f4-predictor-54fdc77bf9-zfzjf to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-797489c4d6-rpwb6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-797489c4d6-rpwb6 to ip-10-0-129-84.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-932d4-6ffb546d98-w74vd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-932d4-6ffb546d98-w74vd to ip-10-0-129-84.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-cd9c7-b856cb664-jsx2p |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-cd9c7-b856cb664-jsx2p to ip-10-0-129-84.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-3f0d8-647745dd4-j58jx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-3f0d8-647745dd4-j58jx to ip-10-0-129-84.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-932d4-predictor-dcd4cd5db-xc22g |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-932d4-predictor-dcd4cd5db-xc22g to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-cd9c7-predictor-75bcf7484c-pw9cg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-cd9c7-predictor-75bcf7484c-pw9cg to ip-10-0-142-243.ec2.internal | ||
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-784cb989b8 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-784cb989b8-hqh7l | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-ce2f4-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-ce2f4-predictor-54fdc77bf9 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-5dfd9559ff |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-5dfd9559ff-wznm5 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-5dfd9559ff from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-ce2f4-predictor-668bdfbd7d |
SuccessfulCreate |
Created pod: error-404-isvc-ce2f4-predictor-668bdfbd7d-swrp4 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-ce2f4-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-ce2f4-predictor-668bdfbd7d from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-ce2f4-predictor-54fdc77bf9-zfzjf |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ce2f4-predictor-54fdc77bf9-zfzjf |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1427" | |
kserve-ci-e2e-test |
multus |
error-404-isvc-ce2f4-predictor-668bdfbd7d-swrp4 |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-784cb989b8 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-ce2f4-predictor-54fdc77bf9 |
SuccessfulCreate |
Created pod: success-200-isvc-ce2f4-predictor-54fdc77bf9-zfzjf | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-7459dc5d7 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ce2f4-predictor-668bdfbd7d-swrp4 |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1427" | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-5dfd9559ff-wznm5 |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dfd9559ff-wznm5 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:aab354f2c86e475a254092a9407c814212380805c294d80c01d879f01bc40743" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-hqh7l |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:aab354f2c86e475a254092a9407c814212380805c294d80c01d879f01bc40743" | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-7459dc5d7-kfblx |
AddedInterface |
Add eth0 [10.133.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-7459dc5d7 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-7459dc5d7-kfblx | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-784cb989b8-hqh7l |
AddedInterface |
Add eth0 [10.133.0.21/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7459dc5d7-kfblx |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:aab354f2c86e475a254092a9407c814212380805c294d80c01d879f01bc40743" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-hqh7l |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7459dc5d7-kfblx |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:aab354f2c86e475a254092a9407c814212380805c294d80c01d879f01bc40743" in 3.624s (3.624s including waiting). Image size: 300954017 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7459dc5d7-kfblx |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-hqh7l |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:aab354f2c86e475a254092a9407c814212380805c294d80c01d879f01bc40743" in 3.747s (3.747s including waiting). Image size: 300954017 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7459dc5d7-kfblx |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-hqh7l |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-hqh7l |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7459dc5d7-kfblx |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1427" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ce2f4-predictor-668bdfbd7d-swrp4 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dfd9559ff-wznm5 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:aab354f2c86e475a254092a9407c814212380805c294d80c01d879f01bc40743" in 16.191s (16.191s including waiting). Image size: 300954017 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ce2f4-predictor-54fdc77bf9-zfzjf |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1427" in 16.792s (16.792s including waiting). Image size: 1332292199 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ce2f4-predictor-668bdfbd7d-swrp4 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dfd9559ff-wznm5 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ce2f4-predictor-54fdc77bf9-zfzjf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ce2f4-predictor-668bdfbd7d-swrp4 |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1427" in 16.475s (16.475s including waiting). Image size: 1332356703 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dfd9559ff-wznm5 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ce2f4-predictor-54fdc77bf9-zfzjf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dfd9559ff-wznm5 |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1427" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dfd9559ff-wznm5 |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1427" in 5.728s (5.728s including waiting). Image size: 1560610732 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dfd9559ff-wznm5 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dfd9559ff-wznm5 |
Started |
Started container kserve-container | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ce2f4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ce2f4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ce2f4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ce2f4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-hqh7l |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7459dc5d7-kfblx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7459dc5d7-kfblx |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7459dc5d7-kfblx |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1427" in 24.67s (24.67s including waiting). Image size: 1560610732 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-hqh7l |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 26.007s (26.007s including waiting). Image size: 1306414327 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-hqh7l |
Started |
Started container kserve-container | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-ce2f4-predictor-668bdfbd7d-swrp4 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.29:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-ce2f4-predictor-54fdc77bf9-zfzjf |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.27:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ce2f4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ce2f4 |
InferenceServiceReady |
InferenceService [success-200-isvc-ce2f4] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ce2f4 |
InferenceServiceReady |
InferenceService [error-404-isvc-ce2f4] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ce2f4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x7) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dfd9559ff-wznm5 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.28:8080: connect: connection refused |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-ce2f4 |
InferenceGraphReady |
InferenceGraph [switch-graph-ce2f4] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-ce2f4 |
ScalingReplicaSet |
Scaled up replica set switch-graph-ce2f4-779b99dd69 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-ce2f4-779b99dd69 |
SuccessfulCreate |
Created pod: switch-graph-ce2f4-779b99dd69-zgpqn | |
| (x2) | kserve-ci-e2e-test |
kubelet |
switch-graph-ce2f4-779b99dd69-zgpqn |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-ce2f4-serving-cert" not found |
kserve-ci-e2e-test |
kubelet |
switch-graph-ce2f4-779b99dd69-zgpqn |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:1cb7acc070794d268505fff79e524d7ef177fc0b63034e1eb066135c23060e62" | |
kserve-ci-e2e-test |
multus |
switch-graph-ce2f4-779b99dd69-zgpqn |
AddedInterface |
Add eth0 [10.133.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-ce2f4-779b99dd69-zgpqn |
Started |
Started container switch-graph-ce2f4 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-ce2f4-779b99dd69-zgpqn |
Created |
Created container: switch-graph-ce2f4 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-ce2f4-779b99dd69-zgpqn |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:1cb7acc070794d268505fff79e524d7ef177fc0b63034e1eb066135c23060e62" in 2.398s (2.398s including waiting). Image size: 216233539 bytes. | |
| (x6) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-hqh7l |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.21:8080: connect: connection refused |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ce2f4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ce2f4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ce2f4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ce2f4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b4346 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-b4346": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-b4346": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
switch-graph-ce2f4-779b99dd69-zgpqn |
Killing |
Stopping container switch-graph-ce2f4 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-b4346-predictor-6c9795b877 |
SuccessfulCreate |
Created pod: success-200-isvc-b4346-predictor-6c9795b877-t7kx4 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-b4346-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-b4346-predictor-6c9795b877 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ce2f4-predictor-54fdc77bf9-zfzjf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b4346 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-b4346": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-b4346": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b4346 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-b4346": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ce2f4-predictor-668bdfbd7d-swrp4 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-b4346-predictor-5f9c4767fb |
SuccessfulCreate |
Created pod: error-404-isvc-b4346-predictor-5f9c4767fb-4xxhm | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b4346 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-b4346": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-b4346-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-b4346-predictor-5f9c4767fb from 0 to 1 | |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7459dc5d7-kfblx |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.22:8080: connect: connection refused |
kserve-ci-e2e-test |
multus |
success-200-isvc-b4346-predictor-6c9795b877-t7kx4 |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b4346-predictor-6c9795b877-t7kx4 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1427" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b4346-predictor-6c9795b877-t7kx4 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b4346-predictor-5f9c4767fb-4xxhm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b4346-predictor-6c9795b877-t7kx4 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b4346-predictor-5f9c4767fb-4xxhm |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1427" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-b4346-predictor-5f9c4767fb-4xxhm |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b4346-predictor-5f9c4767fb-4xxhm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
multus |
model-chainer-797489c4d6-rpwb6 |
AddedInterface |
Add eth0 [10.133.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
model-chainer-797489c4d6-rpwb6 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:1cb7acc070794d268505fff79e524d7ef177fc0b63034e1eb066135c23060e62" already present on machine | |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-797489c4d6 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-797489c4d6 |
SuccessfulCreate |
Created pod: model-chainer-797489c4d6-rpwb6 | |
kserve-ci-e2e-test |
kubelet |
model-chainer-797489c4d6-rpwb6 |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-797489c4d6-rpwb6 |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-797489c4d6-rpwb6 |
Killing |
Stopping container model-chainer | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-cd9c7-predictor-75bcf7484c |
SuccessfulCreate |
Created pod: success-200-isvc-cd9c7-predictor-75bcf7484c-pw9cg | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-cd9c7-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-cd9c7-predictor-fdc5479f4 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-cd9c7-predictor-fdc5479f4 |
SuccessfulCreate |
Created pod: error-404-isvc-cd9c7-predictor-fdc5479f4-bh6v9 | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-hqh7l |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dfd9559ff-wznm5 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-cd9c7-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-cd9c7-predictor-75bcf7484c from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-7459dc5d7-kfblx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cd9c7-predictor-75bcf7484c-pw9cg |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1427" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cd9c7-predictor-75bcf7484c-pw9cg |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-cd9c7-predictor-fdc5479f4-bh6v9 |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cd9c7-predictor-fdc5479f4-bh6v9 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cd9c7-predictor-fdc5479f4-bh6v9 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cd9c7-predictor-75bcf7484c-pw9cg |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-cd9c7-predictor-75bcf7484c-pw9cg |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-ce2f4-779b99dd69-zgpqn |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cd9c7-predictor-fdc5479f4-bh6v9 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1427" already present on machine | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b4346-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b4346-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b4346-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b4346-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cd9c7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cd9c7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-b4346-predictor-5f9c4767fb-4xxhm |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.31:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-b4346-predictor-6c9795b877-t7kx4 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.30:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b4346 |
InferenceServiceReady |
InferenceService [error-404-isvc-b4346] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b4346 |
InferenceServiceReady |
InferenceService [success-200-isvc-b4346] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b4346 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b4346 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-797489c4d6-rpwb6 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b4346-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b4346-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-cd9c7-predictor-fdc5479f4-bh6v9 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.33:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-cd9c7-predictor-75bcf7484c-pw9cg |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.32:8080: connect: connection refused |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-b4346-6b777556b4 |
SuccessfulCreate |
Created pod: switch-graph-b4346-6b777556b4-xkcl7 | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-b4346 |
ScalingReplicaSet |
Scaled up replica set switch-graph-b4346-6b777556b4 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
switch-graph-b4346-6b777556b4-xkcl7 |
AddedInterface |
Add eth0 [10.133.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b4346-6b777556b4-xkcl7 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:1cb7acc070794d268505fff79e524d7ef177fc0b63034e1eb066135c23060e62" already present on machine | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cd9c7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cd9c7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
switch-graph-b4346-6b777556b4-xkcl7 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-b4346-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-b4346 |
InferenceGraphReady |
InferenceGraph [switch-graph-b4346] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b4346-6b777556b4-xkcl7 |
Started |
Started container switch-graph-b4346 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b4346-6b777556b4-xkcl7 |
Created |
Created container: switch-graph-b4346 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b4346-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b4346-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-cd9c7 |
InferenceServiceReady |
InferenceService [success-200-isvc-cd9c7] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-cd9c7 |
InferenceServiceReady |
InferenceService [error-404-isvc-cd9c7] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-cd9c7 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-cd9c7 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-b4346 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-b4346 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-cd9c7 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-cd9c7-b856cb664 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-cd9c7 |
InferenceGraphReady |
InferenceGraph [sequence-graph-cd9c7] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-cd9c7-b856cb664-jsx2p |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-cd9c7-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-cd9c7-b856cb664 |
SuccessfulCreate |
Created pod: sequence-graph-cd9c7-b856cb664-jsx2p | |
kserve-ci-e2e-test |
multus |
sequence-graph-cd9c7-b856cb664-jsx2p |
AddedInterface |
Add eth0 [10.133.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-cd9c7-b856cb664-jsx2p |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:1cb7acc070794d268505fff79e524d7ef177fc0b63034e1eb066135c23060e62" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-cd9c7-b856cb664-jsx2p |
Created |
Created container: sequence-graph-cd9c7 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-cd9c7-b856cb664-jsx2p |
Started |
Started container sequence-graph-cd9c7 | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cd9c7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cd9c7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cd9c7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cd9c7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-b4346 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-b4346 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-cd9c7 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-cd9c7 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b4346-predictor-5f9c4767fb-4xxhm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-42a8c-predictor-5bffc845f9 |
SuccessfulCreate |
Created pod: success-200-isvc-42a8c-predictor-5bffc845f9-8clt7 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b4346-6b777556b4-xkcl7 |
Killing |
Stopping container switch-graph-b4346 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-42a8c-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-42a8c-predictor-5bffc845f9 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-42a8c-predictor-5bffc845f9-8clt7 |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b4346-predictor-6c9795b877-t7kx4 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-42a8c-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-42a8c-predictor-5d964846d6 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-42a8c-predictor-5d964846d6 |
SuccessfulCreate |
Created pod: error-404-isvc-42a8c-predictor-5d964846d6-lkxg6 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-42a8c |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-42a8c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-42a8c |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-42a8c": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-42a8c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-42a8c-predictor-5d964846d6-lkxg6 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-42a8c-predictor-5bffc845f9-8clt7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-42a8c-predictor-5bffc845f9-8clt7 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1427" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-42a8c-predictor-5d964846d6-lkxg6 |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-42a8c-predictor-5d964846d6-lkxg6 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1427" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-42a8c-predictor-5d964846d6-lkxg6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-42a8c-predictor-5bffc845f9-8clt7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-3f0d8-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-3f0d8-predictor-567d69bfc6 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cd9c7-predictor-75bcf7484c-pw9cg |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-3f0d8-predictor-d56d46fd9-5wdh8 |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3f0d8-predictor-d56d46fd9-5wdh8 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1427" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-3f0d8-predictor-d56d46fd9 |
SuccessfulCreate |
Created pod: success-200-isvc-3f0d8-predictor-d56d46fd9-5wdh8 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-3f0d8-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-3f0d8-predictor-d56d46fd9 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-cd9c7-b856cb664-jsx2p |
Killing |
Stopping container sequence-graph-cd9c7 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-3f0d8-predictor-567d69bfc6-x22j4 |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cd9c7-predictor-fdc5479f4-bh6v9 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3f0d8-predictor-567d69bfc6-x22j4 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1427" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-3f0d8-predictor-567d69bfc6 |
SuccessfulCreate |
Created pod: error-404-isvc-3f0d8-predictor-567d69bfc6-x22j4 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3f0d8-predictor-d56d46fd9-5wdh8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3f0d8-predictor-567d69bfc6-x22j4 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3f0d8-predictor-567d69bfc6-x22j4 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3f0d8-predictor-d56d46fd9-5wdh8 |
Started |
Started container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-b4346-6b777556b4-xkcl7 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-42a8c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-42a8c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-42a8c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-42a8c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-42a8c |
InferenceServiceReady |
InferenceService [error-404-isvc-42a8c] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-42a8c |
InferenceServiceReady |
InferenceService [success-200-isvc-42a8c] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-42a8c |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-42a8c |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-cd9c7-b856cb664-jsx2p |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3f0d8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3f0d8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-42a8c |
InferenceGraphReady |
InferenceGraph [ensemble-graph-42a8c] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-42a8c |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-42a8c-86c8649578 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-42a8c-86c8649578 |
SuccessfulCreate |
Created pod: ensemble-graph-42a8c-86c8649578-qg926 | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-42a8c |
UpdateFailed |
Failed to update status for InferenceGraph "ensemble-graph-42a8c": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "ensemble-graph-42a8c": the object has been modified; please apply your changes to the latest version and try again | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3f0d8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
ensemble-graph-42a8c-86c8649578-qg926 |
AddedInterface |
Add eth0 [10.133.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-42a8c-86c8649578-qg926 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:1cb7acc070794d268505fff79e524d7ef177fc0b63034e1eb066135c23060e62" already present on machine | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-42a8c |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "ensemble-graph-42a8c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-42a8c-86c8649578-qg926 |
Created |
Created container: ensemble-graph-42a8c | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-42a8c-86c8649578-qg926 |
Started |
Started container ensemble-graph-42a8c | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3f0d8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-42a8c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-42a8c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-42a8c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-42a8c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3f0d8 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3f0d8 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3f0d8 |
InferenceServiceReady |
InferenceService [error-404-isvc-3f0d8] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3f0d8 |
InferenceServiceReady |
InferenceService [success-200-isvc-3f0d8] is Ready | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-42a8c-predictor-5d964846d6-lkxg6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c50a0-predictor-b6f8dfcbf-tfgv8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-42a8c-86c8649578-qg926 |
Killing |
Stopping container ensemble-graph-42a8c | |
kserve-ci-e2e-test |
multus |
success-200-isvc-c50a0-predictor-b6f8dfcbf-tfgv8 |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c50a0-predictor-b6f8dfcbf-tfgv8 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1427" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-c50a0-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-c50a0-predictor-ff85bf888 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-c50a0-predictor-ff85bf888 |
SuccessfulCreate |
Created pod: error-404-isvc-c50a0-predictor-ff85bf888-w2827 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c50a0-predictor-b6f8dfcbf-tfgv8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c50a0-predictor-ff85bf888-w2827 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c50a0-predictor-ff85bf888-w2827 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c50a0-predictor-ff85bf888-w2827 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1427" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-42a8c-predictor-5bffc845f9-8clt7 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-c50a0-predictor-b6f8dfcbf |
SuccessfulCreate |
Created pod: success-200-isvc-c50a0-predictor-b6f8dfcbf-tfgv8 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-c50a0-predictor-ff85bf888-w2827 |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-c50a0-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-c50a0-predictor-b6f8dfcbf from 0 to 1 | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-42a8c-predictor-5bffc845f9-8clt7 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.34:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-42a8c-predictor-5d964846d6-lkxg6 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.35:8080: connect: connection refused |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-3f0d8-647745dd4 |
SuccessfulCreate |
Created pod: sequence-graph-3f0d8-647745dd4-j58jx | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-3f0d8 |
InferenceGraphReady |
InferenceGraph [sequence-graph-3f0d8] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-3f0d8 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-3f0d8-647745dd4 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-3f0d8-647745dd4-j58jx |
Started |
Started container sequence-graph-3f0d8 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-3f0d8-647745dd4-j58jx |
Created |
Created container: sequence-graph-3f0d8 | |
kserve-ci-e2e-test |
multus |
sequence-graph-3f0d8-647745dd4-j58jx |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-3f0d8-647745dd4-j58jx |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:1cb7acc070794d268505fff79e524d7ef177fc0b63034e1eb066135c23060e62" already present on machine | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3f0d8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3f0d8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3f0d8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3f0d8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-258c6-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-258c6-predictor-868bd945f5 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3f0d8-predictor-d56d46fd9-5wdh8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-3f0d8-647745dd4-j58jx |
Killing |
Stopping container sequence-graph-3f0d8 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-258c6 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-258c6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-258c6-predictor-868bd945f5 |
SuccessfulCreate |
Created pod: success-200-isvc-258c6-predictor-868bd945f5-k9mzq | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-258c6 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-258c6": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-258c6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3f0d8-predictor-567d69bfc6-x22j4 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-258c6-predictor-79cbb6745d-lwxf6 |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
success-200-isvc-258c6-predictor-868bd945f5-k9mzq |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-258c6-predictor-868bd945f5-k9mzq |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1427" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-258c6-predictor-868bd945f5-k9mzq |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-258c6-predictor-868bd945f5-k9mzq |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-258c6 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-258c6": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-258c6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-258c6 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-258c6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-258c6-predictor-79cbb6745d-lwxf6 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1427" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-258c6-predictor-79cbb6745d-lwxf6 |
Started |
Started container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-42a8c-86c8649578-qg926 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-258c6-predictor-79cbb6745d-lwxf6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-258c6-predictor-79cbb6745d |
SuccessfulCreate |
Created pod: error-404-isvc-258c6-predictor-79cbb6745d-lwxf6 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-258c6-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-258c6-predictor-79cbb6745d from 0 to 1 | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-3f0d8-predictor-d56d46fd9-5wdh8 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.36:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-3f0d8-predictor-567d69bfc6-x22j4 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.37:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c50a0-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c50a0-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-258c6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-258c6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-c50a0-predictor-ff85bf888-w2827 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.39:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-c50a0-predictor-b6f8dfcbf-tfgv8 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.38:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c50a0-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c50a0-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c50a0 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-3f0d8-647745dd4-j58jx |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c50a0 |
InferenceServiceReady |
InferenceService [success-200-isvc-c50a0] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c50a0 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c50a0 |
InferenceServiceReady |
InferenceService [error-404-isvc-c50a0] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-258c6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-258c6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-258c6-predictor-79cbb6745d-lwxf6 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.41:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-258c6-predictor-868bd945f5-k9mzq |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.40:8080: connect: connection refused |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-c50a0-7b8946587d |
SuccessfulCreate |
Created pod: ensemble-graph-c50a0-7b8946587d-pz8fb | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-c50a0-7b8946587d-pz8fb |
Started |
Started container ensemble-graph-c50a0 | |
kserve-ci-e2e-test |
multus |
ensemble-graph-c50a0-7b8946587d-pz8fb |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-c50a0 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-c50a0-7b8946587d from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-c50a0-7b8946587d-pz8fb |
Created |
Created container: ensemble-graph-c50a0 | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-c50a0 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-c50a0] is Ready | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-c50a0-7b8946587d-pz8fb |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:1cb7acc070794d268505fff79e524d7ef177fc0b63034e1eb066135c23060e62" already present on machine | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c50a0-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c50a0-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c50a0-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c50a0-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-258c6 |
InferenceServiceReady |
InferenceService [error-404-isvc-258c6] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-258c6 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-258c6 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-258c6 |
InferenceServiceReady |
InferenceService [success-200-isvc-258c6] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-c50a0 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-c50a0 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-258c6-b67dc4465 |
SuccessfulCreate |
Created pod: sequence-graph-258c6-b67dc4465-ct42v | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-258c6 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-258c6-b67dc4465 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
sequence-graph-258c6-b67dc4465-ct42v |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-258c6-b67dc4465-ct42v |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:1cb7acc070794d268505fff79e524d7ef177fc0b63034e1eb066135c23060e62" already present on machine | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-258c6 |
InferenceGraphReady |
InferenceGraph [sequence-graph-258c6] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-258c6-b67dc4465-ct42v |
Created |
Created container: sequence-graph-258c6 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-258c6-b67dc4465-ct42v |
Started |
Started container sequence-graph-258c6 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-258c6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-258c6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-c50a0 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-c50a0 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-258c6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-258c6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-258c6 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-258c6 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-c50a0-7b8946587d-pz8fb |
Killing |
Stopping container ensemble-graph-c50a0 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e8429-predictor-7dc75fffbc-spl94 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e8429 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-e8429": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c50a0-predictor-ff85bf888-w2827 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-e8429-predictor-7dc75fffbc-spl94 |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-e8429-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-e8429-predictor-7dc75fffbc from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-e8429-predictor-7dc75fffbc |
SuccessfulCreate |
Created pod: success-200-isvc-e8429-predictor-7dc75fffbc-spl94 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e8429-predictor-7f7756df8b-vh46g |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e8429-predictor-7f7756df8b-vh46g |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e8429-predictor-7f7756df8b-vh46g |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1427" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-e8429-predictor-7f7756df8b-vh46g |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-e8429-predictor-7f7756df8b |
SuccessfulCreate |
Created pod: error-404-isvc-e8429-predictor-7f7756df8b-vh46g | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-e8429-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-e8429-predictor-7f7756df8b from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e8429 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-e8429": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-e8429": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e8429 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-e8429": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e8429 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-e8429": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-e8429": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e8429-predictor-7dc75fffbc-spl94 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e8429-predictor-7dc75fffbc-spl94 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1427" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c50a0-predictor-b6f8dfcbf-tfgv8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e8429-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e8429-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b394f-predictor-547b67dbcf-vjh55 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1427" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-b394f-predictor-547b67dbcf-vjh55 |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-b394f-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-b394f-predictor-547b67dbcf from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-258c6-b67dc4465-ct42v |
Killing |
Stopping container sequence-graph-258c6 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-b394f-predictor-547b67dbcf |
SuccessfulCreate |
Created pod: success-200-isvc-b394f-predictor-547b67dbcf-vjh55 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-b394f-predictor-5978fdbfd6 |
SuccessfulCreate |
Created pod: error-404-isvc-b394f-predictor-5978fdbfd6-dhspp | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-258c6-predictor-79cbb6745d-lwxf6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-258c6-predictor-868bd945f5-k9mzq |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-b394f-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-b394f-predictor-5978fdbfd6 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b394f-predictor-547b67dbcf-vjh55 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b394f-predictor-547b67dbcf-vjh55 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b394f-predictor-5978fdbfd6-dhspp |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b394f-predictor-5978fdbfd6-dhspp |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1427" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-b394f-predictor-5978fdbfd6-dhspp |
AddedInterface |
Add eth0 [10.134.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b394f-predictor-5978fdbfd6-dhspp |
Started |
Started container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-c50a0-7b8946587d-pz8fb |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b394f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b394f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e8429-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e8429-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e8429 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e8429 |
InferenceServiceReady |
InferenceService [error-404-isvc-e8429] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-258c6-b67dc4465-ct42v |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e8429 |
InferenceServiceReady |
InferenceService [success-200-isvc-e8429] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e8429 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b394f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b394f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
splitter-graph-e8429-56f48fd547-2nhfm |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:1cb7acc070794d268505fff79e524d7ef177fc0b63034e1eb066135c23060e62" already present on machine | |
kserve-ci-e2e-test |
multus |
splitter-graph-e8429-56f48fd547-2nhfm |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-e8429-56f48fd547 |
SuccessfulCreate |
Created pod: splitter-graph-e8429-56f48fd547-2nhfm | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-e8429 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-e8429-56f48fd547 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-e8429 |
InferenceGraphReady |
InferenceGraph [splitter-graph-e8429] is Ready | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-e8429-56f48fd547-2nhfm |
Started |
Started container splitter-graph-e8429 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-e8429 |
UpdateFailed |
Failed to update status for InferenceGraph "splitter-graph-e8429": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "splitter-graph-e8429": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-e8429 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "splitter-graph-e8429": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-e8429-56f48fd547-2nhfm |
Created |
Created container: splitter-graph-e8429 | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e8429-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e8429-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e8429-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e8429-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b394f |
InferenceServiceReady |
InferenceService [success-200-isvc-b394f] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b394f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b394f |
InferenceServiceReady |
InferenceService [error-404-isvc-b394f] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b394f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
kubelet |
splitter-graph-e8429-56f48fd547-2nhfm |
Killing |
Stopping container splitter-graph-e8429 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-932d4-predictor-dcd4cd5db-xc22g |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1427" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e8429-predictor-7f7756df8b-vh46g |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-932d4-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-932d4-predictor-dcd4cd5db from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-932d4-predictor-c79874459-rn8v8 |
AddedInterface |
Add eth0 [10.134.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-932d4-predictor-c79874459-rn8v8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-932d4-predictor-dcd4cd5db |
SuccessfulCreate |
Created pod: error-404-isvc-932d4-predictor-dcd4cd5db-xc22g | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-932d4-predictor-dcd4cd5db-xc22g |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-932d4-predictor-dcd4cd5db-xc22g |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e8429-predictor-7dc75fffbc-spl94 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-932d4-predictor-c79874459 |
SuccessfulCreate |
Created pod: success-200-isvc-932d4-predictor-c79874459-rn8v8 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-932d4-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-932d4-predictor-c79874459 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-932d4-predictor-dcd4cd5db-xc22g |
AddedInterface |
Add eth0 [10.134.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-932d4-predictor-c79874459-rn8v8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-932d4-predictor-c79874459-rn8v8 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1427" already present on machine | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-e8429-predictor-7f7756df8b-vh46g |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.43:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-e8429-predictor-7dc75fffbc-spl94 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.42:8080: connect: connection refused |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-b394f |
InferenceGraphReady |
InferenceGraph [switch-graph-b394f] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-b394f |
ScalingReplicaSet |
Scaled up replica set switch-graph-b394f-7475f7f5f8 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-b394f-7475f7f5f8 |
SuccessfulCreate |
Created pod: switch-graph-b394f-7475f7f5f8-xt62m | |
kserve-ci-e2e-test |
multus |
switch-graph-b394f-7475f7f5f8-xt62m |
AddedInterface |
Add eth0 [10.133.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b394f-7475f7f5f8-xt62m |
Started |
Started container switch-graph-b394f | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b394f-7475f7f5f8-xt62m |
Created |
Created container: switch-graph-b394f | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b394f-7475f7f5f8-xt62m |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:1cb7acc070794d268505fff79e524d7ef177fc0b63034e1eb066135c23060e62" already present on machine | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b394f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b394f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b394f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b394f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-e8429-56f48fd547-2nhfm |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-932d4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-932d4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-932d4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-932d4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-932d4-predictor-dcd4cd5db-xc22g |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.47:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-932d4-predictor-c79874459-rn8v8 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.46:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-b394f |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-b394f |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-932d4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-932d4 |
InferenceServiceReady |
InferenceService [error-404-isvc-932d4] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-932d4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-932d4 |
InferenceServiceReady |
InferenceService [success-200-isvc-932d4] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-932d4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-932d4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-932d4-6ffb546d98 |
SuccessfulCreate |
Created pod: splitter-graph-932d4-6ffb546d98-w74vd | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-932d4 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-932d4-6ffb546d98 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-932d4-6ffb546d98-w74vd |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-932d4-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-932d4 |
InferenceGraphReady |
InferenceGraph [splitter-graph-932d4] is Ready | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-932d4-6ffb546d98-w74vd |
Created |
Created container: splitter-graph-932d4 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-932d4-6ffb546d98-w74vd |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:1cb7acc070794d268505fff79e524d7ef177fc0b63034e1eb066135c23060e62" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-932d4-6ffb546d98-w74vd |
Started |
Started container splitter-graph-932d4 | |
kserve-ci-e2e-test |
multus |
splitter-graph-932d4-6ffb546d98-w74vd |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-932d4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-932d4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-932d4 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-932d4 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-932d4 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-932d4 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-932d4-predictor-c79874459-rn8v8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-932d4-predictor-dcd4cd5db-xc22g |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-932d4-6ffb546d98-w74vd |
Killing |
Stopping container splitter-graph-932d4 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-932d4-6ffb546d98-w74vd |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
switch-graph-b394f-7475f7f5f8-xt62m |
Killing |
Stopping container switch-graph-b394f | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b394f-predictor-547b67dbcf-vjh55 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b394f-predictor-5978fdbfd6-dhspp |
Killing |
Stopping container kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-b394f-predictor-5978fdbfd6-dhspp |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.45:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-b394f-predictor-547b67dbcf-vjh55 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.44:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
kubelet |
switch-graph-b394f-7475f7f5f8-xt62m |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |