| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
error-404-isvc-15788-predictor-68bbf9d949-kglrv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-15788-predictor-68bbf9d949-kglrv to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-cc0f2-8b5c9b9f7-vvxvk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-cc0f2-8b5c9b9f7-vvxvk to ip-10-0-134-158.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-932a3-c77946655-t5lk8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-932a3-c77946655-t5lk8 to ip-10-0-134-158.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-ee4eb-6c7dd7d556-krjp8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-ee4eb-6c7dd7d556-krjp8 to ip-10-0-134-158.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-01ef2-predictor-6c594797db-sg4fs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-01ef2-predictor-6c594797db-sg4fs to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-a03d4-7967858c6b-gzxdj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-a03d4-7967858c6b-gzxdj to ip-10-0-134-158.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-01ef2-997d6cfb-pfzw8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-01ef2-997d6cfb-pfzw8 to ip-10-0-134-158.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-5ddf86697d-c728g |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-5ddf86697d-c728g to ip-10-0-134-158.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-784cb989b8-qqb9q |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-784cb989b8-qqb9q to ip-10-0-134-158.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-56f57765b4-v4xj6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-56f57765b4-v4xj6 to ip-10-0-134-158.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-b8212-86c7c564dd-sqwd9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-b8212-86c7c564dd-sqwd9 to ip-10-0-134-158.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-f682f-6fb54f4984-mgr7g |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-f682f-6fb54f4984-mgr7g to ip-10-0-134-158.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-6d86c7594-lxkhn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6d86c7594-lxkhn to ip-10-0-134-158.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-f682f-predictor-b9b6c9555-h8dsl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-f682f-predictor-b9b6c9555-h8dsl to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-15788-predictor-684db9cccb-rzgzg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-15788-predictor-684db9cccb-rzgzg to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-ee4eb-predictor-6b8659d7f7-l4v4d |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-ee4eb-predictor-6b8659d7f7-l4v4d to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-19633-predictor-848c5d7698-5m9m4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-19633-predictor-848c5d7698-5m9m4 to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-cc0f2-predictor-55b9dd659f-bvmfn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-cc0f2-predictor-55b9dd659f-bvmfn to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-8eac5-predictor-6ff8c47f86-d9nq8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-8eac5-predictor-6ff8c47f86-d9nq8 to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-8eac5-6b5d7df8f4-l6vjl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-8eac5-6b5d7df8f4-l6vjl to ip-10-0-134-158.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-b8212-predictor-58b6586fc-kb7m6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-b8212-predictor-58b6586fc-kb7m6 to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-19633-6665f68b97-zqmlg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-19633-6665f68b97-zqmlg to ip-10-0-134-158.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-01ef2-predictor-bf7749ff5-7qs4d |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-01ef2-predictor-bf7749ff5-7qs4d to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-932a3-predictor-7586c4f994-hg9tx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-932a3-predictor-7586c4f994-hg9tx to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-a03d4-predictor-7b7c8c8654-scwmx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-a03d4-predictor-7b7c8c8654-scwmx to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-b8212-predictor-598b577b-bw5tf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-b8212-predictor-598b577b-bw5tf to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-cc0f2-predictor-56bbbc6bdb-mmsf7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-cc0f2-predictor-56bbbc6bdb-mmsf7 to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-ee4eb-predictor-6cdf96cdcb-q4jmp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-ee4eb-predictor-6cdf96cdcb-q4jmp to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-f682f-predictor-7c7bbf9bd6-8bbfn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-f682f-predictor-7c7bbf9bd6-8bbfn to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-a03d4-predictor-794c46dd55-49r9m |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-a03d4-predictor-794c46dd55-49r9m to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-15788-6fd7bd5656-twm8c |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-15788-6fd7bd5656-twm8c to ip-10-0-134-158.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-932a3-predictor-5b4b84fcb7-jwg8q |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-932a3-predictor-5b4b84fcb7-jwg8q to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-8eac5-predictor-6c64cc44d7-7fgf8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-8eac5-predictor-6c64cc44d7-7fgf8 to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-19633-predictor-7669bd77f9-qhlcf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-19633-predictor-7669bd77f9-qhlcf to ip-10-0-135-182.ec2.internal | ||
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "isvc-sklearn-graph-1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-19633-predictor-848c5d7698 |
SuccessfulCreate |
Created pod: success-200-isvc-19633-predictor-848c5d7698-5m9m4 | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
UpdateFailed |
Failed to update status for InferenceService "isvc-sklearn-graph-1": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "isvc-sklearn-graph-1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-6d86c7594 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-19633-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-19633-predictor-848c5d7698 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-6d86c7594 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-6d86c7594-lxkhn | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d86c7594-lxkhn |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:797c8e435f976ed40a9339cd4d700b7531407093067823e1831ba65ff3d66a3b" | |
kserve-ci-e2e-test |
multus |
error-404-isvc-19633-predictor-7669bd77f9-qhlcf |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-784cb989b8 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-784cb989b8-qqb9q | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-784cb989b8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-19633-predictor-848c5d7698-5m9m4 |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1400" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-qqb9q |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:797c8e435f976ed40a9339cd4d700b7531407093067823e1831ba65ff3d66a3b" | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-19633-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-19633-predictor-7669bd77f9 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-6d86c7594-lxkhn |
AddedInterface |
Add eth0 [10.133.0.21/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-56f57765b4 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-56f57765b4-v4xj6 | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-784cb989b8-qqb9q |
AddedInterface |
Add eth0 [10.133.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-56f57765b4 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-19633-predictor-848c5d7698-5m9m4 |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-19633-predictor-7669bd77f9-qhlcf |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1400" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-56f57765b4-v4xj6 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:797c8e435f976ed40a9339cd4d700b7531407093067823e1831ba65ff3d66a3b" | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-56f57765b4-v4xj6 |
AddedInterface |
Add eth0 [10.133.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-19633-predictor-7669bd77f9 |
SuccessfulCreate |
Created pod: error-404-isvc-19633-predictor-7669bd77f9-qhlcf | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-qqb9q |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:797c8e435f976ed40a9339cd4d700b7531407093067823e1831ba65ff3d66a3b" in 4.588s (4.588s including waiting). Image size: 300960154 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d86c7594-lxkhn |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:797c8e435f976ed40a9339cd4d700b7531407093067823e1831ba65ff3d66a3b" in 5.121s (5.121s including waiting). Image size: 300960154 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d86c7594-lxkhn |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-qqb9q |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-56f57765b4-v4xj6 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-56f57765b4-v4xj6 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:797c8e435f976ed40a9339cd4d700b7531407093067823e1831ba65ff3d66a3b" in 4.268s (4.268s including waiting). Image size: 300960154 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-56f57765b4-v4xj6 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d86c7594-lxkhn |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-qqb9q |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-qqb9q |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d86c7594-lxkhn |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1400" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-56f57765b4-v4xj6 |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1400" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-19633-predictor-7669bd77f9-qhlcf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-19633-predictor-848c5d7698-5m9m4 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-19633-predictor-848c5d7698-5m9m4 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-19633-predictor-848c5d7698-5m9m4 |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1400" in 14.093s (14.093s including waiting). Image size: 1332298338 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-19633-predictor-7669bd77f9-qhlcf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-19633-predictor-7669bd77f9-qhlcf |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1400" in 14.017s (14.017s including waiting). Image size: 1333698136 bytes. | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-19633-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-19633-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d86c7594-lxkhn |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d86c7594-lxkhn |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-56f57765b4-v4xj6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d86c7594-lxkhn |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1400" in 25.86s (25.86s including waiting). Image size: 1560710053 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-56f57765b4-v4xj6 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-56f57765b4-v4xj6 |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1400" in 25.861s (25.861s including waiting). Image size: 1560710053 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-qqb9q |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-qqb9q |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 26.679s (26.679s including waiting). Image size: 1306229499 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-qqb9q |
Created |
Created container: kserve-container | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-19633-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-19633-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-19633 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-19633 |
InferenceServiceReady |
InferenceService [error-404-isvc-19633] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-19633 |
InferenceServiceReady |
InferenceService [success-200-isvc-19633] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-19633 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-19633 |
ScalingReplicaSet |
Scaled up replica set switch-graph-19633-6665f68b97 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-19633 |
InferenceGraphReady |
InferenceGraph [switch-graph-19633] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-19633-6665f68b97 |
SuccessfulCreate |
Created pod: switch-graph-19633-6665f68b97-zqmlg | |
kserve-ci-e2e-test |
kubelet |
switch-graph-19633-6665f68b97-zqmlg |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-19633-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
switch-graph-19633-6665f68b97-zqmlg |
AddedInterface |
Add eth0 [10.133.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-19633-6665f68b97-zqmlg |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:5ddf7b68668839b048ac1f65cf22f5a7b21a1ddc89705b9e0ad240d64f017b66" | |
kserve-ci-e2e-test |
kubelet |
switch-graph-19633-6665f68b97-zqmlg |
Started |
Started container switch-graph-19633 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-19633-6665f68b97-zqmlg |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:5ddf7b68668839b048ac1f65cf22f5a7b21a1ddc89705b9e0ad240d64f017b66" in 2.384s (2.384s including waiting). Image size: 216233534 bytes. | |
kserve-ci-e2e-test |
kubelet |
switch-graph-19633-6665f68b97-zqmlg |
Created |
Created container: switch-graph-19633 | |
| (x7) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-qqb9q |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.22:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-19633-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-19633-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-19633-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-19633-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-19633-predictor-7669bd77f9-qhlcf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-15788-predictor-68bbf9d949 |
SuccessfulCreate |
Created pod: error-404-isvc-15788-predictor-68bbf9d949-kglrv | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-15788-predictor-684db9cccb |
SuccessfulCreate |
Created pod: success-200-isvc-15788-predictor-684db9cccb-rzgzg | |
kserve-ci-e2e-test |
multus |
error-404-isvc-15788-predictor-68bbf9d949-kglrv |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-15788-predictor-68bbf9d949-kglrv |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1400" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-15788-predictor-68bbf9d949-kglrv |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-15788-predictor-684db9cccb-rzgzg |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-15788-predictor-684db9cccb-rzgzg |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-15788-predictor-684db9cccb-rzgzg |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1400" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-15788-predictor-684db9cccb-rzgzg |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-19633-6665f68b97-zqmlg |
Killing |
Stopping container switch-graph-19633 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-15788 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-15788": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-15788": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-15788-predictor-68bbf9d949-kglrv |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-19633-predictor-848c5d7698-5m9m4 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-15788-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-15788-predictor-684db9cccb from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-15788-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-15788-predictor-68bbf9d949 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-15788 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-15788": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-15788": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-15788 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-15788": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-15788 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-15788": the object has been modified; please apply your changes to the latest version and try again | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-19633-predictor-7669bd77f9-qhlcf |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.28:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-19633-predictor-848c5d7698-5m9m4 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.27:8080: connect: connection refused |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d86c7594-lxkhn |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.21:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-56f57765b4-v4xj6 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.23:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-15788-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-15788-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-19633-6665f68b97-zqmlg |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-15788-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-15788-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-5ddf86697d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-5ddf86697d |
SuccessfulCreate |
Created pod: model-chainer-5ddf86697d-c728g | |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
kubelet |
model-chainer-5ddf86697d-c728g |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-5ddf86697d-c728g |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-5ddf86697d-c728g |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:5ddf7b68668839b048ac1f65cf22f5a7b21a1ddc89705b9e0ad240d64f017b66" already present on machine | |
kserve-ci-e2e-test |
multus |
model-chainer-5ddf86697d-c728g |
AddedInterface |
Add eth0 [10.133.0.25/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-15788-predictor-684db9cccb-rzgzg |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.29:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-15788-predictor-68bbf9d949-kglrv |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.30:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f682f-predictor-b9b6c9555-h8dsl |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-f682f-predictor-b9b6c9555-h8dsl |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f682f-predictor-7c7bbf9bd6-8bbfn |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-f682f |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-f682f": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-f682f-predictor-7c7bbf9bd6 |
SuccessfulCreate |
Created pod: success-200-isvc-f682f-predictor-7c7bbf9bd6-8bbfn | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-f682f-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-f682f-predictor-7c7bbf9bd6 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6d86c7594-lxkhn |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-56f57765b4-v4xj6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-784cb989b8-qqb9q |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-f682f-predictor-7c7bbf9bd6-8bbfn |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
model-chainer-5ddf86697d-c728g |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f682f-predictor-7c7bbf9bd6-8bbfn |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-f682f-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-f682f-predictor-b9b6c9555 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-f682f |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-f682f": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-f682f": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f682f-predictor-b9b6c9555-h8dsl |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1400" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-f682f-predictor-b9b6c9555 |
SuccessfulCreate |
Created pod: error-404-isvc-f682f-predictor-b9b6c9555-h8dsl | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f682f-predictor-b9b6c9555-h8dsl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f682f-predictor-7c7bbf9bd6-8bbfn |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1400" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-15788 |
InferenceServiceReady |
InferenceService [success-200-isvc-15788] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-15788 |
InferenceServiceReady |
InferenceService [error-404-isvc-15788] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-15788 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-15788 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-15788 |
InferenceGraphReady |
InferenceGraph [switch-graph-15788] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-15788-6fd7bd5656-twm8c |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-15788-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-15788-6fd7bd5656 |
SuccessfulCreate |
Created pod: switch-graph-15788-6fd7bd5656-twm8c | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-15788 |
ScalingReplicaSet |
Scaled up replica set switch-graph-15788-6fd7bd5656 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-15788-6fd7bd5656-twm8c |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:5ddf7b68668839b048ac1f65cf22f5a7b21a1ddc89705b9e0ad240d64f017b66" already present on machine | |
kserve-ci-e2e-test |
multus |
switch-graph-15788-6fd7bd5656-twm8c |
AddedInterface |
Add eth0 [10.133.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-15788-6fd7bd5656-twm8c |
Created |
Created container: switch-graph-15788 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-15788-6fd7bd5656-twm8c |
Started |
Started container switch-graph-15788 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-5ddf86697d-c728g |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-15788-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-15788-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-15788-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-15788-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-f682f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-f682f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-f682f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-f682f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-f682f-predictor-b9b6c9555-h8dsl |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.32:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-f682f-predictor-7c7bbf9bd6-8bbfn |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.31:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-f682f |
InferenceServiceReady |
InferenceService [error-404-isvc-f682f] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-f682f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-f682f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-f682f |
InferenceServiceReady |
InferenceService [success-200-isvc-f682f] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-15788 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-15788 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-f682f-6fb54f4984 |
SuccessfulCreate |
Created pod: sequence-graph-f682f-6fb54f4984-mgr7g | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-f682f-6fb54f4984-mgr7g |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-f682f-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-f682f |
InferenceGraphReady |
InferenceGraph [sequence-graph-f682f] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-f682f |
ScalingReplicaSet |
Scaled up replica set sequence-graph-f682f-6fb54f4984 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
sequence-graph-f682f-6fb54f4984-mgr7g |
AddedInterface |
Add eth0 [10.133.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-f682f-6fb54f4984-mgr7g |
Started |
Started container sequence-graph-f682f | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-f682f-6fb54f4984-mgr7g |
Created |
Created container: sequence-graph-f682f | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-f682f-6fb54f4984-mgr7g |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:5ddf7b68668839b048ac1f65cf22f5a7b21a1ddc89705b9e0ad240d64f017b66" already present on machine | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-f682f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-f682f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-f682f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-f682f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-f682f |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-f682f |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8eac5-predictor-6c64cc44d7-7fgf8 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1400" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8eac5-predictor-6c64cc44d7-7fgf8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8eac5 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-8eac5": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-8eac5": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-8eac5-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-8eac5-predictor-6ff8c47f86 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-8eac5-predictor-6ff8c47f86 |
SuccessfulCreate |
Created pod: success-200-isvc-8eac5-predictor-6ff8c47f86-d9nq8 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8eac5 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-8eac5": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-8eac5": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8eac5 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-8eac5": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8eac5-predictor-6ff8c47f86-d9nq8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-15788-predictor-68bbf9d949-kglrv |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8eac5 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-8eac5": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8eac5-predictor-6c64cc44d7-7fgf8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-15788-predictor-684db9cccb-rzgzg |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
switch-graph-15788-6fd7bd5656-twm8c |
Killing |
Stopping container switch-graph-15788 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8eac5-predictor-6ff8c47f86-d9nq8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8eac5-predictor-6ff8c47f86-d9nq8 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1400" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-8eac5-predictor-6c64cc44d7 |
SuccessfulCreate |
Created pod: error-404-isvc-8eac5-predictor-6c64cc44d7-7fgf8 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-8eac5-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-8eac5-predictor-6c64cc44d7 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-8eac5-predictor-6ff8c47f86-d9nq8 |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
error-404-isvc-8eac5-predictor-6c64cc44d7-7fgf8 |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8eac5-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8eac5-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-15788-6fd7bd5656-twm8c |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8eac5-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8eac5-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
sequence-graph-f682f-6fb54f4984-mgr7g |
Killing |
Stopping container sequence-graph-f682f | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-01ef2 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-01ef2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-01ef2-predictor-bf7749ff5-7qs4d |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-01ef2-predictor-6c594797db-sg4fs |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-01ef2-predictor-6c594797db-sg4fs |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-01ef2-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-01ef2-predictor-bf7749ff5 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f682f-predictor-b9b6c9555-h8dsl |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f682f-predictor-7c7bbf9bd6-8bbfn |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-01ef2-predictor-bf7749ff5 |
SuccessfulCreate |
Created pod: error-404-isvc-01ef2-predictor-bf7749ff5-7qs4d | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-01ef2-predictor-bf7749ff5-7qs4d |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-01ef2-predictor-6c594797db-sg4fs |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-01ef2-predictor-6c594797db |
SuccessfulCreate |
Created pod: success-200-isvc-01ef2-predictor-6c594797db-sg4fs | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-01ef2-predictor-bf7749ff5-7qs4d |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1400" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-01ef2-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-01ef2-predictor-6c594797db from 0 to 1 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-01ef2-predictor-bf7749ff5-7qs4d |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-01ef2-predictor-6c594797db-sg4fs |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1400" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-01ef2 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-01ef2": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-01ef2": the object has been modified; please apply your changes to the latest version and try again | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8eac5 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8eac5 |
InferenceServiceReady |
InferenceService [success-200-isvc-8eac5] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8eac5 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8eac5 |
InferenceServiceReady |
InferenceService [error-404-isvc-8eac5] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8eac5-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8eac5-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8eac5-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8eac5-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-8eac5 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-8eac5] is Ready | |
kserve-ci-e2e-test |
multus |
ensemble-graph-8eac5-6b5d7df8f4-l6vjl |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-8eac5-6b5d7df8f4-l6vjl |
Created |
Created container: ensemble-graph-8eac5 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-8eac5-6b5d7df8f4-l6vjl |
Started |
Started container ensemble-graph-8eac5 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-8eac5-6b5d7df8f4-l6vjl |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:5ddf7b68668839b048ac1f65cf22f5a7b21a1ddc89705b9e0ad240d64f017b66" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-8eac5 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-8eac5-6b5d7df8f4 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-8eac5-6b5d7df8f4 |
SuccessfulCreate |
Created pod: ensemble-graph-8eac5-6b5d7df8f4-l6vjl | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-f682f-6fb54f4984-mgr7g |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-01ef2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-01ef2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-01ef2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-01ef2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-b8212-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-b8212-predictor-58b6586fc from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8eac5-predictor-6ff8c47f86-d9nq8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-8eac5-6b5d7df8f4-l6vjl |
Killing |
Stopping container ensemble-graph-8eac5 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8eac5-predictor-6c64cc44d7-7fgf8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-b8212-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-b8212-predictor-598b577b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-b8212-predictor-598b577b |
SuccessfulCreate |
Created pod: success-200-isvc-b8212-predictor-598b577b-bw5tf | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b8212-predictor-598b577b-bw5tf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b8212-predictor-598b577b-bw5tf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b8212-predictor-598b577b-bw5tf |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1400" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-b8212-predictor-598b577b-bw5tf |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
error-404-isvc-b8212-predictor-58b6586fc-kb7m6 |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b8212-predictor-58b6586fc-kb7m6 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1400" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b8212-predictor-58b6586fc-kb7m6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b8212 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-b8212": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b8212 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-b8212": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-b8212": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b8212-predictor-58b6586fc-kb7m6 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-b8212-predictor-58b6586fc |
SuccessfulCreate |
Created pod: error-404-isvc-b8212-predictor-58b6586fc-kb7m6 | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-8eac5-predictor-6ff8c47f86-d9nq8 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.33:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-8eac5-predictor-6c64cc44d7-7fgf8 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.34:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b8212-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b8212-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b8212-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b8212-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-01ef2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-01ef2 |
InferenceServiceReady |
InferenceService [error-404-isvc-01ef2] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-01ef2 |
InferenceServiceReady |
InferenceService [success-200-isvc-01ef2] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-01ef2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-8eac5-6b5d7df8f4-l6vjl |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
sequence-graph-01ef2-997d6cfb-pfzw8 |
Created |
Created container: sequence-graph-01ef2 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-01ef2-997d6cfb-pfzw8 |
Started |
Started container sequence-graph-01ef2 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-01ef2 |
InferenceGraphReady |
InferenceGraph [sequence-graph-01ef2] is Ready | |
kserve-ci-e2e-test |
multus |
sequence-graph-01ef2-997d6cfb-pfzw8 |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-01ef2-997d6cfb-pfzw8 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:5ddf7b68668839b048ac1f65cf22f5a7b21a1ddc89705b9e0ad240d64f017b66" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-01ef2 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-01ef2-997d6cfb from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-01ef2-997d6cfb |
SuccessfulCreate |
Created pod: sequence-graph-01ef2-997d6cfb-pfzw8 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-01ef2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-01ef2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-01ef2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-b8212-predictor-598b577b-bw5tf |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.37:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-01ef2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-b8212-predictor-58b6586fc-kb7m6 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.38:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
sequence-graph-01ef2-997d6cfb-pfzw8 |
Killing |
Stopping container sequence-graph-01ef2 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-cc0f2 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-cc0f2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cc0f2-predictor-56bbbc6bdb-mmsf7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cc0f2-predictor-55b9dd659f-bvmfn |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cc0f2-predictor-55b9dd659f-bvmfn |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cc0f2-predictor-56bbbc6bdb-mmsf7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-01ef2-predictor-6c594797db-sg4fs |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-01ef2-predictor-bf7749ff5-7qs4d |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-cc0f2-predictor-55b9dd659f |
SuccessfulCreate |
Created pod: error-404-isvc-cc0f2-predictor-55b9dd659f-bvmfn | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-cc0f2-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-cc0f2-predictor-55b9dd659f from 0 to 1 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-cc0f2-predictor-55b9dd659f-bvmfn |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cc0f2-predictor-55b9dd659f-bvmfn |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1400" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-cc0f2 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-cc0f2": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-cc0f2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cc0f2-predictor-56bbbc6bdb-mmsf7 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1400" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-cc0f2-predictor-56bbbc6bdb-mmsf7 |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-cc0f2-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-cc0f2-predictor-56bbbc6bdb from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-cc0f2-predictor-56bbbc6bdb |
SuccessfulCreate |
Created pod: success-200-isvc-cc0f2-predictor-56bbbc6bdb-mmsf7 | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-01ef2-predictor-6c594797db-sg4fs |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.35:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-01ef2-predictor-bf7749ff5-7qs4d |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.36:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b8212 |
InferenceServiceReady |
InferenceService [success-200-isvc-b8212] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b8212 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b8212 |
InferenceServiceReady |
InferenceService [error-404-isvc-b8212] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b8212 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-b8212 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-b8212] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-b8212 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-b8212-86c7c564dd from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-b8212-86c7c564dd |
SuccessfulCreate |
Created pod: ensemble-graph-b8212-86c7c564dd-sqwd9 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-b8212-86c7c564dd-sqwd9 |
Started |
Started container ensemble-graph-b8212 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-b8212-86c7c564dd-sqwd9 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:5ddf7b68668839b048ac1f65cf22f5a7b21a1ddc89705b9e0ad240d64f017b66" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-b8212-86c7c564dd-sqwd9 |
Created |
Created container: ensemble-graph-b8212 | |
kserve-ci-e2e-test |
multus |
ensemble-graph-b8212-86c7c564dd-sqwd9 |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-01ef2-997d6cfb-pfzw8 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b8212-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b8212-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cc0f2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cc0f2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cc0f2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cc0f2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-cc0f2-predictor-56bbbc6bdb-mmsf7 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.39:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-cc0f2-predictor-55b9dd659f-bvmfn |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.40:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b8212-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b8212-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-cc0f2 |
InferenceServiceReady |
InferenceService [success-200-isvc-cc0f2] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-cc0f2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-cc0f2 |
InferenceServiceReady |
InferenceService [error-404-isvc-cc0f2] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-cc0f2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-b8212 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-b8212 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-cc0f2 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-cc0f2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-cc0f2-8b5c9b9f7 |
SuccessfulCreate |
Created pod: sequence-graph-cc0f2-8b5c9b9f7-vvxvk | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-cc0f2-8b5c9b9f7-vvxvk |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-cc0f2-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-cc0f2 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-cc0f2-8b5c9b9f7 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-cc0f2 |
InferenceGraphReady |
InferenceGraph [sequence-graph-cc0f2] is Ready | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-cc0f2 |
UpdateFailed |
Failed to update status for InferenceGraph "sequence-graph-cc0f2": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-cc0f2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-cc0f2-8b5c9b9f7-vvxvk |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:5ddf7b68668839b048ac1f65cf22f5a7b21a1ddc89705b9e0ad240d64f017b66" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-cc0f2-8b5c9b9f7-vvxvk |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-cc0f2-8b5c9b9f7-vvxvk |
Created |
Created container: sequence-graph-cc0f2 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-cc0f2-8b5c9b9f7-vvxvk |
Started |
Started container sequence-graph-cc0f2 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cc0f2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cc0f2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cc0f2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cc0f2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-cc0f2 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-cc0f2 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-932a3-predictor-5b4b84fcb7 |
SuccessfulCreate |
Created pod: error-404-isvc-932a3-predictor-5b4b84fcb7-jwg8q | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-932a3 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-932a3": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-932a3": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-b8212-86c7c564dd-sqwd9 |
Killing |
Stopping container ensemble-graph-b8212 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-932a3-predictor-7586c4f994-hg9tx |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-932a3-predictor-7586c4f994-hg9tx |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1400" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-932a3-predictor-7586c4f994-hg9tx |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-932a3-predictor-7586c4f994-hg9tx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-932a3 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-932a3": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-932a3": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-932a3 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-932a3": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-932a3-predictor-7586c4f994 |
SuccessfulCreate |
Created pod: success-200-isvc-932a3-predictor-7586c4f994-hg9tx | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-932a3-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-932a3-predictor-7586c4f994 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b8212-predictor-58b6586fc-kb7m6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-932a3-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-932a3-predictor-5b4b84fcb7 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-932a3-predictor-5b4b84fcb7-jwg8q |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-932a3-predictor-5b4b84fcb7-jwg8q |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-932a3-predictor-5b4b84fcb7-jwg8q |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1400" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b8212-predictor-598b577b-bw5tf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-932a3 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-932a3": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-932a3-predictor-5b4b84fcb7-jwg8q |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-932a3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-932a3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-b8212-86c7c564dd-sqwd9 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-932a3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-932a3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a03d4-predictor-794c46dd55-49r9m |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a03d4 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-a03d4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-a03d4-predictor-7b7c8c8654 |
SuccessfulCreate |
Created pod: success-200-isvc-a03d4-predictor-7b7c8c8654-scwmx | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-a03d4-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-a03d4-predictor-7b7c8c8654 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cc0f2-predictor-56bbbc6bdb-mmsf7 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-a03d4-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-a03d4-predictor-794c46dd55 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a03d4-predictor-794c46dd55-49r9m |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1400" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-a03d4-predictor-7b7c8c8654-scwmx |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a03d4-predictor-794c46dd55-49r9m |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a03d4 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-a03d4": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-a03d4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a03d4 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-a03d4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a03d4-predictor-7b7c8c8654-scwmx |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1400" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-a03d4-predictor-794c46dd55 |
SuccessfulCreate |
Created pod: error-404-isvc-a03d4-predictor-794c46dd55-49r9m | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-cc0f2-8b5c9b9f7-vvxvk |
Killing |
Stopping container sequence-graph-cc0f2 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cc0f2-predictor-55b9dd659f-bvmfn |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a03d4-predictor-7b7c8c8654-scwmx |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a03d4-predictor-7b7c8c8654-scwmx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a03d4 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-a03d4": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-a03d4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
error-404-isvc-a03d4-predictor-794c46dd55-49r9m |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-932a3 |
InferenceServiceReady |
InferenceService [success-200-isvc-932a3] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-932a3 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-932a3 |
InferenceServiceReady |
InferenceService [error-404-isvc-932a3] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-932a3 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-932a3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-932a3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a03d4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a03d4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-932a3-c77946655 |
SuccessfulCreate |
Created pod: splitter-graph-932a3-c77946655-t5lk8 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-932a3-c77946655-t5lk8 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-932a3-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-932a3 |
InferenceGraphReady |
InferenceGraph [splitter-graph-932a3] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-932a3 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-932a3-c77946655 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-932a3-c77946655-t5lk8 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:5ddf7b68668839b048ac1f65cf22f5a7b21a1ddc89705b9e0ad240d64f017b66" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-932a3-c77946655-t5lk8 |
Created |
Created container: splitter-graph-932a3 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-932a3-c77946655-t5lk8 |
Started |
Started container splitter-graph-932a3 | |
kserve-ci-e2e-test |
multus |
splitter-graph-932a3-c77946655-t5lk8 |
AddedInterface |
Add eth0 [10.133.0.32/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-cc0f2-8b5c9b9f7-vvxvk |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-932a3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-932a3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a03d4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a03d4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-ee4eb-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-ee4eb-predictor-6cdf96cdcb from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-ee4eb-predictor-6cdf96cdcb |
SuccessfulCreate |
Created pod: success-200-isvc-ee4eb-predictor-6cdf96cdcb-q4jmp | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-ee4eb-predictor-6b8659d7f7 |
SuccessfulCreate |
Created pod: error-404-isvc-ee4eb-predictor-6b8659d7f7-l4v4d | |
kserve-ci-e2e-test |
multus |
success-200-isvc-ee4eb-predictor-6cdf96cdcb-q4jmp |
AddedInterface |
Add eth0 [10.134.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ee4eb-predictor-6cdf96cdcb-q4jmp |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1400" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-932a3-c77946655-t5lk8 |
Killing |
Stopping container splitter-graph-932a3 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-932a3-predictor-7586c4f994-hg9tx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-932a3-predictor-5b4b84fcb7-jwg8q |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-ee4eb-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-ee4eb-predictor-6b8659d7f7 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ee4eb-predictor-6cdf96cdcb-q4jmp |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ee4eb-predictor-6b8659d7f7-l4v4d |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ee4eb-predictor-6b8659d7f7-l4v4d |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ee4eb-predictor-6b8659d7f7-l4v4d |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1400" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-ee4eb-predictor-6b8659d7f7-l4v4d |
AddedInterface |
Add eth0 [10.134.0.46/23] from ovn-kubernetes | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-932a3-predictor-7586c4f994-hg9tx |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.41:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ee4eb-predictor-6cdf96cdcb-q4jmp |
Started |
Started container kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-932a3-predictor-5b4b84fcb7-jwg8q |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.42:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a03d4 |
InferenceServiceReady |
InferenceService [success-200-isvc-a03d4] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a03d4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a03d4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a03d4 |
InferenceServiceReady |
InferenceService [error-404-isvc-a03d4] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a03d4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a03d4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-932a3-c77946655-t5lk8 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ee4eb-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ee4eb-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
switch-graph-a03d4-7967858c6b-gzxdj |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-a03d4-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-a03d4-7967858c6b |
SuccessfulCreate |
Created pod: switch-graph-a03d4-7967858c6b-gzxdj | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-a03d4 |
ScalingReplicaSet |
Scaled up replica set switch-graph-a03d4-7967858c6b from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-a03d4 |
InferenceGraphReady |
InferenceGraph [switch-graph-a03d4] is Ready | |
kserve-ci-e2e-test |
multus |
switch-graph-a03d4-7967858c6b-gzxdj |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-a03d4-7967858c6b-gzxdj |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:5ddf7b68668839b048ac1f65cf22f5a7b21a1ddc89705b9e0ad240d64f017b66" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-a03d4-7967858c6b-gzxdj |
Created |
Created container: switch-graph-a03d4 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-a03d4-7967858c6b-gzxdj |
Started |
Started container switch-graph-a03d4 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a03d4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a03d4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-ee4eb-predictor-6cdf96cdcb-q4jmp |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.45:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-ee4eb-predictor-6b8659d7f7-l4v4d |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.46:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ee4eb-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ee4eb-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ee4eb |
InferenceServiceReady |
InferenceService [success-200-isvc-ee4eb] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ee4eb |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ee4eb |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ee4eb |
InferenceServiceReady |
InferenceService [error-404-isvc-ee4eb] is Ready | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-ee4eb |
InferenceGraphReady |
InferenceGraph [splitter-graph-ee4eb] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-ee4eb-6c7dd7d556 |
SuccessfulCreate |
Created pod: splitter-graph-ee4eb-6c7dd7d556-krjp8 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-ee4eb-6c7dd7d556-krjp8 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-ee4eb-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-ee4eb |
ScalingReplicaSet |
Scaled up replica set splitter-graph-ee4eb-6c7dd7d556 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-ee4eb-6c7dd7d556-krjp8 |
Started |
Started container splitter-graph-ee4eb | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-ee4eb-6c7dd7d556-krjp8 |
Created |
Created container: splitter-graph-ee4eb | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-ee4eb-6c7dd7d556-krjp8 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:5ddf7b68668839b048ac1f65cf22f5a7b21a1ddc89705b9e0ad240d64f017b66" already present on machine | |
kserve-ci-e2e-test |
multus |
splitter-graph-ee4eb-6c7dd7d556-krjp8 |
AddedInterface |
Add eth0 [10.133.0.34/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ee4eb-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ee4eb-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-a03d4 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-a03d4 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ee4eb-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ee4eb-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-ee4eb |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-ee4eb |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ee4eb-predictor-6cdf96cdcb-q4jmp |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-ee4eb-6c7dd7d556-krjp8 |
Killing |
Stopping container splitter-graph-ee4eb | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ee4eb-predictor-6b8659d7f7-l4v4d |
Killing |
Stopping container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-ee4eb-6c7dd7d556-krjp8 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a03d4-predictor-7b7c8c8654-scwmx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a03d4-predictor-794c46dd55-49r9m |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
switch-graph-a03d4-7967858c6b-gzxdj |
Killing |
Stopping container switch-graph-a03d4 | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-a03d4-predictor-794c46dd55-49r9m |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.44:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-a03d4-predictor-7b7c8c8654-scwmx |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.43:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
kubelet |
switch-graph-a03d4-7967858c6b-gzxdj |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |