| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
error-404-isvc-ddc34-predictor-64558dffdb-gvgtl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-ddc34-predictor-64558dffdb-gvgtl to ip-10-0-128-17.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-ddc34-predictor-54b9f46b47-258vb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-ddc34-predictor-54b9f46b47-258vb to ip-10-0-136-18.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf to ip-10-0-136-18.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-9c92a-predictor-5b64d8b4b7-rk5wg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-9c92a-predictor-5b64d8b4b7-rk5wg to ip-10-0-136-18.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-ea3c5-predictor-848549444-hb7jc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-ea3c5-predictor-848549444-hb7jc to ip-10-0-128-17.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-482a1-predictor-686985f998-wdxbb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-482a1-predictor-686985f998-wdxbb to ip-10-0-128-17.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-555fc69d56-x7bp5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-x7bp5 to ip-10-0-136-18.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-8975a-predictor-748969fd7d-k9kmm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-8975a-predictor-748969fd7d-k9kmm to ip-10-0-128-17.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg to ip-10-0-136-18.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-1ab9e-predictor-595c484fbc-shn4m |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-1ab9e-predictor-595c484fbc-shn4m to ip-10-0-136-18.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-20f8f-predictor-7996fdcc9f-82nm4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-20f8f-predictor-7996fdcc9f-82nm4 to ip-10-0-136-18.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-ff919-predictor-6bbdbd4fc7-7vgxn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-ff919-predictor-6bbdbd4fc7-7vgxn to ip-10-0-136-18.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-20f8f-predictor-65795d6ffd-lqj2s |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-20f8f-predictor-65795d6ffd-lqj2s to ip-10-0-128-17.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-9c92a-7458554479-n8fnv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-9c92a-7458554479-n8fnv to ip-10-0-132-119.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-a9581-694df647d-nn95d |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-a9581-694df647d-nn95d to ip-10-0-132-119.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-482a1-predictor-747c4d74f5-fq6rz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-482a1-predictor-747c4d74f5-fq6rz to ip-10-0-136-18.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-8975a-predictor-67685ddcd7-57fpp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-8975a-predictor-67685ddcd7-57fpp to ip-10-0-136-18.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-ff919-c4589574f-j5k57 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-ff919-c4589574f-j5k57 to ip-10-0-132-119.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-a9581-predictor-5656556755-688q4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-a9581-predictor-5656556755-688q4 to ip-10-0-136-18.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-a9581-predictor-74b4589474-bz7h6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-a9581-predictor-74b4589474-bz7h6 to ip-10-0-128-17.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-ddc34-98b445d6c-9zb8b |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-ddc34-98b445d6c-9zb8b to ip-10-0-132-119.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-ea3c5-5d669fffd4-pqsgm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-ea3c5-5d669fffd4-pqsgm to ip-10-0-132-119.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-1ab9e-567bbdc5cc-77rv9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-1ab9e-567bbdc5cc-77rv9 to ip-10-0-132-119.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-e5408-66fb7f646b-d99b8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-e5408-66fb7f646b-d99b8 to ip-10-0-132-119.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-1ab9e-predictor-d4c755658-thbsc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-1ab9e-predictor-d4c755658-thbsc to ip-10-0-128-17.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-6f97b8c58f-jd8dx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-6f97b8c58f-jd8dx to ip-10-0-132-119.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-e5408-predictor-7cfd9ff86-4zpt6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-e5408-predictor-7cfd9ff86-4zpt6 to ip-10-0-128-17.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-8975a-67db9b666-tz2kd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-8975a-67db9b666-tz2kd to ip-10-0-132-119.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-482a1-556896489f-gxlb5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-482a1-556896489f-gxlb5 to ip-10-0-132-119.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-ea3c5-predictor-86955dc77c-sd4rh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-ea3c5-predictor-86955dc77c-sd4rh to ip-10-0-136-18.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-e5408-predictor-765956d4cf-svlxt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-e5408-predictor-765956d4cf-svlxt to ip-10-0-136-18.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-ff919-predictor-754fd47c76-zdg46 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-ff919-predictor-754fd47c76-zdg46 to ip-10-0-128-17.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-9c92a-predictor-7cc7d7578-x4tw6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-9c92a-predictor-7cc7d7578-x4tw6 to ip-10-0-128-17.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-20f8f-7765c6fc54-q5zts |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-20f8f-7765c6fc54-q5zts to ip-10-0-132-119.ec2.internal | ||
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-8975a-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-8975a-predictor-748969fd7d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-8975a-predictor-748969fd7d |
SuccessfulCreate |
Created pod: error-404-isvc-8975a-predictor-748969fd7d-k9kmm | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-555fc69d56 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-555fc69d56-x7bp5 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-8975a-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-8975a-predictor-67685ddcd7 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-555fc69d56 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-5dcd4747bf |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-5dcd4747bf from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-8975a-predictor-67685ddcd7 |
SuccessfulCreate |
Created pod: success-200-isvc-8975a-predictor-67685ddcd7-57fpp | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-76586f68dc |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-x7bp5 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-xgboost-graph-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf |
AddedInterface |
Add eth0 [10.134.0.20/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:4164f82a611b9e52a903d9686e415dbc9c35d0c556e392d7254ca59528ec9948" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-sklearn-graph-2-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
success-200-isvc-8975a-predictor-67685ddcd7-57fpp |
AddedInterface |
Add eth0 [10.134.0.21/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8975a-predictor-67685ddcd7-57fpp |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1928" | |
| (x2) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-8975a-predictor-748969fd7d-k9kmm |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-8975a-predictor-serving-cert" not found |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-76586f68dc from 0 to 1 | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-555fc69d56-x7bp5 |
AddedInterface |
Add eth0 [10.134.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-x7bp5 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8975a-predictor-748969fd7d-k9kmm |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1928" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
error-404-isvc-8975a-predictor-748969fd7d-k9kmm |
AddedInterface |
Add eth0 [10.132.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-x7bp5 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:4164f82a611b9e52a903d9686e415dbc9c35d0c556e392d7254ca59528ec9948" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:4164f82a611b9e52a903d9686e415dbc9c35d0c556e392d7254ca59528ec9948" already present on machine | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg |
AddedInterface |
Add eth0 [10.134.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-x7bp5 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1928" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-x7bp5 |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1928" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8975a-predictor-748969fd7d-k9kmm |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8975a-predictor-748969fd7d-k9kmm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8975a-predictor-748969fd7d-k9kmm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8975a-predictor-748969fd7d-k9kmm |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1928" in 11.719s (11.719s including waiting). Image size: 1357269580 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8975a-predictor-748969fd7d-k9kmm |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8975a-predictor-748969fd7d-k9kmm |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.185s (2.185s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8975a-predictor-748969fd7d-k9kmm |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8975a-predictor-67685ddcd7-57fpp |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8975a-predictor-67685ddcd7-57fpp |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8975a-predictor-67685ddcd7-57fpp |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1928" in 16.231s (16.231s including waiting). Image size: 1356712016 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8975a-predictor-67685ddcd7-57fpp |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1928" in 10.625s (10.625s including waiting). Image size: 1583654804 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1928" in 10.606s (10.606s including waiting). Image size: 1583654804 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8975a-predictor-67685ddcd7-57fpp |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8975a-predictor-67685ddcd7-57fpp |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8975a-predictor-67685ddcd7-57fpp |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 3.643s (3.643s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 1.57s (1.57s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 3.551s (3.551s including waiting). Image size: 211946088 bytes. | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-x7bp5 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-x7bp5 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-x7bp5 |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 30.472s (30.472s including waiting). Image size: 1332343041 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-x7bp5 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-x7bp5 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-x7bp5 |
Started |
Started container kube-rbac-proxy | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8975a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8975a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8975a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8975a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-8975a-predictor-748969fd7d-k9kmm |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.34:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8975a |
InferenceServiceReady |
InferenceService [error-404-isvc-8975a] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8975a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8975a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8975a |
InferenceServiceReady |
InferenceService [success-200-isvc-8975a] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8975a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8975a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-8975a-67db9b666 |
SuccessfulCreate |
Created pod: switch-graph-8975a-67db9b666-tz2kd | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8975a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-8975a |
InferenceGraphReady |
InferenceGraph [switch-graph-8975a] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-8975a-67db9b666-tz2kd |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-8975a-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-8975a |
ScalingReplicaSet |
Scaled up replica set switch-graph-8975a-67db9b666 from 0 to 1 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8975a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
multus |
switch-graph-8975a-67db9b666-tz2kd |
AddedInterface |
Add eth0 [10.133.0.20/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-8975a-67db9b666-tz2kd |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:7ae24018e4b762b3a4204d7b989ec2ec72d61978201f42380712a0f4d411d8ad" | |
kserve-ci-e2e-test |
kubelet |
switch-graph-8975a-67db9b666-tz2kd |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:7ae24018e4b762b3a4204d7b989ec2ec72d61978201f42380712a0f4d411d8ad" in 3.172s (3.172s including waiting). Image size: 214907987 bytes. | |
kserve-ci-e2e-test |
kubelet |
switch-graph-8975a-67db9b666-tz2kd |
Created |
Created container: switch-graph-8975a | |
kserve-ci-e2e-test |
kubelet |
switch-graph-8975a-67db9b666-tz2kd |
Started |
Started container switch-graph-8975a | |
| (x11) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.23:8080: connect: connection refused |
| (x10) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.20:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9c92a |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-9c92a": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-9c92a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
switch-graph-8975a-67db9b666-tz2kd |
Killing |
Stopping container switch-graph-8975a | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8975a-predictor-748969fd7d-k9kmm |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8975a-predictor-748969fd7d-k9kmm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9c92a |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-9c92a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-9c92a-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-9c92a-predictor-5b64d8b4b7 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-9c92a-predictor-5b64d8b4b7 |
SuccessfulCreate |
Created pod: success-200-isvc-9c92a-predictor-5b64d8b4b7-rk5wg | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8975a-predictor-67685ddcd7-57fpp |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8975a-predictor-67685ddcd7-57fpp |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9c92a-predictor-5b64d8b4b7-rk5wg |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9c92a |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-9c92a": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-9c92a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9c92a-predictor-7cc7d7578-x4tw6 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-9c92a-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9c92a-predictor-5b64d8b4b7-rk5wg |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1928" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-9c92a-predictor-5b64d8b4b7-rk5wg |
AddedInterface |
Add eth0 [10.134.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9c92a-predictor-5b64d8b4b7-rk5wg |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-9c92a-predictor-7cc7d7578 |
SuccessfulCreate |
Created pod: error-404-isvc-9c92a-predictor-7cc7d7578-x4tw6 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9c92a-predictor-5b64d8b4b7-rk5wg |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-9c92a-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-9c92a-predictor-7cc7d7578 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9c92a |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-9c92a": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9c92a-predictor-5b64d8b4b7-rk5wg |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9c92a-predictor-5b64d8b4b7-rk5wg |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9c92a-predictor-7cc7d7578-x4tw6 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9c92a-predictor-7cc7d7578-x4tw6 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1928" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9c92a-predictor-7cc7d7578-x4tw6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9c92a-predictor-7cc7d7578-x4tw6 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-9c92a-predictor-7cc7d7578-x4tw6 |
AddedInterface |
Add eth0 [10.132.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9c92a-predictor-7cc7d7578-x4tw6 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9c92a-predictor-7cc7d7578-x4tw6 |
Created |
Created container: kube-rbac-proxy | |
| (x8) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-8975a-predictor-67685ddcd7-57fpp |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.21:8080: connect: connection refused |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8975a-predictor-67685ddcd7-57fpp |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.21:8643/healthz": dial tcp 10.134.0.21:8643: connect: connection refused | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
kubelet |
model-chainer-6f97b8c58f-jd8dx |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "model-chainer-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-6f97b8c58f |
SuccessfulCreate |
Created pod: model-chainer-6f97b8c58f-jd8dx | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-6f97b8c58f from 0 to 1 | |
kserve-ci-e2e-test |
multus |
model-chainer-6f97b8c58f-jd8dx |
AddedInterface |
Add eth0 [10.133.0.21/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
model-chainer-6f97b8c58f-jd8dx |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:7ae24018e4b762b3a4204d7b989ec2ec72d61978201f42380712a0f4d411d8ad" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-8975a-67db9b666-tz2kd |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
model-chainer-6f97b8c58f-jd8dx |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-6f97b8c58f-jd8dx |
Started |
Started container model-chainer | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9c92a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9c92a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9c92a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9c92a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x7) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x7) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ff919 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-ff919": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-x7bp5 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-ff919-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-ff919-predictor-6bbdbd4fc7 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-ff919-predictor-6bbdbd4fc7 |
SuccessfulCreate |
Created pod: success-200-isvc-ff919-predictor-6bbdbd4fc7-7vgxn | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ff919 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-ff919": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
model-chainer-6f97b8c58f-jd8dx |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ff919 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-ff919": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-ff919": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-ff919-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-ff919-predictor-754fd47c76 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-ff919-predictor-754fd47c76 |
SuccessfulCreate |
Created pod: error-404-isvc-ff919-predictor-754fd47c76-zdg46 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ff919 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-ff919": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-ff919": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-x7bp5 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ff919-predictor-754fd47c76-zdg46 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1928" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-ff919-predictor-754fd47c76-zdg46 |
AddedInterface |
Add eth0 [10.132.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ff919-predictor-754fd47c76-zdg46 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ff919-predictor-754fd47c76-zdg46 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ff919-predictor-754fd47c76-zdg46 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ff919-predictor-754fd47c76-zdg46 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ff919-predictor-754fd47c76-zdg46 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ff919-predictor-6bbdbd4fc7-7vgxn |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ff919-predictor-6bbdbd4fc7-7vgxn |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ff919-predictor-6bbdbd4fc7-7vgxn |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ff919-predictor-6bbdbd4fc7-7vgxn |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ff919-predictor-6bbdbd4fc7-7vgxn |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-ff919-predictor-6bbdbd4fc7-7vgxn |
AddedInterface |
Add eth0 [10.134.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ff919-predictor-6bbdbd4fc7-7vgxn |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1928" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76586f68dc-g5gwg |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.23:8643/healthz": dial tcp 10.134.0.23:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-9c92a-predictor-7cc7d7578-x4tw6 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.35:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-9c92a-predictor-5b64d8b4b7-rk5wg |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.24:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-5dcd4747bf-pxvpf |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.20:8643/healthz": dial tcp 10.134.0.20:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-x7bp5 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.22:8643/healthz": dial tcp 10.134.0.22:8643: connect: connection refused | |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-x7bp5 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.22:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9c92a |
InferenceServiceReady |
InferenceService [success-200-isvc-9c92a] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9c92a |
InferenceServiceReady |
InferenceService [error-404-isvc-9c92a] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9c92a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9c92a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ff919-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ff919-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-9c92a |
ScalingReplicaSet |
Scaled up replica set switch-graph-9c92a-7458554479 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-9c92a-7458554479 |
SuccessfulCreate |
Created pod: switch-graph-9c92a-7458554479-n8fnv | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9c92a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9c92a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-9c92a |
InferenceGraphReady |
InferenceGraph [switch-graph-9c92a] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-9c92a-7458554479-n8fnv |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-9c92a-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
switch-graph-9c92a-7458554479-n8fnv |
Started |
Started container switch-graph-9c92a | |
kserve-ci-e2e-test |
multus |
switch-graph-9c92a-7458554479-n8fnv |
AddedInterface |
Add eth0 [10.133.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-9c92a-7458554479-n8fnv |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:7ae24018e4b762b3a4204d7b989ec2ec72d61978201f42380712a0f4d411d8ad" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-9c92a-7458554479-n8fnv |
Created |
Created container: switch-graph-9c92a | |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-6f97b8c58f-jd8dx |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ff919-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ff919-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9c92a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9c92a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-9c92a |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-ff919-predictor-754fd47c76-zdg46 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.36:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-9c92a |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ff919 |
InferenceServiceReady |
InferenceService [success-200-isvc-ff919] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ff919 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ff919 |
InferenceServiceReady |
InferenceService [error-404-isvc-ff919] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ff919 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-9c92a |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-9c92a |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-ff919 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-ff919": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-ff919 |
UpdateFailed |
Failed to update status for InferenceGraph "sequence-graph-ff919": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "sequence-graph-ff919": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-ff919-c4589574f |
SuccessfulCreate |
Created pod: sequence-graph-ff919-c4589574f-j5k57 | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-ff919 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-ff919-c4589574f from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-ff919 |
InferenceGraphReady |
InferenceGraph [sequence-graph-ff919] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-ff919-c4589574f-j5k57 |
Started |
Started container sequence-graph-ff919 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-ff919-c4589574f-j5k57 |
Created |
Created container: sequence-graph-ff919 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-ff919-c4589574f-j5k57 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:7ae24018e4b762b3a4204d7b989ec2ec72d61978201f42380712a0f4d411d8ad" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-ff919-c4589574f-j5k57 |
AddedInterface |
Add eth0 [10.133.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-ff919 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-ff919 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ff919-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ff919-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ff919-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ff919-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-ff919 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-ff919 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9c92a-predictor-5b64d8b4b7-rk5wg |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9c92a-predictor-5b64d8b4b7-rk5wg |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a9581 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-a9581": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-a9581": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
switch-graph-9c92a-7458554479-n8fnv |
Killing |
Stopping container switch-graph-9c92a | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a9581 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-a9581": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a9581 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-a9581": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-a9581": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-a9581-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-a9581-predictor-5656556755 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-a9581-predictor-5656556755 |
SuccessfulCreate |
Created pod: success-200-isvc-a9581-predictor-5656556755-688q4 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-a9581-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-a9581-predictor-74b4589474 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-a9581-predictor-74b4589474 |
SuccessfulCreate |
Created pod: error-404-isvc-a9581-predictor-74b4589474-bz7h6 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a9581 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-a9581": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9c92a-predictor-7cc7d7578-x4tw6 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9c92a-predictor-7cc7d7578-x4tw6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a9581-predictor-74b4589474-bz7h6 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a9581-predictor-74b4589474-bz7h6 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a9581-predictor-5656556755-688q4 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-a9581-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a9581-predictor-74b4589474-bz7h6 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a9581-predictor-74b4589474-bz7h6 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a9581-predictor-74b4589474-bz7h6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-a9581-predictor-74b4589474-bz7h6 |
AddedInterface |
Add eth0 [10.132.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a9581-predictor-74b4589474-bz7h6 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1928" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a9581-predictor-5656556755-688q4 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a9581-predictor-5656556755-688q4 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-a9581-predictor-5656556755-688q4 |
AddedInterface |
Add eth0 [10.134.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a9581-predictor-5656556755-688q4 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a9581-predictor-5656556755-688q4 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1928" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a9581-predictor-5656556755-688q4 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a9581-predictor-5656556755-688q4 |
Started |
Started container kube-rbac-proxy | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-9c92a-7458554479-n8fnv |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a9581-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a9581-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a9581-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a9581-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ff919-predictor-754fd47c76-zdg46 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-e5408-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-e5408-predictor-7cfd9ff86 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ff919-predictor-754fd47c76-zdg46 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ff919-predictor-6bbdbd4fc7-7vgxn |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ff919-predictor-6bbdbd4fc7-7vgxn |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-e5408-predictor-7cfd9ff86 |
SuccessfulCreate |
Created pod: error-404-isvc-e5408-predictor-7cfd9ff86-4zpt6 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-ff919-c4589574f-j5k57 |
Killing |
Stopping container sequence-graph-ff919 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-e5408-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-e5408-predictor-765956d4cf from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-e5408-predictor-765956d4cf |
SuccessfulCreate |
Created pod: success-200-isvc-e5408-predictor-765956d4cf-svlxt | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5408-predictor-765956d4cf-svlxt |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-e5408-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5408-predictor-765956d4cf-svlxt |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5408-predictor-765956d4cf-svlxt |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1928" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-e5408-predictor-765956d4cf-svlxt |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5408-predictor-765956d4cf-svlxt |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5408-predictor-765956d4cf-svlxt |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5408-predictor-7cfd9ff86-4zpt6 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-e5408-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5408-predictor-7cfd9ff86-4zpt6 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5408-predictor-7cfd9ff86-4zpt6 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5408-predictor-7cfd9ff86-4zpt6 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5408-predictor-7cfd9ff86-4zpt6 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5408-predictor-765956d4cf-svlxt |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ff919-predictor-6bbdbd4fc7-7vgxn |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.25:8643/healthz": dial tcp 10.134.0.25:8643: connect: connection refused | |
kserve-ci-e2e-test |
multus |
error-404-isvc-e5408-predictor-7cfd9ff86-4zpt6 |
AddedInterface |
Add eth0 [10.132.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5408-predictor-7cfd9ff86-4zpt6 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1928" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5408-predictor-7cfd9ff86-4zpt6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5408-predictor-765956d4cf-svlxt |
Started |
Started container kube-rbac-proxy | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-a9581-predictor-74b4589474-bz7h6 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.37:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-ff919-predictor-6bbdbd4fc7-7vgxn |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.25:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-a9581-predictor-5656556755-688q4 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.26:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a9581 |
InferenceServiceReady |
InferenceService [error-404-isvc-a9581] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a9581 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a9581 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a9581 |
InferenceServiceReady |
InferenceService [success-200-isvc-a9581] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e5408-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e5408-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a9581-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a9581-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a9581-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-a9581 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-a9581] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a9581-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-a9581 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-a9581-694df647d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-a9581-694df647d |
SuccessfulCreate |
Created pod: ensemble-graph-a9581-694df647d-nn95d | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-a9581-694df647d-nn95d |
Started |
Started container ensemble-graph-a9581 | |
kserve-ci-e2e-test |
multus |
ensemble-graph-a9581-694df647d-nn95d |
AddedInterface |
Add eth0 [10.133.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-a9581-694df647d-nn95d |
Created |
Created container: ensemble-graph-a9581 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-a9581-694df647d-nn95d |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:7ae24018e4b762b3a4204d7b989ec2ec72d61978201f42380712a0f4d411d8ad" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-ff919-c4589574f-j5k57 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e5408-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e5408-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-a9581-694df647d-nn95d |
Killing |
Stopping container ensemble-graph-a9581 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-1ab9e-predictor-d4c755658 |
SuccessfulCreate |
Created pod: error-404-isvc-1ab9e-predictor-d4c755658-thbsc | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1ab9e-predictor-595c484fbc-shn4m |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-1ab9e-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a9581-predictor-74b4589474-bz7h6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1ab9e |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-1ab9e": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-1ab9e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1ab9e |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-1ab9e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-1ab9e-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-1ab9e-predictor-d4c755658 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1ab9e-predictor-d4c755658-thbsc |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-1ab9e-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a9581-predictor-74b4589474-bz7h6 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1ab9e |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-1ab9e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1ab9e |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-1ab9e": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-1ab9e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a9581-predictor-5656556755-688q4 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a9581-predictor-5656556755-688q4 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-1ab9e-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-1ab9e-predictor-595c484fbc from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-1ab9e-predictor-595c484fbc |
SuccessfulCreate |
Created pod: success-200-isvc-1ab9e-predictor-595c484fbc-shn4m | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1ab9e-predictor-595c484fbc-shn4m |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1ab9e-predictor-595c484fbc-shn4m |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-1ab9e-predictor-d4c755658-thbsc |
AddedInterface |
Add eth0 [10.132.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1ab9e-predictor-595c484fbc-shn4m |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1ab9e-predictor-595c484fbc-shn4m |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1ab9e-predictor-595c484fbc-shn4m |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1ab9e-predictor-d4c755658-thbsc |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1928" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1ab9e-predictor-595c484fbc-shn4m |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1928" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-1ab9e-predictor-595c484fbc-shn4m |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1ab9e-predictor-d4c755658-thbsc |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1ab9e-predictor-d4c755658-thbsc |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1ab9e-predictor-d4c755658-thbsc |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1ab9e-predictor-d4c755658-thbsc |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1ab9e-predictor-d4c755658-thbsc |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a9581-predictor-74b4589474-bz7h6 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.37:8643/healthz": dial tcp 10.132.0.37:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5408-predictor-765956d4cf-svlxt |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.27:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5408-predictor-7cfd9ff86-4zpt6 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.38:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e5408 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e5408 |
InferenceServiceReady |
InferenceService [success-200-isvc-e5408] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e5408 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e5408 |
InferenceServiceReady |
InferenceService [error-404-isvc-e5408] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-e5408-66fb7f646b |
SuccessfulCreate |
Created pod: sequence-graph-e5408-66fb7f646b-d99b8 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-e5408 |
InferenceGraphReady |
InferenceGraph [sequence-graph-e5408] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-e5408 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-e5408-66fb7f646b from 0 to 1 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e5408-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e5408-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e5408-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e5408-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
sequence-graph-e5408-66fb7f646b-d99b8 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-e5408-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-e5408-66fb7f646b-d99b8 |
Created |
Created container: sequence-graph-e5408 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-e5408-66fb7f646b-d99b8 |
Started |
Started container sequence-graph-e5408 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-e5408-66fb7f646b-d99b8 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:7ae24018e4b762b3a4204d7b989ec2ec72d61978201f42380712a0f4d411d8ad" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-e5408-66fb7f646b-d99b8 |
AddedInterface |
Add eth0 [10.133.0.25/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-a9581-694df647d-nn95d |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-ea3c5-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-ea3c5-predictor-86955dc77c from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5408-predictor-7cfd9ff86-4zpt6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5408-predictor-765956d4cf-svlxt |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5408-predictor-7cfd9ff86-4zpt6 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-ea3c5-predictor-86955dc77c |
SuccessfulCreate |
Created pod: success-200-isvc-ea3c5-predictor-86955dc77c-sd4rh | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-e5408-66fb7f646b-d99b8 |
Killing |
Stopping container sequence-graph-e5408 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5408-predictor-765956d4cf-svlxt |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-ea3c5-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-ea3c5-predictor-848549444 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ea3c5-predictor-848549444-hb7jc |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ea3c5-predictor-848549444-hb7jc |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ea3c5-predictor-848549444-hb7jc |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1928" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-ea3c5-predictor-848549444 |
SuccessfulCreate |
Created pod: error-404-isvc-ea3c5-predictor-848549444-hb7jc | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ea3c5-predictor-848549444-hb7jc |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ea3c5-predictor-848549444-hb7jc |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea3c5-predictor-86955dc77c-sd4rh |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-ea3c5-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ea3c5-predictor-848549444-hb7jc |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-ea3c5-predictor-848549444-hb7jc |
AddedInterface |
Add eth0 [10.132.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea3c5-predictor-86955dc77c-sd4rh |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea3c5-predictor-86955dc77c-sd4rh |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea3c5-predictor-86955dc77c-sd4rh |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea3c5-predictor-86955dc77c-sd4rh |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1928" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea3c5-predictor-86955dc77c-sd4rh |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-ea3c5-predictor-86955dc77c-sd4rh |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea3c5-predictor-86955dc77c-sd4rh |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e5408-predictor-7cfd9ff86-4zpt6 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.38:8643/healthz": dial tcp 10.132.0.38:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-1ab9e-predictor-595c484fbc-shn4m |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.28:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e5408-predictor-765956d4cf-svlxt |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.27:8643/healthz": dial tcp 10.134.0.27:8643: connect: connection refused | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1ab9e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1ab9e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1ab9e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1ab9e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1ab9e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1ab9e |
InferenceServiceReady |
InferenceService [success-200-isvc-1ab9e] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1ab9e |
InferenceServiceReady |
InferenceService [error-404-isvc-1ab9e] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1ab9e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-1ab9e |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-1ab9e-567bbdc5cc from 0 to 1 | |
kserve-ci-e2e-test |
multus |
ensemble-graph-1ab9e-567bbdc5cc-77rv9 |
AddedInterface |
Add eth0 [10.133.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-1ab9e-567bbdc5cc-77rv9 |
Started |
Started container ensemble-graph-1ab9e | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-1ab9e-567bbdc5cc-77rv9 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:7ae24018e4b762b3a4204d7b989ec2ec72d61978201f42380712a0f4d411d8ad" already present on machine | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-1ab9e |
InferenceGraphReady |
InferenceGraph [ensemble-graph-1ab9e] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-1ab9e-567bbdc5cc |
SuccessfulCreate |
Created pod: ensemble-graph-1ab9e-567bbdc5cc-77rv9 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-1ab9e-567bbdc5cc-77rv9 |
Created |
Created container: ensemble-graph-1ab9e | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-e5408-66fb7f646b-d99b8 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ea3c5-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ea3c5-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ea3c5-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ea3c5-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-ea3c5-predictor-848549444-hb7jc |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.40:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1ab9e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-1ab9e |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-1ab9e |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1ab9e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ea3c5 |
InferenceServiceReady |
InferenceService [error-404-isvc-ea3c5] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ea3c5 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ea3c5 |
InferenceServiceReady |
InferenceService [success-200-isvc-ea3c5] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ea3c5 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1ab9e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1ab9e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-1ab9e |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-1ab9e |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-ea3c5-5d669fffd4 |
SuccessfulCreate |
Created pod: sequence-graph-ea3c5-5d669fffd4-pqsgm | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-ea3c5 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-ea3c5-5d669fffd4 from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ea3c5-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-ea3c5 |
InferenceGraphReady |
InferenceGraph [sequence-graph-ea3c5] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-ea3c5-5d669fffd4-pqsgm |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-ea3c5-serving-cert" not found | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ea3c5-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
sequence-graph-ea3c5-5d669fffd4-pqsgm |
Started |
Started container sequence-graph-ea3c5 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-ea3c5-5d669fffd4-pqsgm |
Created |
Created container: sequence-graph-ea3c5 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-ea3c5-5d669fffd4-pqsgm |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:7ae24018e4b762b3a4204d7b989ec2ec72d61978201f42380712a0f4d411d8ad" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-ea3c5-5d669fffd4-pqsgm |
AddedInterface |
Add eth0 [10.133.0.27/23] from ovn-kubernetes | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ea3c5-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ea3c5-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-ea3c5 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-ea3c5 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-1ab9e-567bbdc5cc-77rv9 |
Killing |
Stopping container ensemble-graph-1ab9e | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1ab9e-predictor-595c484fbc-shn4m |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1ab9e-predictor-595c484fbc-shn4m |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-ddc34-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-ddc34-predictor-54b9f46b47 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ddc34 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-ddc34": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-ddc34": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1ab9e-predictor-d4c755658-thbsc |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1ab9e-predictor-d4c755658-thbsc |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-ddc34-predictor-64558dffdb |
SuccessfulCreate |
Created pod: error-404-isvc-ddc34-predictor-64558dffdb-gvgtl | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-ddc34-predictor-54b9f46b47 |
SuccessfulCreate |
Created pod: success-200-isvc-ddc34-predictor-54b9f46b47-258vb | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ddc34 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-ddc34": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-ddc34": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ddc34 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-ddc34": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-ddc34-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-ddc34-predictor-64558dffdb from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ddc34-predictor-54b9f46b47-258vb |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-ddc34-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ddc34-predictor-64558dffdb-gvgtl |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-ddc34-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ddc34 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-ddc34": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ddc34-predictor-64558dffdb-gvgtl |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ddc34-predictor-54b9f46b47-258vb |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1928" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ddc34-predictor-54b9f46b47-258vb |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ddc34-predictor-64558dffdb-gvgtl |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1928" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ddc34-predictor-54b9f46b47-258vb |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ddc34-predictor-54b9f46b47-258vb |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-ddc34-predictor-64558dffdb-gvgtl |
AddedInterface |
Add eth0 [10.132.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ddc34-predictor-64558dffdb-gvgtl |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ddc34-predictor-64558dffdb-gvgtl |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ddc34-predictor-64558dffdb-gvgtl |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ddc34-predictor-64558dffdb-gvgtl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-ddc34-predictor-54b9f46b47-258vb |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ddc34-predictor-54b9f46b47-258vb |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ddc34-predictor-54b9f46b47-258vb |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1ab9e-predictor-d4c755658-thbsc |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.39:8643/healthz": dial tcp 10.132.0.39:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-1ab9e-predictor-d4c755658-thbsc |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.39:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-1ab9e-567bbdc5cc-77rv9 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-482a1-predictor-686985f998 |
SuccessfulCreate |
Created pod: error-404-isvc-482a1-predictor-686985f998-wdxbb | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ea3c5-predictor-848549444-hb7jc |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea3c5-predictor-86955dc77c-sd4rh |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea3c5-predictor-86955dc77c-sd4rh |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-ea3c5-5d669fffd4-pqsgm |
Killing |
Stopping container sequence-graph-ea3c5 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-482a1-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-482a1-predictor-686985f998 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-482a1-predictor-747c4d74f5 |
SuccessfulCreate |
Created pod: success-200-isvc-482a1-predictor-747c4d74f5-fq6rz | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-482a1-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-482a1-predictor-747c4d74f5 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ea3c5-predictor-848549444-hb7jc |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-482a1-predictor-686985f998-wdxbb |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-482a1-predictor-747c4d74f5-fq6rz |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1928" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-482a1-predictor-686985f998-wdxbb |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-482a1-predictor-747c4d74f5-fq6rz |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-482a1-predictor-747c4d74f5-fq6rz |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-482a1-predictor-686985f998-wdxbb |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-482a1-predictor-686985f998-wdxbb |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-482a1-predictor-686985f998-wdxbb |
AddedInterface |
Add eth0 [10.132.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-482a1-predictor-747c4d74f5-fq6rz |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-482a1-predictor-747c4d74f5-fq6rz |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-482a1-predictor-686985f998-wdxbb |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-482a1-predictor-747c4d74f5-fq6rz |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-482a1-predictor-747c4d74f5-fq6rz |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-482a1-predictor-686985f998-wdxbb |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1928" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-ddc34-predictor-54b9f46b47-258vb |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.30:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea3c5-predictor-86955dc77c-sd4rh |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.29:8643/healthz": dial tcp 10.134.0.29:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-ea3c5-predictor-86955dc77c-sd4rh |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.29:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-ddc34-predictor-64558dffdb-gvgtl |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.41:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ddc34-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ddc34-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ddc34-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ddc34-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ddc34 |
InferenceServiceReady |
InferenceService [success-200-isvc-ddc34] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ddc34 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ddc34 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ddc34 |
InferenceServiceReady |
InferenceService [error-404-isvc-ddc34] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-482a1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-482a1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-ddc34 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-ddc34-98b445d6c from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ddc34-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ddc34-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ddc34-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ddc34-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
splitter-graph-ddc34-98b445d6c-9zb8b |
Created |
Created container: splitter-graph-ddc34 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-ddc34-98b445d6c-9zb8b |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:7ae24018e4b762b3a4204d7b989ec2ec72d61978201f42380712a0f4d411d8ad" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-ddc34-98b445d6c-9zb8b |
Started |
Started container splitter-graph-ddc34 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-ddc34 |
InferenceGraphReady |
InferenceGraph [splitter-graph-ddc34] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-ddc34-98b445d6c |
SuccessfulCreate |
Created pod: splitter-graph-ddc34-98b445d6c-9zb8b | |
kserve-ci-e2e-test |
multus |
splitter-graph-ddc34-98b445d6c-9zb8b |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-ea3c5-5d669fffd4-pqsgm |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-482a1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-482a1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ddc34-predictor-54b9f46b47-258vb |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-ddc34-98b445d6c-9zb8b |
Killing |
Stopping container splitter-graph-ddc34 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-20f8f-predictor-65795d6ffd |
SuccessfulCreate |
Created pod: error-404-isvc-20f8f-predictor-65795d6ffd-lqj2s | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-20f8f-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-20f8f-predictor-65795d6ffd from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ddc34-predictor-64558dffdb-gvgtl |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ddc34-predictor-64558dffdb-gvgtl |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-20f8f-predictor-7996fdcc9f-82nm4 |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-20f8f-predictor-7996fdcc9f |
SuccessfulCreate |
Created pod: success-200-isvc-20f8f-predictor-7996fdcc9f-82nm4 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-20f8f-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-20f8f-predictor-7996fdcc9f from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ddc34-predictor-54b9f46b47-258vb |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-20f8f-predictor-7996fdcc9f-82nm4 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-20f8f-predictor-7996fdcc9f-82nm4 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-20f8f-predictor-65795d6ffd-lqj2s |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-20f8f-predictor-65795d6ffd-lqj2s |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-20f8f-predictor-65795d6ffd-lqj2s |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-20f8f-predictor-7996fdcc9f-82nm4 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-20f8f-predictor-7996fdcc9f-82nm4 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-20f8f-predictor-65795d6ffd-lqj2s |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-20f8f-predictor-7996fdcc9f-82nm4 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-20f8f-predictor-65795d6ffd-lqj2s |
AddedInterface |
Add eth0 [10.132.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-20f8f-predictor-65795d6ffd-lqj2s |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-20f8f-predictor-65795d6ffd-lqj2s |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1928" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-20f8f-predictor-7996fdcc9f-82nm4 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1928" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-482a1-predictor-747c4d74f5-fq6rz |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.31:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ddc34-predictor-54b9f46b47-258vb |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.30:8643/healthz": dial tcp 10.134.0.30:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-482a1-predictor-686985f998-wdxbb |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.42:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-482a1 |
InferenceServiceReady |
InferenceService [error-404-isvc-482a1] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-482a1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-482a1 |
InferenceServiceReady |
InferenceService [success-200-isvc-482a1] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-482a1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-20f8f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-20f8f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-482a1-556896489f |
SuccessfulCreate |
Created pod: switch-graph-482a1-556896489f-gxlb5 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-482a1 |
InferenceGraphReady |
InferenceGraph [switch-graph-482a1] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-482a1 |
ScalingReplicaSet |
Scaled up replica set switch-graph-482a1-556896489f from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-482a1-556896489f-gxlb5 |
Started |
Started container switch-graph-482a1 | |
kserve-ci-e2e-test |
multus |
switch-graph-482a1-556896489f-gxlb5 |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-482a1-556896489f-gxlb5 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:7ae24018e4b762b3a4204d7b989ec2ec72d61978201f42380712a0f4d411d8ad" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-482a1-556896489f-gxlb5 |
Created |
Created container: switch-graph-482a1 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-ddc34-98b445d6c-9zb8b |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-20f8f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-20f8f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-20f8f-predictor-65795d6ffd-lqj2s |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.43:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-20f8f-predictor-7996fdcc9f-82nm4 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.32:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-482a1 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-482a1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-482a1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-482a1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-482a1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-482a1 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-20f8f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-20f8f |
InferenceServiceReady |
InferenceService [error-404-isvc-20f8f] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-20f8f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-20f8f |
InferenceServiceReady |
InferenceService [success-200-isvc-20f8f] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-482a1 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-482a1 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
multus |
splitter-graph-20f8f-7765c6fc54-q5zts |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-20f8f-7765c6fc54-q5zts |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:7ae24018e4b762b3a4204d7b989ec2ec72d61978201f42380712a0f4d411d8ad" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-20f8f-7765c6fc54 |
SuccessfulCreate |
Created pod: splitter-graph-20f8f-7765c6fc54-q5zts | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-20f8f |
ScalingReplicaSet |
Scaled up replica set splitter-graph-20f8f-7765c6fc54 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-20f8f |
InferenceGraphReady |
InferenceGraph [splitter-graph-20f8f] is Ready | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-20f8f-7765c6fc54-q5zts |
Created |
Created container: splitter-graph-20f8f | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-20f8f-7765c6fc54-q5zts |
Started |
Started container splitter-graph-20f8f | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-20f8f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-20f8f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-20f8f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-20f8f |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-20f8f |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-20f8f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
splitter-graph-20f8f-7765c6fc54-q5zts |
Killing |
Stopping container splitter-graph-20f8f | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-20f8f-predictor-7996fdcc9f-82nm4 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-20f8f-predictor-65795d6ffd-lqj2s |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-20f8f-predictor-7996fdcc9f-82nm4 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-20f8f-predictor-65795d6ffd-lqj2s |
Killing |
Stopping container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-20f8f-7765c6fc54-q5zts |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
switch-graph-482a1-556896489f-gxlb5 |
Killing |
Stopping container switch-graph-482a1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-482a1-predictor-747c4d74f5-fq6rz |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-482a1-predictor-747c4d74f5-fq6rz |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-482a1-predictor-686985f998-wdxbb |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-482a1-predictor-686985f998-wdxbb |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-482a1-predictor-747c4d74f5-fq6rz |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.31:8643/healthz": dial tcp 10.134.0.31:8643: connect: connection refused | |
| (x5) | kserve-ci-e2e-test |
kubelet |
switch-graph-482a1-556896489f-gxlb5 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |