| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
sequence-graph-f7bdd-7ccdd96579-trdwk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-f7bdd-7ccdd96579-trdwk to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-feffa-predictor-5cff45889-498mt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-feffa-predictor-5cff45889-498mt to ip-10-0-141-176.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-565675b447-t5g7p |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-565675b447-t5g7p to ip-10-0-141-176.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-5035e-predictor-6d8685dc6b-q4hpb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-5035e-predictor-6d8685dc6b-q4hpb to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-feffa-predictor-75cd96c4d6-tzwhk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-feffa-predictor-75cd96c4d6-tzwhk to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-f7bdd-predictor-84546c4756-jjbxj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-f7bdd-predictor-84546c4756-jjbxj to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-8d150-predictor-568b6759f8-b7rcq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-8d150-predictor-568b6759f8-b7rcq to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-5035e-5c58fb744-qcjf5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-5035e-5c58fb744-qcjf5 to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-94d25-predictor-6f676d4cb5-jjsc9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-94d25-predictor-6f676d4cb5-jjsc9 to ip-10-0-141-176.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-37fbd-576848b778-mxpf4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-37fbd-576848b778-mxpf4 to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-5649869f87-hrjlf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-5649869f87-hrjlf to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-2d7b2-5475c4b8c9-gxkpr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-2d7b2-5475c4b8c9-gxkpr to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-2d7b2-predictor-595799759b-8gwcl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-2d7b2-predictor-595799759b-8gwcl to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-8d150-predictor-5cd95d7749-hpnmb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-8d150-predictor-5cd95d7749-hpnmb to ip-10-0-141-176.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-37fbd-predictor-7544db6574-c755q |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-37fbd-predictor-7544db6574-c755q to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-1cfcc-57cb468459-llds7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-1cfcc-57cb468459-llds7 to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-8d150-55944bff46-k6lxc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-8d150-55944bff46-k6lxc to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-f7bdd-predictor-54969f468c-dq4nt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-f7bdd-predictor-54969f468c-dq4nt to ip-10-0-141-176.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-94d25-predictor-f56cbdc6b-6r59g |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-94d25-predictor-f56cbdc6b-6r59g to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-a8c3e-predictor-965fc7978-k4bn8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-a8c3e-predictor-965fc7978-k4bn8 to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-d2d70-6d98679489-grd7b |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-d2d70-6d98679489-grd7b to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-feffa-7cd874cdb5-n9vxb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-feffa-7cd874cdb5-n9vxb to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-1cfcc-predictor-655bf67bfd-prkpg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-1cfcc-predictor-655bf67bfd-prkpg to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-5035e-predictor-6cc7687ff7-sbk7s |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-5035e-predictor-6cc7687ff7-sbk7s to ip-10-0-141-176.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-37fbd-predictor-8f56b4685-mbxhd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-37fbd-predictor-8f56b4685-mbxhd to ip-10-0-141-176.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-2d7b2-predictor-5885f7c96c-tld6g |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-2d7b2-predictor-5885f7c96c-tld6g to ip-10-0-141-176.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-1cfcc-predictor-5b5dd86bb9-h48hv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-1cfcc-predictor-5b5dd86bb9-h48hv to ip-10-0-141-176.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-94d25-5664f9bbb4-v4vxx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-94d25-5664f9bbb4-v4vxx to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-669d8d6456-kk2qw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-669d8d6456-kk2qw to ip-10-0-137-177.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-a8c3e-predictor-7f68d969df-qqgdr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-a8c3e-predictor-7f68d969df-qqgdr to ip-10-0-141-176.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-d2d70-predictor-5cd95cc7dc-9qgt2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-d2d70-predictor-5cd95cc7dc-9qgt2 to ip-10-0-141-176.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-d2d70-predictor-557fcdd5cb-lmqhk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-d2d70-predictor-557fcdd5cb-lmqhk to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-a8c3e-bc877ccbf-qwvt7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-a8c3e-bc877ccbf-qwvt7 to ip-10-0-132-207.ec2.internal | ||
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-94d25-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-94d25-predictor-6f676d4cb5 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-669d8d6456 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-7c88655ddf |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-565675b447 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-7c88655ddf from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-669d8d6456 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-669d8d6456-kk2qw | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-94d25-predictor-6f676d4cb5-jjsc9 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-94d25-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-94d25-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-94d25-predictor-f56cbdc6b from 0 to 1 | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-669d8d6456-kk2qw |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-94d25-predictor-6f676d4cb5 |
SuccessfulCreate |
Created pod: success-200-isvc-94d25-predictor-6f676d4cb5-jjsc9 | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-kk2qw |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:bfc8f044ee2a84e90b7b9876040a412b44d7b121a59a5fe7b22a946b15b61519" | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-94d25-predictor-f56cbdc6b |
SuccessfulCreate |
Created pod: error-404-isvc-94d25-predictor-f56cbdc6b-6r59g | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-94d25-predictor-f56cbdc6b-6r59g |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-94d25-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
error-404-isvc-94d25-predictor-f56cbdc6b-6r59g |
AddedInterface |
Add eth0 [10.132.0.18/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-565675b447-t5g7p |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:bfc8f044ee2a84e90b7b9876040a412b44d7b121a59a5fe7b22a946b15b61519" | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-565675b447 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-565675b447-t5g7p | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-94d25-predictor-f56cbdc6b-6r59g |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1436" | |
kserve-ci-e2e-test |
multus |
success-200-isvc-94d25-predictor-6f676d4cb5-jjsc9 |
AddedInterface |
Add eth0 [10.133.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-94d25-predictor-6f676d4cb5-jjsc9 |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1436" | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-565675b447-t5g7p |
AddedInterface |
Add eth0 [10.133.0.24/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:bfc8f044ee2a84e90b7b9876040a412b44d7b121a59a5fe7b22a946b15b61519" | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 |
AddedInterface |
Add eth0 [10.132.0.17/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-kk2qw |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-kk2qw |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:bfc8f044ee2a84e90b7b9876040a412b44d7b121a59a5fe7b22a946b15b61519" in 3.537s (3.537s including waiting). Image size: 301492121 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-kk2qw |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-kk2qw |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-94d25-predictor-f56cbdc6b-6r59g |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-94d25-predictor-f56cbdc6b-6r59g |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-94d25-predictor-f56cbdc6b-6r59g |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:bfc8f044ee2a84e90b7b9876040a412b44d7b121a59a5fe7b22a946b15b61519" in 11.996s (11.996s including waiting). Image size: 301492121 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-94d25-predictor-f56cbdc6b-6r59g |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1436" in 12.746s (12.746s including waiting). Image size: 1336675422 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-565675b447-t5g7p |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-565675b447-t5g7p |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:bfc8f044ee2a84e90b7b9876040a412b44d7b121a59a5fe7b22a946b15b61519" in 13.609s (13.609s including waiting). Image size: 301492121 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-565675b447-t5g7p |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-94d25-predictor-6f676d4cb5-jjsc9 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-94d25-predictor-6f676d4cb5-jjsc9 |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1436" in 14.336s (14.336s including waiting). Image size: 1337604196 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-94d25-predictor-6f676d4cb5-jjsc9 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-94d25-predictor-6f676d4cb5-jjsc9 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-94d25-predictor-f56cbdc6b-6r59g |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-94d25-predictor-f56cbdc6b-6r59g |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-94d25-predictor-f56cbdc6b-6r59g |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.265s (2.265s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-94d25-predictor-6f676d4cb5-jjsc9 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.321s (2.321s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-94d25-predictor-6f676d4cb5-jjsc9 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-94d25-predictor-6f676d4cb5-jjsc9 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1436" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-565675b447-t5g7p |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1436" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1436" in 6.167s (6.168s including waiting). Image size: 1562812843 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-565675b447-t5g7p |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-565675b447-t5g7p |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1436" in 5.743s (5.743s including waiting). Image size: 1562812843 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-565675b447-t5g7p |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-565675b447-t5g7p |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-565675b447-t5g7p |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-565675b447-t5g7p |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-kk2qw |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-kk2qw |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-kk2qw |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-kk2qw |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 18.455s (18.455s including waiting). Image size: 1306414326 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-kk2qw |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.375s (2.375s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-kk2qw |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-kk2qw |
Created |
Created container: kube-rbac-proxy | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-94d25-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-94d25-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-94d25-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-94d25-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-94d25-predictor-f56cbdc6b-6r59g |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.18:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-94d25 |
InferenceServiceReady |
InferenceService [error-404-isvc-94d25] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-94d25 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-94d25 |
InferenceServiceReady |
InferenceService [success-200-isvc-94d25] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-94d25 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-94d25-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-94d25-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-94d25-5664f9bbb4 |
SuccessfulCreate |
Created pod: switch-graph-94d25-5664f9bbb4-v4vxx | |
kserve-ci-e2e-test |
kubelet |
switch-graph-94d25-5664f9bbb4-v4vxx |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-94d25-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-94d25 |
InferenceGraphReady |
InferenceGraph [switch-graph-94d25] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-94d25 |
ScalingReplicaSet |
Scaled up replica set switch-graph-94d25-5664f9bbb4 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
switch-graph-94d25-5664f9bbb4-v4vxx |
AddedInterface |
Add eth0 [10.132.0.19/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-94d25-5664f9bbb4-v4vxx |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:64310d078bf386870e904a5a4ca9cf4559d7cad81ce46ab7ca9a6afadbba1f7c" | |
kserve-ci-e2e-test |
kubelet |
switch-graph-94d25-5664f9bbb4-v4vxx |
Started |
Started container switch-graph-94d25 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-94d25-5664f9bbb4-v4vxx |
Created |
Created container: switch-graph-94d25 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-94d25-5664f9bbb4-v4vxx |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:64310d078bf386870e904a5a4ca9cf4559d7cad81ce46ab7ca9a6afadbba1f7c" in 2.581s (2.581s including waiting). Image size: 216346181 bytes. | |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-kk2qw |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.35:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-94d25-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-94d25-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d2d70 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-d2d70": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-d2d70": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
switch-graph-94d25-5664f9bbb4-v4vxx |
Killing |
Stopping container switch-graph-94d25 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d2d70-predictor-557fcdd5cb-lmqhk |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-d2d70-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-d2d70-predictor-557fcdd5cb |
SuccessfulCreate |
Created pod: error-404-isvc-d2d70-predictor-557fcdd5cb-lmqhk | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-d2d70-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-d2d70-predictor-557fcdd5cb from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d2d70 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-d2d70": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-d2d70": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d2d70 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-d2d70": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d2d70 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-d2d70": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-d2d70-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-d2d70-predictor-5cd95cc7dc from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-94d25-predictor-f56cbdc6b-6r59g |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-94d25-predictor-f56cbdc6b-6r59g |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-d2d70-predictor-5cd95cc7dc |
SuccessfulCreate |
Created pod: success-200-isvc-d2d70-predictor-5cd95cc7dc-9qgt2 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d2d70-predictor-5cd95cc7dc-9qgt2 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1436" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-d2d70-predictor-5cd95cc7dc-9qgt2 |
AddedInterface |
Add eth0 [10.133.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-94d25-predictor-6f676d4cb5-jjsc9 |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.23:8643/healthz": dial tcp 10.133.0.23:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-94d25-predictor-6f676d4cb5-jjsc9 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-94d25-predictor-6f676d4cb5-jjsc9 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d2d70-predictor-5cd95cc7dc-9qgt2 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d2d70-predictor-557fcdd5cb-lmqhk |
Created |
Created container: kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-94d25-predictor-6f676d4cb5-jjsc9 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.23:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d2d70-predictor-557fcdd5cb-lmqhk |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d2d70-predictor-557fcdd5cb-lmqhk |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d2d70-predictor-557fcdd5cb-lmqhk |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d2d70-predictor-557fcdd5cb-lmqhk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d2d70-predictor-5cd95cc7dc-9qgt2 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d2d70-predictor-557fcdd5cb-lmqhk |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1436" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-d2d70-predictor-557fcdd5cb-lmqhk |
AddedInterface |
Add eth0 [10.132.0.20/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d2d70-predictor-5cd95cc7dc-9qgt2 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d2d70-predictor-5cd95cc7dc-9qgt2 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d2d70-predictor-5cd95cc7dc-9qgt2 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
model-chainer-5649869f87-hrjlf |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
multus |
model-chainer-5649869f87-hrjlf |
AddedInterface |
Add eth0 [10.132.0.21/23] from ovn-kubernetes | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
kubelet |
model-chainer-5649869f87-hrjlf |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:64310d078bf386870e904a5a4ca9cf4559d7cad81ce46ab7ca9a6afadbba1f7c" already present on machine | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-94d25-5664f9bbb4-v4vxx |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
model-chainer-5649869f87-hrjlf |
Started |
Started container model-chainer | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-5649869f87 |
SuccessfulCreate |
Created pod: model-chainer-5649869f87-hrjlf | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-5649869f87 from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d2d70-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d2d70-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d2d70-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d2d70-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-565675b447-t5g7p |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f7bdd-predictor-84546c4756-jjbxj |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-f7bdd |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-f7bdd": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-f7bdd": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-f7bdd |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-f7bdd": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-f7bdd |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-f7bdd": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-f7bdd |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-f7bdd": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-f7bdd": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-kk2qw |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-kk2qw |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-565675b447-t5g7p |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f7bdd-predictor-54969f468c-dq4nt |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-f7bdd-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-f7bdd-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-f7bdd-predictor-54969f468c from 0 to 1 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-f7bdd-predictor-84546c4756-jjbxj |
AddedInterface |
Add eth0 [10.132.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f7bdd-predictor-84546c4756-jjbxj |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1436" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f7bdd-predictor-84546c4756-jjbxj |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f7bdd-predictor-84546c4756-jjbxj |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
model-chainer-5649869f87-hrjlf |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-f7bdd-predictor-54969f468c |
SuccessfulCreate |
Created pod: success-200-isvc-f7bdd-predictor-54969f468c-dq4nt | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-f7bdd-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-f7bdd-predictor-84546c4756 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-f7bdd-predictor-84546c4756 |
SuccessfulCreate |
Created pod: error-404-isvc-f7bdd-predictor-84546c4756-jjbxj | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f7bdd-predictor-54969f468c-dq4nt |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f7bdd-predictor-54969f468c-dq4nt |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f7bdd-predictor-54969f468c-dq4nt |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1436" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f7bdd-predictor-84546c4756-jjbxj |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f7bdd-predictor-54969f468c-dq4nt |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f7bdd-predictor-54969f468c-dq4nt |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f7bdd-predictor-54969f468c-dq4nt |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f7bdd-predictor-84546c4756-jjbxj |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-f7bdd-predictor-54969f468c-dq4nt |
AddedInterface |
Add eth0 [10.133.0.26/23] from ovn-kubernetes | |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.17:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-kk2qw |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.35:8643/healthz": dial tcp 10.134.0.35:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-7c88655ddf-p6px8 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.17:8643/healthz": dial tcp 10.132.0.17:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-d2d70-predictor-557fcdd5cb-lmqhk |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.20:8080: connect: connection refused |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-565675b447-t5g7p |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.24:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-565675b447-t5g7p |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.24:8643/healthz": dial tcp 10.133.0.24:8643: connect: connection refused | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d2d70 |
InferenceServiceReady |
InferenceService [success-200-isvc-d2d70] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d2d70 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d2d70 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d2d70 |
InferenceServiceReady |
InferenceService [error-404-isvc-d2d70] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d2d70-6d98679489-grd7b |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-d2d70-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-d2d70-6d98679489 |
SuccessfulCreate |
Created pod: switch-graph-d2d70-6d98679489-grd7b | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-d2d70 |
ScalingReplicaSet |
Scaled up replica set switch-graph-d2d70-6d98679489 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-d2d70 |
InferenceGraphReady |
InferenceGraph [switch-graph-d2d70] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d2d70-6d98679489-grd7b |
Started |
Started container switch-graph-d2d70 | |
kserve-ci-e2e-test |
multus |
switch-graph-d2d70-6d98679489-grd7b |
AddedInterface |
Add eth0 [10.132.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d2d70-6d98679489-grd7b |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:64310d078bf386870e904a5a4ca9cf4559d7cad81ce46ab7ca9a6afadbba1f7c" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d2d70-6d98679489-grd7b |
Created |
Created container: switch-graph-d2d70 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-5649869f87-hrjlf |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-f7bdd-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-f7bdd-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-f7bdd-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-f7bdd-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-f7bdd-predictor-84546c4756-jjbxj |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.22:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d2d70-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d2d70-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-d2d70 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-f7bdd-predictor-54969f468c-dq4nt |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.26:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d2d70-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-d2d70 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d2d70-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-f7bdd |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-f7bdd |
InferenceServiceReady |
InferenceService [error-404-isvc-f7bdd] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-f7bdd |
InferenceServiceReady |
InferenceService [success-200-isvc-f7bdd] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-f7bdd |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-d2d70 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-d2d70 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-f7bdd |
ScalingReplicaSet |
Scaled up replica set sequence-graph-f7bdd-7ccdd96579 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-f7bdd-7ccdd96579 |
SuccessfulCreate |
Created pod: sequence-graph-f7bdd-7ccdd96579-trdwk | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-f7bdd-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
sequence-graph-f7bdd-7ccdd96579-trdwk |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-f7bdd-serving-cert" not found | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-f7bdd-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-f7bdd |
InferenceGraphReady |
InferenceGraph [sequence-graph-f7bdd] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-f7bdd-7ccdd96579-trdwk |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:64310d078bf386870e904a5a4ca9cf4559d7cad81ce46ab7ca9a6afadbba1f7c" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-f7bdd-7ccdd96579-trdwk |
AddedInterface |
Add eth0 [10.132.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-f7bdd-7ccdd96579-trdwk |
Started |
Started container sequence-graph-f7bdd | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-f7bdd-7ccdd96579-trdwk |
Created |
Created container: sequence-graph-f7bdd | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-f7bdd-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-f7bdd-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-f7bdd |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-f7bdd |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-2d7b2-predictor-5885f7c96c |
SuccessfulCreate |
Created pod: success-200-isvc-2d7b2-predictor-5885f7c96c-tld6g | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-2d7b2 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-2d7b2": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-2d7b2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-2d7b2 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-2d7b2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-2d7b2-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-2d7b2-predictor-5885f7c96c from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2d7b2-predictor-5885f7c96c-tld6g |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-2d7b2-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-2d7b2-predictor-595799759b |
SuccessfulCreate |
Created pod: error-404-isvc-2d7b2-predictor-595799759b-8gwcl | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-2d7b2-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-2d7b2-predictor-595799759b from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-2d7b2 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-2d7b2": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-2d7b2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-2d7b2 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-2d7b2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d2d70-6d98679489-grd7b |
Killing |
Stopping container switch-graph-d2d70 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d2d70-predictor-5cd95cc7dc-9qgt2 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d2d70-predictor-5cd95cc7dc-9qgt2 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d2d70-predictor-557fcdd5cb-lmqhk |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d2d70-predictor-557fcdd5cb-lmqhk |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2d7b2-predictor-5885f7c96c-tld6g |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2d7b2-predictor-595799759b-8gwcl |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1436" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-2d7b2-predictor-595799759b-8gwcl |
AddedInterface |
Add eth0 [10.132.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2d7b2-predictor-5885f7c96c-tld6g |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2d7b2-predictor-5885f7c96c-tld6g |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2d7b2-predictor-5885f7c96c-tld6g |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2d7b2-predictor-5885f7c96c-tld6g |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2d7b2-predictor-5885f7c96c-tld6g |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1436" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-2d7b2-predictor-5885f7c96c-tld6g |
AddedInterface |
Add eth0 [10.133.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2d7b2-predictor-595799759b-8gwcl |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2d7b2-predictor-595799759b-8gwcl |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2d7b2-predictor-595799759b-8gwcl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2d7b2-predictor-595799759b-8gwcl |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2d7b2-predictor-595799759b-8gwcl |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d2d70-predictor-5cd95cc7dc-9qgt2 |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.25:8643/healthz": dial tcp 10.133.0.25:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-d2d70-predictor-5cd95cc7dc-9qgt2 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.25:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-d2d70-6d98679489-grd7b |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-2d7b2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-2d7b2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1cfcc |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-1cfcc": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1cfcc |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-1cfcc": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1cfcc-predictor-655bf67bfd-prkpg |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1cfcc-predictor-655bf67bfd-prkpg |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1cfcc-predictor-655bf67bfd-prkpg |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1cfcc-predictor-5b5dd86bb9-h48hv |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-1cfcc-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-1cfcc-predictor-655bf67bfd |
SuccessfulCreate |
Created pod: error-404-isvc-1cfcc-predictor-655bf67bfd-prkpg | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-1cfcc-predictor-5b5dd86bb9 |
SuccessfulCreate |
Created pod: success-200-isvc-1cfcc-predictor-5b5dd86bb9-h48hv | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-1cfcc-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-1cfcc-predictor-655bf67bfd from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-1cfcc-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-1cfcc-predictor-5b5dd86bb9 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1cfcc |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-1cfcc": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-1cfcc": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1cfcc-predictor-655bf67bfd-prkpg |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1cfcc-predictor-655bf67bfd-prkpg |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f7bdd-predictor-84546c4756-jjbxj |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-f7bdd-predictor-84546c4756-jjbxj |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-f7bdd-7ccdd96579-trdwk |
Killing |
Stopping container sequence-graph-f7bdd | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f7bdd-predictor-54969f468c-dq4nt |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1cfcc-predictor-655bf67bfd-prkpg |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1436" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-f7bdd-predictor-54969f468c-dq4nt |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-1cfcc-predictor-655bf67bfd-prkpg |
AddedInterface |
Add eth0 [10.132.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1cfcc |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-1cfcc": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-1cfcc": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1cfcc-predictor-5b5dd86bb9-h48hv |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1cfcc-predictor-5b5dd86bb9-h48hv |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1cfcc-predictor-5b5dd86bb9-h48hv |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-1cfcc-predictor-5b5dd86bb9-h48hv |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1cfcc-predictor-5b5dd86bb9-h48hv |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1cfcc-predictor-5b5dd86bb9-h48hv |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1436" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1cfcc-predictor-5b5dd86bb9-h48hv |
Created |
Created container: kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-2d7b2-predictor-595799759b-8gwcl |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.25:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-2d7b2-predictor-5885f7c96c-tld6g |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.27:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-2d7b2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-2d7b2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-2d7b2 |
InferenceServiceReady |
InferenceService [success-200-isvc-2d7b2] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-2d7b2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-2d7b2 |
InferenceServiceReady |
InferenceService [error-404-isvc-2d7b2] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-2d7b2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1cfcc-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1cfcc-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-2d7b2 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-2d7b2] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-2d7b2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-2d7b2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-2d7b2 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-2d7b2-5475c4b8c9 from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-2d7b2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-2d7b2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-2d7b2-5475c4b8c9 |
SuccessfulCreate |
Created pod: ensemble-graph-2d7b2-5475c4b8c9-gxkpr | |
kserve-ci-e2e-test |
multus |
ensemble-graph-2d7b2-5475c4b8c9-gxkpr |
AddedInterface |
Add eth0 [10.132.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-2d7b2-5475c4b8c9-gxkpr |
Started |
Started container ensemble-graph-2d7b2 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-2d7b2-5475c4b8c9-gxkpr |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:64310d078bf386870e904a5a4ca9cf4559d7cad81ce46ab7ca9a6afadbba1f7c" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-2d7b2-5475c4b8c9-gxkpr |
Created |
Created container: ensemble-graph-2d7b2 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-f7bdd-7ccdd96579-trdwk |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2d7b2-predictor-595799759b-8gwcl |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-37fbd-predictor-8f56b4685 |
SuccessfulCreate |
Created pod: success-200-isvc-37fbd-predictor-8f56b4685-mbxhd | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-37fbd |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-37fbd": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-37fbd": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-37fbd |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-37fbd": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-37fbd |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-37fbd": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-37fbd |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-37fbd": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-37fbd": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-37fbd-predictor-7544db6574 |
SuccessfulCreate |
Created pod: error-404-isvc-37fbd-predictor-7544db6574-c755q | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-37fbd-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-37fbd-predictor-8f56b4685 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-2d7b2-5475c4b8c9-gxkpr |
Killing |
Stopping container ensemble-graph-2d7b2 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-37fbd-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-37fbd-predictor-7544db6574 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2d7b2-predictor-595799759b-8gwcl |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2d7b2-predictor-5885f7c96c-tld6g |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2d7b2-predictor-5885f7c96c-tld6g |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-37fbd-predictor-7544db6574-c755q |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-37fbd-predictor-8f56b4685-mbxhd |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-37fbd-predictor-7544db6574-c755q |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-37fbd-predictor-8f56b4685-mbxhd |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1436" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-37fbd-predictor-7544db6574-c755q |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-37fbd-predictor-8f56b4685-mbxhd |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-37fbd-predictor-8f56b4685-mbxhd |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-37fbd-predictor-7544db6574-c755q |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1436" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-37fbd-predictor-7544db6574-c755q |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-37fbd-predictor-7544db6574-c755q |
AddedInterface |
Add eth0 [10.132.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-37fbd-predictor-8f56b4685-mbxhd |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-37fbd-predictor-7544db6574-c755q |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-37fbd-predictor-8f56b4685-mbxhd |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-37fbd-predictor-8f56b4685-mbxhd |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-2d7b2-predictor-5885f7c96c-tld6g |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.27:8643/healthz": dial tcp 10.133.0.27:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-2d7b2-predictor-595799759b-8gwcl |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.25:8643/healthz": dial tcp 10.132.0.25:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-1cfcc-predictor-655bf67bfd-prkpg |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.26:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-1cfcc-predictor-5b5dd86bb9-h48hv |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.28:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1cfcc-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1cfcc-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1cfcc |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1cfcc |
InferenceServiceReady |
InferenceService [error-404-isvc-1cfcc] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1cfcc |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-37fbd-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-37fbd-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1cfcc |
InferenceServiceReady |
InferenceService [success-200-isvc-1cfcc] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-1cfcc-57cb468459-llds7 |
Started |
Started container sequence-graph-1cfcc | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-1cfcc-57cb468459 |
SuccessfulCreate |
Created pod: sequence-graph-1cfcc-57cb468459-llds7 | |
kserve-ci-e2e-test |
multus |
sequence-graph-1cfcc-57cb468459-llds7 |
AddedInterface |
Add eth0 [10.132.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-1cfcc-57cb468459-llds7 |
Created |
Created container: sequence-graph-1cfcc | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-1cfcc-57cb468459-llds7 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:64310d078bf386870e904a5a4ca9cf4559d7cad81ce46ab7ca9a6afadbba1f7c" already present on machine | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-1cfcc |
InferenceGraphReady |
InferenceGraph [sequence-graph-1cfcc] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-1cfcc |
ScalingReplicaSet |
Scaled up replica set sequence-graph-1cfcc-57cb468459 from 0 to 1 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1cfcc-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1cfcc-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1cfcc-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1cfcc-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-2d7b2-5475c4b8c9-gxkpr |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-37fbd-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-37fbd-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1cfcc-predictor-5b5dd86bb9-h48hv |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1cfcc-predictor-5b5dd86bb9-h48hv |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d150-predictor-568b6759f8-b7rcq |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-8d150-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-8d150-predictor-5cd95d7749 |
SuccessfulCreate |
Created pod: success-200-isvc-8d150-predictor-5cd95d7749-hpnmb | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1cfcc-predictor-655bf67bfd-prkpg |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8d150 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-8d150": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-8d150": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-1cfcc-57cb468459-llds7 |
Killing |
Stopping container sequence-graph-1cfcc | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-8d150-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-8d150-predictor-5cd95d7749 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8d150 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-8d150": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d150-predictor-5cd95d7749-hpnmb |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-8d150-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8d150 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-8d150": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-8d150": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8d150 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-8d150": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1cfcc-predictor-655bf67bfd-prkpg |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-8d150-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-8d150-predictor-568b6759f8 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-8d150-predictor-568b6759f8 |
SuccessfulCreate |
Created pod: error-404-isvc-8d150-predictor-568b6759f8-b7rcq | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d150-predictor-568b6759f8-b7rcq |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d150-predictor-5cd95d7749-hpnmb |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d150-predictor-568b6759f8-b7rcq |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d150-predictor-568b6759f8-b7rcq |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d150-predictor-568b6759f8-b7rcq |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d150-predictor-5cd95d7749-hpnmb |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d150-predictor-5cd95d7749-hpnmb |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d150-predictor-5cd95d7749-hpnmb |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d150-predictor-568b6759f8-b7rcq |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1436" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d150-predictor-5cd95d7749-hpnmb |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-8d150-predictor-568b6759f8-b7rcq |
AddedInterface |
Add eth0 [10.132.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d150-predictor-5cd95d7749-hpnmb |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1436" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-8d150-predictor-5cd95d7749-hpnmb |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d150-predictor-568b6759f8-b7rcq |
Created |
Created container: kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-37fbd-predictor-7544db6574-c755q |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.28:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-37fbd-predictor-8f56b4685-mbxhd |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.29:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1cfcc-predictor-655bf67bfd-prkpg |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.26:8643/healthz": dial tcp 10.132.0.26:8643: connect: connection refused | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-37fbd |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-37fbd |
InferenceServiceReady |
InferenceService [success-200-isvc-37fbd] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-37fbd |
InferenceServiceReady |
InferenceService [error-404-isvc-37fbd] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-37fbd |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-37fbd-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-37fbd |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-37fbd-576848b778 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-37fbd |
InferenceGraphReady |
InferenceGraph [ensemble-graph-37fbd] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-37fbd-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-37fbd-576848b778 |
SuccessfulCreate |
Created pod: ensemble-graph-37fbd-576848b778-mxpf4 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-37fbd-576848b778-mxpf4 |
Created |
Created container: ensemble-graph-37fbd | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-37fbd-576848b778-mxpf4 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:64310d078bf386870e904a5a4ca9cf4559d7cad81ce46ab7ca9a6afadbba1f7c" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-37fbd-576848b778-mxpf4 |
Started |
Started container ensemble-graph-37fbd | |
kserve-ci-e2e-test |
multus |
ensemble-graph-37fbd-576848b778-mxpf4 |
AddedInterface |
Add eth0 [10.132.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-37fbd-576848b778-mxpf4 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-37fbd-serving-cert" not found | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-1cfcc-57cb468459-llds7 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8d150-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8d150-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d150-predictor-568b6759f8-b7rcq |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.30:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-37fbd-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-37fbd-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8d150-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8d150-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8d150 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8d150 |
InferenceServiceReady |
InferenceService [success-200-isvc-8d150] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8d150 |
InferenceServiceReady |
InferenceService [error-404-isvc-8d150] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8d150 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-37fbd |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-37fbd |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
sequence-graph-8d150-55944bff46-k6lxc |
AddedInterface |
Add eth0 [10.132.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-8d150-55944bff46 |
SuccessfulCreate |
Created pod: sequence-graph-8d150-55944bff46-k6lxc | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-8d150 |
InferenceGraphReady |
InferenceGraph [sequence-graph-8d150] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-8d150 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-8d150-55944bff46 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8d150-55944bff46-k6lxc |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:64310d078bf386870e904a5a4ca9cf4559d7cad81ce46ab7ca9a6afadbba1f7c" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8d150-55944bff46-k6lxc |
Created |
Created container: sequence-graph-8d150 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8d150-55944bff46-k6lxc |
Started |
Started container sequence-graph-8d150 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8d150-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8d150-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8d150-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8d150-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-8d150 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-8d150 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-5035e |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-5035e": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-5035e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-5035e |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-5035e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-37fbd-576848b778-mxpf4 |
Killing |
Stopping container ensemble-graph-37fbd | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-5035e-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-5035e-predictor-6d8685dc6b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-37fbd-predictor-7544db6574-c755q |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-37fbd-predictor-7544db6574-c755q |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-37fbd-predictor-8f56b4685-mbxhd |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-5035e-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-5035e-predictor-6cc7687ff7 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-5035e-predictor-6cc7687ff7 |
SuccessfulCreate |
Created pod: success-200-isvc-5035e-predictor-6cc7687ff7-sbk7s | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-37fbd-predictor-8f56b4685-mbxhd |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-5035e-predictor-6d8685dc6b |
SuccessfulCreate |
Created pod: error-404-isvc-5035e-predictor-6d8685dc6b-q4hpb | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-5035e |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-5035e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-5035e |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-5035e": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-5035e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5035e-predictor-6cc7687ff7-sbk7s |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5035e-predictor-6cc7687ff7-sbk7s |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5035e-predictor-6d8685dc6b-q4hpb |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5035e-predictor-6cc7687ff7-sbk7s |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5035e-predictor-6cc7687ff7-sbk7s |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1436" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-5035e-predictor-6cc7687ff7-sbk7s |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5035e-predictor-6cc7687ff7-sbk7s |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5035e-predictor-6d8685dc6b-q4hpb |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5035e-predictor-6d8685dc6b-q4hpb |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5035e-predictor-6cc7687ff7-sbk7s |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5035e-predictor-6d8685dc6b-q4hpb |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5035e-predictor-6d8685dc6b-q4hpb |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1436" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-5035e-predictor-6d8685dc6b-q4hpb |
AddedInterface |
Add eth0 [10.132.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5035e-predictor-6d8685dc6b-q4hpb |
Created |
Created container: kube-rbac-proxy | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-37fbd-576848b778-mxpf4 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5035e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5035e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5035e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5035e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d150-predictor-5cd95d7749-hpnmb |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-feffa-predictor-5cff45889-498mt |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1436" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d150-predictor-5cd95d7749-hpnmb |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d150-predictor-568b6759f8-b7rcq |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8d150-55944bff46-k6lxc |
Killing |
Stopping container sequence-graph-8d150 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-feffa |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-feffa": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-feffa |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-feffa": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-feffa": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-feffa-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-feffa-predictor-75cd96c4d6 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-feffa |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-feffa": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-feffa |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-feffa": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-feffa": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-feffa-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-feffa-predictor-5cff45889 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-feffa-predictor-75cd96c4d6 |
SuccessfulCreate |
Created pod: error-404-isvc-feffa-predictor-75cd96c4d6-tzwhk | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-feffa-predictor-5cff45889 |
SuccessfulCreate |
Created pod: success-200-isvc-feffa-predictor-5cff45889-498mt | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d150-predictor-568b6759f8-b7rcq |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-feffa-predictor-5cff45889-498mt |
AddedInterface |
Add eth0 [10.133.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-feffa-predictor-5cff45889-498mt |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-feffa-predictor-5cff45889-498mt |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-feffa-predictor-5cff45889-498mt |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-feffa-predictor-75cd96c4d6-tzwhk |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1436" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-feffa-predictor-5cff45889-498mt |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-feffa-predictor-75cd96c4d6-tzwhk |
AddedInterface |
Add eth0 [10.132.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-feffa-predictor-5cff45889-498mt |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-feffa-predictor-75cd96c4d6-tzwhk |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-feffa-predictor-75cd96c4d6-tzwhk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-feffa-predictor-75cd96c4d6-tzwhk |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-feffa-predictor-75cd96c4d6-tzwhk |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-feffa-predictor-75cd96c4d6-tzwhk |
Started |
Started container kube-rbac-proxy | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-5035e-predictor-6cc7687ff7-sbk7s |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.31:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-5035e-predictor-6d8685dc6b-q4hpb |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.33:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d150-predictor-5cd95d7749-hpnmb |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.30:8643/healthz": dial tcp 10.133.0.30:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d150-predictor-5cd95d7749-hpnmb |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.30:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-5035e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-5035e |
InferenceServiceReady |
InferenceService [error-404-isvc-5035e] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-5035e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-5035e |
InferenceServiceReady |
InferenceService [success-200-isvc-5035e] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5035e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-5035e |
InferenceGraphReady |
InferenceGraph [splitter-graph-5035e] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-5035e |
ScalingReplicaSet |
Scaled up replica set splitter-graph-5035e-5c58fb744 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-5035e-5c58fb744 |
SuccessfulCreate |
Created pod: splitter-graph-5035e-5c58fb744-qcjf5 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5035e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5035e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5035e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
multus |
splitter-graph-5035e-5c58fb744-qcjf5 |
AddedInterface |
Add eth0 [10.132.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-5035e-5c58fb744-qcjf5 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-5035e-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-5035e-5c58fb744-qcjf5 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:64310d078bf386870e904a5a4ca9cf4559d7cad81ce46ab7ca9a6afadbba1f7c" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-5035e-5c58fb744-qcjf5 |
Created |
Created container: splitter-graph-5035e | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-5035e-5c58fb744-qcjf5 |
Started |
Started container splitter-graph-5035e | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-8d150-55944bff46-k6lxc |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-feffa-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-feffa-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-a8c3e-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-a8c3e-predictor-7f68d969df from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-5035e-5c58fb744-qcjf5 |
Killing |
Stopping container splitter-graph-5035e | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a8c3e |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-a8c3e": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-a8c3e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a8c3e |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-a8c3e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5035e-predictor-6cc7687ff7-sbk7s |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5035e-predictor-6cc7687ff7-sbk7s |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5035e-predictor-6d8685dc6b-q4hpb |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5035e-predictor-6d8685dc6b-q4hpb |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-a8c3e-predictor-965fc7978-k4bn8 |
AddedInterface |
Add eth0 [10.132.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a8c3e-predictor-965fc7978-k4bn8 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a8c3e |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-a8c3e": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-a8c3e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a8c3e |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-a8c3e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a8c3e-predictor-965fc7978-k4bn8 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a8c3e-predictor-7f68d969df-qqgdr |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-a8c3e-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-a8c3e-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-a8c3e-predictor-965fc7978 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-a8c3e-predictor-965fc7978 |
SuccessfulCreate |
Created pod: error-404-isvc-a8c3e-predictor-965fc7978-k4bn8 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a8c3e-predictor-965fc7978-k4bn8 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a8c3e-predictor-965fc7978-k4bn8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a8c3e-predictor-965fc7978-k4bn8 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1436" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a8c3e-predictor-965fc7978-k4bn8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-a8c3e-predictor-7f68d969df |
SuccessfulCreate |
Created pod: success-200-isvc-a8c3e-predictor-7f68d969df-qqgdr | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a8c3e-predictor-7f68d969df-qqgdr |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-a8c3e-predictor-7f68d969df-qqgdr |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a8c3e-predictor-7f68d969df-qqgdr |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a8c3e-predictor-7f68d969df-qqgdr |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a8c3e-predictor-7f68d969df-qqgdr |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a8c3e-predictor-7f68d969df-qqgdr |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1436" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a8c3e-predictor-7f68d969df-qqgdr |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5035e-predictor-6d8685dc6b-q4hpb |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.33:8643/healthz": dial tcp 10.132.0.33:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5035e-predictor-6cc7687ff7-sbk7s |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.31:8643/healthz": dial tcp 10.133.0.31:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-feffa-predictor-75cd96c4d6-tzwhk |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.34:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-feffa-predictor-5cff45889-498mt |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.32:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-feffa-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-feffa-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-feffa |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-feffa |
InferenceServiceReady |
InferenceService [success-200-isvc-feffa] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-feffa |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-feffa |
InferenceServiceReady |
InferenceService [error-404-isvc-feffa] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-feffa-7cd874cdb5-n9vxb |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-feffa-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-feffa-7cd874cdb5 |
SuccessfulCreate |
Created pod: switch-graph-feffa-7cd874cdb5-n9vxb | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-feffa |
ScalingReplicaSet |
Scaled up replica set switch-graph-feffa-7cd874cdb5 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-feffa |
InferenceGraphReady |
InferenceGraph [switch-graph-feffa] is Ready | |
kserve-ci-e2e-test |
multus |
switch-graph-feffa-7cd874cdb5-n9vxb |
AddedInterface |
Add eth0 [10.132.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-feffa-7cd874cdb5-n9vxb |
Created |
Created container: switch-graph-feffa | |
kserve-ci-e2e-test |
kubelet |
switch-graph-feffa-7cd874cdb5-n9vxb |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:64310d078bf386870e904a5a4ca9cf4559d7cad81ce46ab7ca9a6afadbba1f7c" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-feffa-7cd874cdb5-n9vxb |
Started |
Started container switch-graph-feffa | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-5035e-5c58fb744-qcjf5 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a8c3e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a8c3e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a8c3e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a8c3e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-a8c3e-predictor-965fc7978-k4bn8 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.36:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-a8c3e-predictor-7f68d969df-qqgdr |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.33:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-feffa-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-feffa-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-feffa-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-feffa-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a8c3e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a8c3e |
InferenceServiceReady |
InferenceService [error-404-isvc-a8c3e] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a8c3e |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a8c3e |
InferenceServiceReady |
InferenceService [success-200-isvc-a8c3e] is Ready | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-a8c3e |
UpdateFailed |
Failed to update status for InferenceGraph "splitter-graph-a8c3e": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "splitter-graph-a8c3e": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-a8c3e |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "splitter-graph-a8c3e": the object has been modified; please apply your changes to the latest version and try again | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a8c3e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a8c3e-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a8c3e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a8c3e-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-a8c3e |
InferenceGraphReady |
InferenceGraph [splitter-graph-a8c3e] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-a8c3e |
ScalingReplicaSet |
Scaled up replica set splitter-graph-a8c3e-bc877ccbf from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-a8c3e-bc877ccbf |
SuccessfulCreate |
Created pod: splitter-graph-a8c3e-bc877ccbf-qwvt7 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-a8c3e-bc877ccbf-qwvt7 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-a8c3e-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-a8c3e-bc877ccbf-qwvt7 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:64310d078bf386870e904a5a4ca9cf4559d7cad81ce46ab7ca9a6afadbba1f7c" already present on machine | |
kserve-ci-e2e-test |
multus |
splitter-graph-a8c3e-bc877ccbf-qwvt7 |
AddedInterface |
Add eth0 [10.132.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-a8c3e-bc877ccbf-qwvt7 |
Created |
Created container: splitter-graph-a8c3e | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-a8c3e-bc877ccbf-qwvt7 |
Started |
Started container splitter-graph-a8c3e | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-feffa |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-feffa |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-a8c3e |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-a8c3e |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
splitter-graph-a8c3e-bc877ccbf-qwvt7 |
Killing |
Stopping container splitter-graph-a8c3e | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a8c3e-predictor-965fc7978-k4bn8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a8c3e-predictor-965fc7978-k4bn8 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a8c3e-predictor-7f68d969df-qqgdr |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a8c3e-predictor-7f68d969df-qqgdr |
Killing |
Stopping container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-a8c3e-bc877ccbf-qwvt7 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
switch-graph-feffa-7cd874cdb5-n9vxb |
Killing |
Stopping container switch-graph-feffa | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-feffa-predictor-5cff45889-498mt |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-feffa-predictor-5cff45889-498mt |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-feffa-predictor-75cd96c4d6-tzwhk |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-feffa-predictor-75cd96c4d6-tzwhk |
Killing |
Stopping container kserve-container | |
| (x5) | kserve-ci-e2e-test |
kubelet |
switch-graph-feffa-7cd874cdb5-n9vxb |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |