| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
error-404-isvc-0dcf6-predictor-5d98597747-kxs58 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-0dcf6-predictor-5d98597747-kxs58 to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-9d702-predictor-5967c4d597-nkqp8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-9d702-predictor-5967c4d597-nkqp8 to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-8eede-predictor-5d489c9599-98jkr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-8eede-predictor-5d489c9599-98jkr to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-0dcf6-predictor-5f6f74f858-hls48 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-0dcf6-predictor-5f6f74f858-hls48 to ip-10-0-135-40.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-76bc4cf9d7-2h22s |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-76bc4cf9d7-2h22s to ip-10-0-135-40.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-85bfa-predictor-74c5d488b8-xfmfg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-85bfa-predictor-74c5d488b8-xfmfg to ip-10-0-135-40.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-8649f-predictor-86d8f8bc54-9q6dr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-8649f-predictor-86d8f8bc54-9q6dr to ip-10-0-135-40.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-d46ec-predictor-7dbc68c665-9zjhq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-d46ec-predictor-7dbc68c665-9zjhq to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-0dcf6-84fd5d8669-w4s5w |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-0dcf6-84fd5d8669-w4s5w to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-8eede-bdd8448d-m85hx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-8eede-bdd8448d-m85hx to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-8649f-fc945575-t7558 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-8649f-fc945575-t7558 to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-9d702-6849cf5859-m6bk5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-9d702-6849cf5859-m6bk5 to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-e7d45-predictor-bfcffd599-ntx59 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-e7d45-predictor-bfcffd599-ntx59 to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-d46ec-7f8c97c56d-rqgm4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-d46ec-7f8c97c56d-rqgm4 to ip-10-0-135-40.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-85bfa-7886b55cbc-fnw2h |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-85bfa-7886b55cbc-fnw2h to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-081d8-66964d46f7-ghmwg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-081d8-66964d46f7-ghmwg to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-e7d45-7d4894f44c-9lvpm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-e7d45-7d4894f44c-9lvpm to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-8eede-predictor-757747b4bb-fm7b8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-8eede-predictor-757747b4bb-fm7b8 to ip-10-0-135-40.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-9d702-predictor-84c754796-qj7zl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-9d702-predictor-84c754796-qj7zl to ip-10-0-135-40.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-d46ec-predictor-54ff8f5568-kj6n7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-d46ec-predictor-54ff8f5568-kj6n7 to ip-10-0-135-40.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-8592d-predictor-94446b57c-nnlbx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-8592d-predictor-94446b57c-nnlbx to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-8592d-predictor-b4d845d84-vrdmm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-8592d-predictor-b4d845d84-vrdmm to ip-10-0-135-40.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-081d8-predictor-6b56b68db-qlfsp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-081d8-predictor-6b56b68db-qlfsp to ip-10-0-135-40.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-081d8-predictor-7f479c548c-h2qk4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-081d8-predictor-7f479c548c-h2qk4 to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-de19c-predictor-548b8d5b44-6g7k2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-de19c-predictor-548b8d5b44-6g7k2 to ip-10-0-135-40.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-e7d45-predictor-685f9d9bbb-mm5ss |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-e7d45-predictor-685f9d9bbb-mm5ss to ip-10-0-135-40.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-de19c-predictor-d5c8fcc89-47k8v |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-de19c-predictor-d5c8fcc89-47k8v to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-85bfa-predictor-5d4d479565-4dlks |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-85bfa-predictor-5d4d479565-4dlks to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-de19c-847bdf9fb9-z5b2d |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-de19c-847bdf9fb9-z5b2d to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-8592d-688fc594f9-lcxv9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-8592d-688fc594f9-lcxv9 to ip-10-0-135-40.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-555fc69d56-xzhr5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-xzhr5 to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-8649f-predictor-f69888d4c-dvxpd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-8649f-predictor-f69888d4c-dvxpd to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 to ip-10-0-139-237.ec2.internal | ||
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-d46ec-predictor-54ff8f5568 |
SuccessfulCreate |
Created pod: success-200-isvc-d46ec-predictor-54ff8f5568-kj6n7 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-d46ec-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-d46ec-predictor-7dbc68c665 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d46ec-predictor-7dbc68c665-9zjhq |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-d46ec-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-555fc69d56 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-555fc69d56 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-555fc69d56-xzhr5 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-d46ec-predictor-7dbc68c665 |
SuccessfulCreate |
Created pod: error-404-isvc-d46ec-predictor-7dbc68c665-9zjhq | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-d46ec-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-d46ec-predictor-54ff8f5568 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-74fc5cfbf9 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-74fc5cfbf9 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-xzhr5 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-xgboost-graph-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-76857dd9b4 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:4352771c5cb4ba9624a857ef32395dc1abbb2576e467cd6caf52080736c17239" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-sklearn-graph-2-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
success-200-isvc-d46ec-predictor-54ff8f5568-kj6n7 |
AddedInterface |
Add eth0 [10.133.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d46ec-predictor-54ff8f5568-kj6n7 |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1970" | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-76857dd9b4 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x |
AddedInterface |
Add eth0 [10.134.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
error-404-isvc-d46ec-predictor-7dbc68c665-9zjhq |
AddedInterface |
Add eth0 [10.134.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d46ec-predictor-7dbc68c665-9zjhq |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1970" | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-555fc69d56-xzhr5 |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-xzhr5 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:4352771c5cb4ba9624a857ef32395dc1abbb2576e467cd6caf52080736c17239" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-xzhr5 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-xzhr5 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:4352771c5cb4ba9624a857ef32395dc1abbb2576e467cd6caf52080736c17239" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1970" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1970" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-xzhr5 |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d46ec-predictor-54ff8f5568-kj6n7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d46ec-predictor-54ff8f5568-kj6n7 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d46ec-predictor-54ff8f5568-kj6n7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d46ec-predictor-54ff8f5568-kj6n7 |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1970" in 11.934s (11.934s including waiting). Image size: 1356815952 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d46ec-predictor-54ff8f5568-kj6n7 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.247s (2.247s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d46ec-predictor-54ff8f5568-kj6n7 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d46ec-predictor-54ff8f5568-kj6n7 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d46ec-predictor-7dbc68c665-9zjhq |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d46ec-predictor-7dbc68c665-9zjhq |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d46ec-predictor-7dbc68c665-9zjhq |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1970" in 16.905s (16.905s including waiting). Image size: 1355757128 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1970" in 12.577s (12.577s including waiting). Image size: 1580899218 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d46ec-predictor-7dbc68c665-9zjhq |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1970" in 11.482s (11.482s including waiting). Image size: 1580899218 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 4.794s (4.794s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 4.652s (4.652s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d46ec-predictor-7dbc68c665-9zjhq |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 4.963s (4.963s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d46ec-predictor-7dbc68c665-9zjhq |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d46ec-predictor-7dbc68c665-9zjhq |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-xzhr5 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-xzhr5 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-xzhr5 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-xzhr5 |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 34.002s (34.002s including waiting). Image size: 1435742979 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-xzhr5 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-xzhr5 |
Started |
Started container kube-rbac-proxy | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d46ec-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d46ec-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d46ec-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d46ec-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d46ec |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d46ec |
InferenceServiceReady |
InferenceService [success-200-isvc-d46ec] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d46ec |
InferenceServiceReady |
InferenceService [error-404-isvc-d46ec] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d46ec |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d46ec-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d46ec-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d46ec-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d46ec-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
switch-graph-d46ec-7f8c97c56d-rqgm4 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-d46ec-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-d46ec |
InferenceGraphReady |
InferenceGraph [switch-graph-d46ec] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-d46ec |
ScalingReplicaSet |
Scaled up replica set switch-graph-d46ec-7f8c97c56d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-d46ec-7f8c97c56d |
SuccessfulCreate |
Created pod: switch-graph-d46ec-7f8c97c56d-rqgm4 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d46ec-7f8c97c56d-rqgm4 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:bb50e7052755d34993c754ebb5475c57cbe2445f423ca013a14a621d1f8fda77" | |
kserve-ci-e2e-test |
multus |
switch-graph-d46ec-7f8c97c56d-rqgm4 |
AddedInterface |
Add eth0 [10.133.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d46ec-7f8c97c56d-rqgm4 |
Started |
Started container switch-graph-d46ec | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d46ec-7f8c97c56d-rqgm4 |
Created |
Created container: switch-graph-d46ec | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d46ec-7f8c97c56d-rqgm4 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:bb50e7052755d34993c754ebb5475c57cbe2445f423ca013a14a621d1f8fda77" in 2.004s (2.004s including waiting). Image size: 211751507 bytes. | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-8592d-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-8592d-predictor-94446b57c from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d46ec-predictor-7dbc68c665-9zjhq |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d46ec-7f8c97c56d-rqgm4 |
Killing |
Stopping container switch-graph-d46ec | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d46ec-predictor-54ff8f5568-kj6n7 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-8592d-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-8592d-predictor-b4d845d84 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-8592d-predictor-b4d845d84 |
SuccessfulCreate |
Created pod: success-200-isvc-8592d-predictor-b4d845d84-vrdmm | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d46ec-predictor-54ff8f5568-kj6n7 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-8592d-predictor-94446b57c |
SuccessfulCreate |
Created pod: error-404-isvc-8592d-predictor-94446b57c-nnlbx | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d46ec-predictor-7dbc68c665-9zjhq |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8592d-predictor-b4d845d84-vrdmm |
Started |
Started container kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-d46ec-predictor-7dbc68c665-9zjhq |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.26:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8592d-predictor-b4d845d84-vrdmm |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8592d-predictor-b4d845d84-vrdmm |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8592d-predictor-94446b57c-nnlbx |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1970" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8592d-predictor-b4d845d84-vrdmm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8592d-predictor-b4d845d84-vrdmm |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1970" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-8592d-predictor-b4d845d84-vrdmm |
AddedInterface |
Add eth0 [10.133.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d46ec-predictor-7dbc68c665-9zjhq |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.26:8643/healthz": dial tcp 10.134.0.26:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8592d-predictor-b4d845d84-vrdmm |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8592d-predictor-94446b57c-nnlbx |
Started |
Started container kube-rbac-proxy | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-d46ec-predictor-54ff8f5568-kj6n7 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.25:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d46ec-predictor-54ff8f5568-kj6n7 |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.25:8643/healthz": dial tcp 10.133.0.25:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8592d-predictor-94446b57c-nnlbx |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8592d-predictor-94446b57c-nnlbx |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-8592d-predictor-94446b57c-nnlbx |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8592d-predictor-94446b57c-nnlbx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8592d-predictor-94446b57c-nnlbx |
Created |
Created container: kserve-container | |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-xzhr5 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.27:8080: connect: connection refused |
| (x10) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.25:8080: connect: connection refused |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8592d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8592d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-d46ec-7f8c97c56d-rqgm4 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8592d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8592d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
model-chainer-76bc4cf9d7-2h22s |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "model-chainer-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-76bc4cf9d7 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-76bc4cf9d7 |
SuccessfulCreate |
Created pod: model-chainer-76bc4cf9d7-2h22s | |
kserve-ci-e2e-test |
kubelet |
model-chainer-76bc4cf9d7-2h22s |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-76bc4cf9d7-2h22s |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:bb50e7052755d34993c754ebb5475c57cbe2445f423ca013a14a621d1f8fda77" already present on machine | |
kserve-ci-e2e-test |
kubelet |
model-chainer-76bc4cf9d7-2h22s |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
multus |
model-chainer-76bc4cf9d7-2h22s |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8592d |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8592d |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8592d |
InferenceServiceReady |
InferenceService [success-200-isvc-8592d] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8592d |
InferenceServiceReady |
InferenceService [error-404-isvc-8592d] is Ready | |
kserve-ci-e2e-test |
kubelet |
model-chainer-76bc4cf9d7-2h22s |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-081d8-predictor-6b56b68db-qlfsp |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-xzhr5 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-xzhr5 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-081d8-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-081d8-predictor-6b56b68db from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-081d8-predictor-6b56b68db |
SuccessfulCreate |
Created pod: success-200-isvc-081d8-predictor-6b56b68db-qlfsp | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-081d8-predictor-6b56b68db-qlfsp |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-081d8-predictor-6b56b68db-qlfsp |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-081d8-predictor-6b56b68db-qlfsp |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-081d8-predictor-6b56b68db-qlfsp |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-081d8-predictor-6b56b68db-qlfsp |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-081d8-predictor-6b56b68db-qlfsp |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1970" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.28:8643/healthz": dial tcp 10.134.0.28:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-081d8-predictor-7f479c548c-h2qk4 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-081d8-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-081d8-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-081d8-predictor-7f479c548c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-081d8-predictor-7f479c548c |
SuccessfulCreate |
Created pod: error-404-isvc-081d8-predictor-7f479c548c-h2qk4 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-081d8-predictor-7f479c548c-h2qk4 |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
| (x11) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76857dd9b4-cvqt8 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.28:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-081d8-predictor-7f479c548c-h2qk4 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1970" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-081d8-predictor-7f479c548c-h2qk4 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-081d8-predictor-7f479c548c-h2qk4 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-081d8-predictor-7f479c548c-h2qk4 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-081d8-predictor-7f479c548c-h2qk4 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-081d8-predictor-7f479c548c-h2qk4 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-xzhr5 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.27:8643/healthz": dial tcp 10.134.0.27:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-74fc5cfbf9-4bx9x |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.25:8643/healthz": dial tcp 10.134.0.25:8643: connect: connection refused | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-8592d |
ScalingReplicaSet |
Scaled up replica set switch-graph-8592d-688fc594f9 from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8592d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-8592d |
InferenceGraphReady |
InferenceGraph [switch-graph-8592d] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-8592d-688fc594f9 |
SuccessfulCreate |
Created pod: switch-graph-8592d-688fc594f9-lcxv9 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8592d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
multus |
switch-graph-8592d-688fc594f9-lcxv9 |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-8592d-688fc594f9-lcxv9 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:bb50e7052755d34993c754ebb5475c57cbe2445f423ca013a14a621d1f8fda77" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-8592d-688fc594f9-lcxv9 |
Started |
Started container switch-graph-8592d | |
kserve-ci-e2e-test |
kubelet |
switch-graph-8592d-688fc594f9-lcxv9 |
Created |
Created container: switch-graph-8592d | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-081d8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-081d8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8592d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8592d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-76bc4cf9d7-2h22s |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-081d8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-081d8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-8592d |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-081d8-predictor-7f479c548c-h2qk4 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.30:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-8592d |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-081d8 |
InferenceServiceReady |
InferenceService [success-200-isvc-081d8] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-081d8 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-081d8 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-081d8 |
InferenceServiceReady |
InferenceService [error-404-isvc-081d8] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-081d8 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-081d8-66964d46f7 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
sequence-graph-081d8-66964d46f7-ghmwg |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-081d8-66964d46f7-ghmwg |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:bb50e7052755d34993c754ebb5475c57cbe2445f423ca013a14a621d1f8fda77" | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-081d8-66964d46f7 |
SuccessfulCreate |
Created pod: sequence-graph-081d8-66964d46f7-ghmwg | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-081d8 |
InferenceGraphReady |
InferenceGraph [sequence-graph-081d8] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-081d8-66964d46f7-ghmwg |
Created |
Created container: sequence-graph-081d8 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-081d8-66964d46f7-ghmwg |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:bb50e7052755d34993c754ebb5475c57cbe2445f423ca013a14a621d1f8fda77" in 1.841s (1.841s including waiting). Image size: 211751507 bytes. | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-081d8-66964d46f7-ghmwg |
Started |
Started container sequence-graph-081d8 | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-081d8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-081d8 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-081d8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-081d8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-081d8 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-081d8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-081d8 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-081d8 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
switch-graph-8592d-688fc594f9-lcxv9 |
Killing |
Stopping container switch-graph-8592d | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-0dcf6-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-0dcf6-predictor-5d98597747 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8592d-predictor-b4d845d84-vrdmm |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8592d-predictor-94446b57c-nnlbx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8592d-predictor-b4d845d84-vrdmm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-0dcf6-predictor-5d98597747 |
SuccessfulCreate |
Created pod: error-404-isvc-0dcf6-predictor-5d98597747-kxs58 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8592d-predictor-94446b57c-nnlbx |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-0dcf6-predictor-5f6f74f858 |
SuccessfulCreate |
Created pod: success-200-isvc-0dcf6-predictor-5f6f74f858-hls48 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-0dcf6-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-0dcf6-predictor-5f6f74f858 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0dcf6-predictor-5f6f74f858-hls48 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0dcf6-predictor-5f6f74f858-hls48 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-0dcf6-predictor-5d98597747-kxs58 |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0dcf6-predictor-5d98597747-kxs58 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1970" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0dcf6-predictor-5d98597747-kxs58 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0dcf6-predictor-5d98597747-kxs58 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0dcf6-predictor-5d98597747-kxs58 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0dcf6-predictor-5d98597747-kxs58 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0dcf6-predictor-5f6f74f858-hls48 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1970" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-0dcf6-predictor-5f6f74f858-hls48 |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0dcf6-predictor-5d98597747-kxs58 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0dcf6-predictor-5f6f74f858-hls48 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0dcf6-predictor-5f6f74f858-hls48 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0dcf6-predictor-5f6f74f858-hls48 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8592d-predictor-b4d845d84-vrdmm |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.27:8643/healthz": dial tcp 10.133.0.27:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8592d-predictor-94446b57c-nnlbx |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.29:8643/healthz": dial tcp 10.134.0.29:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-8592d-predictor-94446b57c-nnlbx |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.29:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-8592d-predictor-b4d845d84-vrdmm |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.27:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-8592d-688fc594f9-lcxv9 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0dcf6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0dcf6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0dcf6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0dcf6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-0dcf6-predictor-5f6f74f858-hls48 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.31:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-0dcf6-predictor-5d98597747-kxs58 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.32:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0dcf6 |
InferenceServiceReady |
InferenceService [success-200-isvc-0dcf6] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0dcf6 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0dcf6 |
InferenceServiceReady |
InferenceService [error-404-isvc-0dcf6] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0dcf6 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-081d8-predictor-7f479c548c-h2qk4 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-081d8-66964d46f7-ghmwg |
Killing |
Stopping container sequence-graph-081d8 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-081d8-predictor-6b56b68db-qlfsp |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-081d8-predictor-6b56b68db-qlfsp |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-081d8-predictor-7f479c548c-h2qk4 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-8649f-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-8649f-predictor-86d8f8bc54 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8649f-predictor-f69888d4c-dvxpd |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8649f-predictor-f69888d4c-dvxpd |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8649f-predictor-f69888d4c-dvxpd |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8649f-predictor-f69888d4c-dvxpd |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8649f-predictor-f69888d4c-dvxpd |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8649f-predictor-f69888d4c-dvxpd |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1970" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8649f-predictor-86d8f8bc54-9q6dr |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-8649f-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-8649f-predictor-f69888d4c |
SuccessfulCreate |
Created pod: error-404-isvc-8649f-predictor-f69888d4c-dvxpd | |
kserve-ci-e2e-test |
multus |
error-404-isvc-8649f-predictor-f69888d4c-dvxpd |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-8649f-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-8649f-predictor-f69888d4c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-8649f-predictor-86d8f8bc54 |
SuccessfulCreate |
Created pod: success-200-isvc-8649f-predictor-86d8f8bc54-9q6dr | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8649f-predictor-86d8f8bc54-9q6dr |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8649f-predictor-86d8f8bc54-9q6dr |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8649f-predictor-86d8f8bc54-9q6dr |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1970" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-8649f-predictor-86d8f8bc54-9q6dr |
AddedInterface |
Add eth0 [10.133.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8649f-predictor-86d8f8bc54-9q6dr |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8649f-predictor-86d8f8bc54-9q6dr |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8649f-predictor-86d8f8bc54-9q6dr |
Started |
Started container kube-rbac-proxy | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-081d8-predictor-6b56b68db-qlfsp |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.29:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-081d8-predictor-6b56b68db-qlfsp |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.29:8643/healthz": dial tcp 10.133.0.29:8643: connect: connection refused | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-0dcf6 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-0dcf6] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-0dcf6 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-0dcf6-84fd5d8669 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-0dcf6-84fd5d8669 |
SuccessfulCreate |
Created pod: ensemble-graph-0dcf6-84fd5d8669-w4s5w | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0dcf6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0dcf6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0dcf6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0dcf6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
multus |
ensemble-graph-0dcf6-84fd5d8669-w4s5w |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0dcf6-84fd5d8669-w4s5w |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-0dcf6-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0dcf6-84fd5d8669-w4s5w |
Started |
Started container ensemble-graph-0dcf6 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0dcf6-84fd5d8669-w4s5w |
Created |
Created container: ensemble-graph-0dcf6 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0dcf6-84fd5d8669-w4s5w |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:bb50e7052755d34993c754ebb5475c57cbe2445f423ca013a14a621d1f8fda77" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0dcf6-84fd5d8669-w4s5w |
Killing |
Stopping container ensemble-graph-0dcf6 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-9d702-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-9d702-predictor-5967c4d597 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0dcf6-predictor-5d98597747-kxs58 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0dcf6-predictor-5d98597747-kxs58 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d702-predictor-84c754796-qj7zl |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-9d702-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0dcf6-predictor-5f6f74f858-hls48 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d702-predictor-5967c4d597-nkqp8 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-9d702-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-9d702-predictor-5967c4d597 |
SuccessfulCreate |
Created pod: error-404-isvc-9d702-predictor-5967c4d597-nkqp8 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-9d702-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-9d702-predictor-84c754796 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-9d702-predictor-84c754796 |
SuccessfulCreate |
Created pod: success-200-isvc-9d702-predictor-84c754796-qj7zl | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0dcf6-predictor-5f6f74f858-hls48 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d702-predictor-84c754796-qj7zl |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d702-predictor-5967c4d597-nkqp8 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1970" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d702-predictor-84c754796-qj7zl |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d702-predictor-84c754796-qj7zl |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d702-predictor-5967c4d597-nkqp8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d702-predictor-5967c4d597-nkqp8 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d702-predictor-84c754796-qj7zl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d702-predictor-84c754796-qj7zl |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d702-predictor-5967c4d597-nkqp8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-9d702-predictor-5967c4d597-nkqp8 |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d702-predictor-84c754796-qj7zl |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1970" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d702-predictor-5967c4d597-nkqp8 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-9d702-predictor-84c754796-qj7zl |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d702-predictor-5967c4d597-nkqp8 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0dcf6-predictor-5d98597747-kxs58 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.32:8643/healthz": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-081d8-66964d46f7-ghmwg |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8649f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8649f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-8649f-predictor-86d8f8bc54-9q6dr |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.32:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-8649f-predictor-f69888d4c-dvxpd |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.33:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8649f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8649f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8649f |
InferenceServiceReady |
InferenceService [error-404-isvc-8649f] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8649f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-0dcf6-84fd5d8669-w4s5w |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8649f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8649f |
InferenceServiceReady |
InferenceService [success-200-isvc-8649f] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d702-predictor-84c754796-qj7zl |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.33:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d702-predictor-5967c4d597-nkqp8 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.35:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8649f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8649f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8649f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-8649f |
InferenceGraphReady |
InferenceGraph [sequence-graph-8649f] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-8649f |
ScalingReplicaSet |
Scaled up replica set sequence-graph-8649f-fc945575 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-8649f-fc945575 |
SuccessfulCreate |
Created pod: sequence-graph-8649f-fc945575-t7558 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8649f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8649f-fc945575-t7558 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-8649f-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
sequence-graph-8649f-fc945575-t7558 |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8649f-fc945575-t7558 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:bb50e7052755d34993c754ebb5475c57cbe2445f423ca013a14a621d1f8fda77" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8649f-fc945575-t7558 |
Created |
Created container: sequence-graph-8649f | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8649f-fc945575-t7558 |
Started |
Started container sequence-graph-8649f | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9d702-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9d702-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9d702-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9d702-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9d702 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9d702 |
InferenceServiceReady |
InferenceService [success-200-isvc-9d702] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9d702 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9d702 |
InferenceServiceReady |
InferenceService [error-404-isvc-9d702] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-8eede-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-8eede-predictor-757747b4bb from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8eede-predictor-757747b4bb-fm7b8 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-8eede-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8649f-predictor-f69888d4c-dvxpd |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8649f-fc945575-t7558 |
Killing |
Stopping container sequence-graph-8649f | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8649f-predictor-f69888d4c-dvxpd |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8649f-predictor-86d8f8bc54-9q6dr |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-8eede-predictor-757747b4bb |
SuccessfulCreate |
Created pod: success-200-isvc-8eede-predictor-757747b4bb-fm7b8 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8649f-predictor-86d8f8bc54-9q6dr |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-8eede-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-8eede-predictor-5d489c9599 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-8eede-predictor-5d489c9599 |
SuccessfulCreate |
Created pod: error-404-isvc-8eede-predictor-5d489c9599-98jkr | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8eede-predictor-5d489c9599-98jkr |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-8eede-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8eede-predictor-5d489c9599-98jkr |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8eede-predictor-757747b4bb-fm7b8 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1970" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8eede-predictor-757747b4bb-fm7b8 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8eede-predictor-5d489c9599-98jkr |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1970" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8eede-predictor-5d489c9599-98jkr |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-8eede-predictor-5d489c9599-98jkr |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8eede-predictor-5d489c9599-98jkr |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-8eede-predictor-757747b4bb-fm7b8 |
AddedInterface |
Add eth0 [10.133.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8eede-predictor-757747b4bb-fm7b8 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8eede-predictor-757747b4bb-fm7b8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8eede-predictor-757747b4bb-fm7b8 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8eede-predictor-757747b4bb-fm7b8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8eede-predictor-5d489c9599-98jkr |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8eede-predictor-5d489c9599-98jkr |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8649f-predictor-86d8f8bc54-9q6dr |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.32:8643/healthz": dial tcp 10.133.0.32:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8649f-predictor-f69888d4c-dvxpd |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.33:8643/healthz": dial tcp 10.134.0.33:8643: connect: connection refused | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-9d702-6849cf5859 |
SuccessfulCreate |
Created pod: ensemble-graph-9d702-6849cf5859-m6bk5 | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-9d702 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-9d702-6849cf5859 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-9d702 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-9d702] is Ready | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-9d702-6849cf5859-m6bk5 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-9d702-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-9d702-6849cf5859-m6bk5 |
Created |
Created container: ensemble-graph-9d702 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-9d702-6849cf5859-m6bk5 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:bb50e7052755d34993c754ebb5475c57cbe2445f423ca013a14a621d1f8fda77" already present on machine | |
kserve-ci-e2e-test |
multus |
ensemble-graph-9d702-6849cf5859-m6bk5 |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-9d702-6849cf5859-m6bk5 |
Started |
Started container ensemble-graph-9d702 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-8649f-fc945575-t7558 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8eede-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8eede-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8eede-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8eede-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-8eede-predictor-5d489c9599-98jkr |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.37:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-8eede-predictor-757747b4bb-fm7b8 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.34:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9d702-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9d702-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9d702-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9d702-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8eede |
InferenceServiceReady |
InferenceService [error-404-isvc-8eede] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8eede |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8eede |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8eede |
InferenceServiceReady |
InferenceService [success-200-isvc-8eede] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-9d702 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-9d702 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-8eede |
InferenceGraphReady |
InferenceGraph [sequence-graph-8eede] is Ready | |
kserve-ci-e2e-test |
multus |
sequence-graph-8eede-bdd8448d-m85hx |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8eede-bdd8448d-m85hx |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:bb50e7052755d34993c754ebb5475c57cbe2445f423ca013a14a621d1f8fda77" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8eede-bdd8448d-m85hx |
Created |
Created container: sequence-graph-8eede | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-8eede-bdd8448d |
SuccessfulCreate |
Created pod: sequence-graph-8eede-bdd8448d-m85hx | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-8eede |
ScalingReplicaSet |
Scaled up replica set sequence-graph-8eede-bdd8448d from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8eede-bdd8448d-m85hx |
Started |
Started container sequence-graph-8eede | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8eede-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8eede-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8eede-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8eede-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-8eede |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-8eede |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d702-predictor-5967c4d597-nkqp8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-de19c |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-de19c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-de19c |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-de19c": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-de19c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-de19c-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-de19c-predictor-548b8d5b44 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-de19c-predictor-548b8d5b44 |
SuccessfulCreate |
Created pod: success-200-isvc-de19c-predictor-548b8d5b44-6g7k2 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d702-predictor-5967c4d597-nkqp8 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d702-predictor-84c754796-qj7zl |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d702-predictor-84c754796-qj7zl |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-9d702-6849cf5859-m6bk5 |
Killing |
Stopping container ensemble-graph-9d702 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de19c-predictor-d5c8fcc89-47k8v |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-de19c |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-de19c": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-de19c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de19c-predictor-548b8d5b44-6g7k2 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de19c-predictor-548b8d5b44-6g7k2 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de19c-predictor-548b8d5b44-6g7k2 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de19c-predictor-548b8d5b44-6g7k2 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de19c-predictor-548b8d5b44-6g7k2 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de19c-predictor-548b8d5b44-6g7k2 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1970" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-de19c-predictor-548b8d5b44-6g7k2 |
AddedInterface |
Add eth0 [10.133.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
error-404-isvc-de19c-predictor-d5c8fcc89-47k8v |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-de19c |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-de19c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de19c-predictor-d5c8fcc89-47k8v |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1970" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-de19c-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-de19c-predictor-d5c8fcc89 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-de19c-predictor-d5c8fcc89 |
SuccessfulCreate |
Created pod: error-404-isvc-de19c-predictor-d5c8fcc89-47k8v | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de19c-predictor-d5c8fcc89-47k8v |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de19c-predictor-d5c8fcc89-47k8v |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de19c-predictor-d5c8fcc89-47k8v |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de19c-predictor-d5c8fcc89-47k8v |
Started |
Started container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-9d702-6849cf5859-m6bk5 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-de19c-predictor-d5c8fcc89-47k8v |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.40:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-de19c-predictor-548b8d5b44-6g7k2 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.35:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-de19c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-de19c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-de19c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-de19c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-de19c |
InferenceServiceReady |
InferenceService [error-404-isvc-de19c] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-de19c |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-de19c |
InferenceServiceReady |
InferenceService [success-200-isvc-de19c] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-de19c |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8eede-bdd8448d-m85hx |
Killing |
Stopping container sequence-graph-8eede | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-85bfa-predictor-74c5d488b8-xfmfg |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-85bfa-predictor-5d4d479565-4dlks |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-85bfa-predictor-74c5d488b8-xfmfg |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-85bfa-predictor-74c5d488b8-xfmfg |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-85bfa-predictor-74c5d488b8-xfmfg |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-85bfa-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-85bfa-predictor-5d4d479565 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8eede-predictor-757747b4bb-fm7b8 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8eede-predictor-757747b4bb-fm7b8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8eede-predictor-5d489c9599-98jkr |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-85bfa-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-85bfa-predictor-74c5d488b8 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-85bfa-predictor-74c5d488b8 |
SuccessfulCreate |
Created pod: success-200-isvc-85bfa-predictor-74c5d488b8-xfmfg | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-85bfa-predictor-74c5d488b8-xfmfg |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-85bfa-predictor-5d4d479565-4dlks |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1970" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-85bfa-predictor-5d4d479565-4dlks |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-85bfa-predictor-5d4d479565-4dlks |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-85bfa-predictor-5d4d479565-4dlks |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-85bfa-predictor-5d4d479565-4dlks |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-85bfa-predictor-5d4d479565-4dlks |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-85bfa-predictor-74c5d488b8-xfmfg |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1970" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-85bfa-predictor-74c5d488b8-xfmfg |
AddedInterface |
Add eth0 [10.133.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8eede-predictor-5d489c9599-98jkr |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-85bfa-predictor-5d4d479565 |
SuccessfulCreate |
Created pod: error-404-isvc-85bfa-predictor-5d4d479565-4dlks | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-de19c-847bdf9fb9-z5b2d |
Created |
Created container: splitter-graph-de19c | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-de19c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
splitter-graph-de19c-847bdf9fb9-z5b2d |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:bb50e7052755d34993c754ebb5475c57cbe2445f423ca013a14a621d1f8fda77" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-de19c-847bdf9fb9-z5b2d |
Started |
Started container splitter-graph-de19c | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-de19c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-de19c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-de19c-847bdf9fb9 |
SuccessfulCreate |
Created pod: splitter-graph-de19c-847bdf9fb9-z5b2d | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-de19c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
multus |
splitter-graph-de19c-847bdf9fb9-z5b2d |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-de19c |
InferenceGraphReady |
InferenceGraph [splitter-graph-de19c] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-de19c |
ScalingReplicaSet |
Scaled up replica set splitter-graph-de19c-847bdf9fb9 from 0 to 1 | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-85bfa-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-85bfa-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-85bfa-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-85bfa-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de19c-predictor-d5c8fcc89-47k8v |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e7d45-predictor-685f9d9bbb-mm5ss |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-e7d45-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de19c-predictor-d5c8fcc89-47k8v |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-e7d45-predictor-685f9d9bbb |
SuccessfulCreate |
Created pod: success-200-isvc-e7d45-predictor-685f9d9bbb-mm5ss | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-de19c-847bdf9fb9-z5b2d |
Killing |
Stopping container splitter-graph-de19c | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-e7d45-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-e7d45-predictor-685f9d9bbb from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de19c-predictor-548b8d5b44-6g7k2 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de19c-predictor-548b8d5b44-6g7k2 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-e7d45-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-e7d45-predictor-bfcffd599 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-e7d45-predictor-bfcffd599 |
SuccessfulCreate |
Created pod: error-404-isvc-e7d45-predictor-bfcffd599-ntx59 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e7d45-predictor-bfcffd599-ntx59 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e7d45-predictor-bfcffd599-ntx59 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e7d45-predictor-bfcffd599-ntx59 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e7d45-predictor-685f9d9bbb-mm5ss |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e7d45-predictor-685f9d9bbb-mm5ss |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e7d45-predictor-bfcffd599-ntx59 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1970" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e7d45-predictor-bfcffd599-ntx59 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e7d45-predictor-685f9d9bbb-mm5ss |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e7d45-predictor-685f9d9bbb-mm5ss |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e7d45-predictor-685f9d9bbb-mm5ss |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e7d45-predictor-685f9d9bbb-mm5ss |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1970" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e7d45-predictor-bfcffd599-ntx59 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-e7d45-predictor-685f9d9bbb-mm5ss |
AddedInterface |
Add eth0 [10.133.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
error-404-isvc-e7d45-predictor-bfcffd599-ntx59 |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de19c-predictor-d5c8fcc89-47k8v |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.40:8643/healthz": dial tcp 10.134.0.40:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de19c-predictor-548b8d5b44-6g7k2 |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.35:8643/healthz": dial tcp 10.133.0.35:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-8eede-bdd8448d-m85hx |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e7d45-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e7d45-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-85bfa-predictor-5d4d479565-4dlks |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.41:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-85bfa-predictor-74c5d488b8-xfmfg |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.36:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-de19c-847bdf9fb9-z5b2d |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-85bfa |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-85bfa |
InferenceServiceReady |
InferenceService [error-404-isvc-85bfa] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-85bfa |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-85bfa |
InferenceServiceReady |
InferenceService [success-200-isvc-85bfa] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-e7d45-predictor-685f9d9bbb-mm5ss |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.37:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
switch-graph-85bfa-7886b55cbc-fnw2h |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-85bfa-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-85bfa-7886b55cbc |
SuccessfulCreate |
Created pod: switch-graph-85bfa-7886b55cbc-fnw2h | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-85bfa |
ScalingReplicaSet |
Scaled up replica set switch-graph-85bfa-7886b55cbc from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-85bfa |
InferenceGraphReady |
InferenceGraph [switch-graph-85bfa] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-85bfa-7886b55cbc-fnw2h |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:bb50e7052755d34993c754ebb5475c57cbe2445f423ca013a14a621d1f8fda77" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-85bfa-7886b55cbc-fnw2h |
Created |
Created container: switch-graph-85bfa | |
kserve-ci-e2e-test |
multus |
switch-graph-85bfa-7886b55cbc-fnw2h |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-85bfa-7886b55cbc-fnw2h |
Started |
Started container switch-graph-85bfa | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e7d45-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e7d45-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e7d45 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e7d45 |
InferenceServiceReady |
InferenceService [success-200-isvc-e7d45] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e7d45 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e7d45 |
InferenceServiceReady |
InferenceService [error-404-isvc-e7d45] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-85bfa |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-85bfa-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-85bfa-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-85bfa |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-e7d45 |
InferenceGraphReady |
InferenceGraph [splitter-graph-e7d45] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-e7d45 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-e7d45-7d4894f44c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-e7d45-7d4894f44c |
SuccessfulCreate |
Created pod: splitter-graph-e7d45-7d4894f44c-9lvpm | |
kserve-ci-e2e-test |
multus |
splitter-graph-e7d45-7d4894f44c-9lvpm |
AddedInterface |
Add eth0 [10.134.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-e7d45-7d4894f44c-9lvpm |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:bb50e7052755d34993c754ebb5475c57cbe2445f423ca013a14a621d1f8fda77" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-e7d45-7d4894f44c-9lvpm |
Created |
Created container: splitter-graph-e7d45 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-e7d45-7d4894f44c-9lvpm |
Started |
Started container splitter-graph-e7d45 | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-85bfa-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-85bfa |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-85bfa |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-85bfa-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-e7d45 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e7d45-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-e7d45 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e7d45-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-e7d45 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-e7d45 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e7d45-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e7d45-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
splitter-graph-e7d45-7d4894f44c-9lvpm |
Killing |
Stopping container splitter-graph-e7d45 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e7d45-predictor-bfcffd599-ntx59 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e7d45-predictor-685f9d9bbb-mm5ss |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e7d45-predictor-685f9d9bbb-mm5ss |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e7d45-predictor-bfcffd599-ntx59 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e7d45-predictor-bfcffd599-ntx59 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.43:8643/healthz": dial tcp 10.134.0.43:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-e7d45-predictor-bfcffd599-ntx59 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.43:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-e7d45-7d4894f44c-9lvpm |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
switch-graph-85bfa-7886b55cbc-fnw2h |
Killing |
Stopping container switch-graph-85bfa | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-85bfa-predictor-5d4d479565-4dlks |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-85bfa-predictor-74c5d488b8-xfmfg |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-85bfa-predictor-74c5d488b8-xfmfg |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-85bfa-predictor-5d4d479565-4dlks |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-85bfa-predictor-5d4d479565-4dlks |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.41:8643/healthz": dial tcp 10.134.0.41:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-85bfa-predictor-5d4d479565-4dlks |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.41:8643/healthz": context deadline exceeded | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-85bfa-predictor-5d4d479565-4dlks |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.41:8080: i/o timeout | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-85bfa-7886b55cbc-fnw2h |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |