| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
splitter-graph-5a2c4-77c5594cb8-l58pz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-5a2c4-77c5594cb8-l58pz to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-e0a45-predictor-dd9f8465d-ctpz8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-e0a45-predictor-dd9f8465d-ctpz8 to ip-10-0-136-130.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-e0a45-predictor-8545c9dc7f-pqqjh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-e0a45-predictor-8545c9dc7f-pqqjh to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-5a2c4-predictor-7d688b9859-9flbs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-5a2c4-predictor-7d688b9859-9flbs to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-6f687ffc4-z65q8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-6f687ffc4-z65q8 to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-555fc69d56-n9npf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-n9npf to ip-10-0-136-130.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-65928-predictor-6b77457dbf-g7kr9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-65928-predictor-6b77457dbf-g7kr9 to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-31957-5d489cff66-4lgrj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-31957-5d489cff66-4lgrj to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-65928-767fdc487-v7j4m |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-65928-767fdc487-v7j4m to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-c4e90-775bbd874f-t68tg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-c4e90-775bbd874f-t68tg to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-31957-predictor-5657f8887-srjcj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-31957-predictor-5657f8887-srjcj to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-77f5f-d7ff746f7-hwnc6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-77f5f-d7ff746f7-hwnc6 to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-c1827-745964469b-cskkx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-c1827-745964469b-cskkx to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-e0a45-9684bdf46-n62b8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-e0a45-9684bdf46-n62b8 to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-c5f0c-844f475959-vnjtz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-c5f0c-844f475959-vnjtz to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-29aad-74c87f6b5c-t62mf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-29aad-74c87f6b5c-t62mf to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-c4e90-predictor-555f9566bc-fnlzr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-c4e90-predictor-555f9566bc-fnlzr to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-10598-predictor-756678795d-kb629 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-10598-predictor-756678795d-kb629 to ip-10-0-136-130.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-29aad-predictor-6f6bfbbb58-gqwmr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-29aad-predictor-6f6bfbbb58-gqwmr to ip-10-0-136-130.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-31957-predictor-bb49bf486-kkdf8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-31957-predictor-bb49bf486-kkdf8 to ip-10-0-136-130.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-5a2c4-predictor-656b55656b-85ql9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-5a2c4-predictor-656b55656b-85ql9 to ip-10-0-136-130.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf to ip-10-0-136-130.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-c5f0c-predictor-78b5f64bc-74flm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-c5f0c-predictor-78b5f64bc-74flm to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-10598-predictor-577cdb5f5f-xf8dr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-10598-predictor-577cdb5f5f-xf8dr to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-65928-predictor-8d4457c6-thkmw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-65928-predictor-8d4457c6-thkmw to ip-10-0-136-130.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-10598-647cf68fb6-9lwpp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-10598-647cf68fb6-9lwpp to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-77f5f-predictor-6995f557bc-s5ttt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-77f5f-predictor-6995f557bc-s5ttt to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-29aad-predictor-658758c67f-4c92z |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-29aad-predictor-658758c67f-4c92z to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-c1827-predictor-64748d747d-75nl8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-c1827-predictor-64748d747d-75nl8 to ip-10-0-136-130.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-c4e90-predictor-7889b4769d-6wm5n |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-c4e90-predictor-7889b4769d-6wm5n to ip-10-0-136-130.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-c5f0c-predictor-78fd55bc98-r8vjb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-c5f0c-predictor-78fd55bc98-r8vjb to ip-10-0-136-130.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr to ip-10-0-136-130.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-77f5f-predictor-844f655df8-cpff7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-77f5f-predictor-844f655df8-cpff7 to ip-10-0-136-130.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-c1827-predictor-5fccd85d8c-9dtwm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-c1827-predictor-5fccd85d8c-9dtwm to ip-10-0-143-176.ec2.internal | ||
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-e0a45-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-e0a45-predictor-dd9f8465d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-6586fbcf75 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-6586fbcf75 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-e0a45-predictor-dd9f8465d |
SuccessfulCreate |
Created pod: success-200-isvc-e0a45-predictor-dd9f8465d-ctpz8 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-5bb8cf688 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-e0a45-predictor-8545c9dc7f |
SuccessfulCreate |
Created pod: error-404-isvc-e0a45-predictor-8545c9dc7f-pqqjh | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-555fc69d56 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e0a45-predictor-dd9f8465d-ctpz8 |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-2001" | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-555fc69d56 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-555fc69d56-n9npf | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-e0a45-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-e0a45-predictor-8545c9dc7f from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-e0a45-predictor-dd9f8465d-ctpz8 |
AddedInterface |
Add eth0 [10.133.0.18/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-555fc69d56-n9npf |
AddedInterface |
Add eth0 [10.133.0.19/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-5bb8cf688 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e0a45-predictor-8545c9dc7f-pqqjh |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-2001" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-sklearn-graph-2-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-n9npf |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:58521de9f1e6ac7a4c1846ddd43b3fde688cfbb0dfbc271a01823cb9f1815d77" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-e0a45-predictor-8545c9dc7f-pqqjh |
AddedInterface |
Add eth0 [10.132.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:58521de9f1e6ac7a4c1846ddd43b3fde688cfbb0dfbc271a01823cb9f1815d77" already present on machine | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf |
AddedInterface |
Add eth0 [10.133.0.17/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-n9npf |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-n9npf |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr |
AddedInterface |
Add eth0 [10.133.0.20/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:58521de9f1e6ac7a4c1846ddd43b3fde688cfbb0dfbc271a01823cb9f1815d77" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-2001" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-n9npf |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-2001" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e0a45-predictor-8545c9dc7f-pqqjh |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e0a45-predictor-8545c9dc7f-pqqjh |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e0a45-predictor-8545c9dc7f-pqqjh |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-2001" in 11.961s (11.961s including waiting). Image size: 1355797058 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e0a45-predictor-8545c9dc7f-pqqjh |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e0a45-predictor-8545c9dc7f-pqqjh |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e0a45-predictor-8545c9dc7f-pqqjh |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.194s (2.194s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e0a45-predictor-8545c9dc7f-pqqjh |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-2001" in 15.687s (15.687s including waiting). Image size: 1580942218 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e0a45-predictor-dd9f8465d-ctpz8 |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-2001" in 22.291s (22.291s including waiting). Image size: 1356818505 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-2001" in 16.502s (16.502s including waiting). Image size: 1580942218 bytes. | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e0a45-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e0a45-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e0a45-predictor-dd9f8465d-ctpz8 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e0a45-predictor-dd9f8465d-ctpz8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-n9npf |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-n9npf |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 25.23s (25.231s including waiting). Image size: 1435742979 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e0a45-predictor-dd9f8465d-ctpz8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-n9npf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-n9npf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e0a45-predictor-dd9f8465d-ctpz8 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-n9npf |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 3.445s (3.445s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-n9npf |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-n9npf |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 3.561s (3.561s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 3.529s (3.529s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e0a45-predictor-dd9f8465d-ctpz8 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 3.499s (3.499s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e0a45-predictor-dd9f8465d-ctpz8 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr |
Started |
Started container kube-rbac-proxy | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-e0a45-predictor-8545c9dc7f-pqqjh |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.24:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e0a45 |
InferenceServiceReady |
InferenceService [error-404-isvc-e0a45] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e0a45 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-e0a45-predictor-dd9f8465d-ctpz8 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.18:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e0a45-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e0a45-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e0a45 |
InferenceServiceReady |
InferenceService [success-200-isvc-e0a45] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e0a45 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e0a45-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e0a45-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
switch-graph-e0a45-9684bdf46-n62b8 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-e0a45-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-e0a45 |
InferenceGraphReady |
InferenceGraph [switch-graph-e0a45] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-e0a45 |
ScalingReplicaSet |
Scaled up replica set switch-graph-e0a45-9684bdf46 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-e0a45-9684bdf46 |
SuccessfulCreate |
Created pod: switch-graph-e0a45-9684bdf46-n62b8 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-e0a45-9684bdf46-n62b8 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:541f5925144e7631a56252a58e1f72ffb46442ac12f9e86de1bc012876dee338" | |
kserve-ci-e2e-test |
multus |
switch-graph-e0a45-9684bdf46-n62b8 |
AddedInterface |
Add eth0 [10.132.0.25/23] from ovn-kubernetes | |
| (x8) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-e0a45-9684bdf46-n62b8 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:541f5925144e7631a56252a58e1f72ffb46442ac12f9e86de1bc012876dee338" in 2.432s (2.432s including waiting). Image size: 211751489 bytes. | |
kserve-ci-e2e-test |
kubelet |
switch-graph-e0a45-9684bdf46-n62b8 |
Created |
Created container: switch-graph-e0a45 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-e0a45-9684bdf46-n62b8 |
Started |
Started container switch-graph-e0a45 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e0a45-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e0a45-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e0a45-predictor-dd9f8465d-ctpz8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e0a45-predictor-8545c9dc7f-pqqjh |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e0a45-predictor-dd9f8465d-ctpz8 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
switch-graph-e0a45-9684bdf46-n62b8 |
Killing |
Stopping container switch-graph-e0a45 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e0a45-predictor-8545c9dc7f-pqqjh |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-c5f0c-predictor-78fd55bc98 |
SuccessfulCreate |
Created pod: success-200-isvc-c5f0c-predictor-78fd55bc98-r8vjb | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c5f0c-predictor-78fd55bc98-r8vjb |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c5f0c-predictor-78fd55bc98-r8vjb |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-2001" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c5f0c-predictor-78fd55bc98-r8vjb |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-c5f0c-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-c5f0c-predictor-78b5f64bc from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-c5f0c-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-c5f0c-predictor-78fd55bc98 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-c5f0c-predictor-78fd55bc98-r8vjb |
AddedInterface |
Add eth0 [10.133.0.21/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c5f0c-predictor-78fd55bc98-r8vjb |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c5f0c-predictor-78b5f64bc-74flm |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-c5f0c-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c5f0c-predictor-78fd55bc98-r8vjb |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c5f0c-predictor-78fd55bc98-r8vjb |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-c5f0c-predictor-78b5f64bc |
SuccessfulCreate |
Created pod: error-404-isvc-c5f0c-predictor-78b5f64bc-74flm | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c5f0c-predictor-78b5f64bc-74flm |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c5f0c-predictor-78b5f64bc-74flm |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c5f0c-predictor-78b5f64bc-74flm |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-c5f0c-predictor-78b5f64bc-74flm |
AddedInterface |
Add eth0 [10.132.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c5f0c-predictor-78b5f64bc-74flm |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-2001" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c5f0c-predictor-78b5f64bc-74flm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c5f0c-predictor-78b5f64bc-74flm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e0a45-predictor-dd9f8465d-ctpz8 |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.18:8643/healthz": dial tcp 10.133.0.18:8643: connect: connection refused | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-e0a45-9684bdf46-n62b8 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-6f687ffc4 |
SuccessfulCreate |
Created pod: model-chainer-6f687ffc4-z65q8 | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-6f687ffc4 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
model-chainer-6f687ffc4-z65q8 |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-6f687ffc4-z65q8 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:541f5925144e7631a56252a58e1f72ffb46442ac12f9e86de1bc012876dee338" already present on machine | |
kserve-ci-e2e-test |
multus |
model-chainer-6f687ffc4-z65q8 |
AddedInterface |
Add eth0 [10.132.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
model-chainer-6f687ffc4-z65q8 |
Created |
Created container: model-chainer | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c5f0c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c5f0c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c5f0c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c5f0c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-n9npf |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-65928-predictor-8d4457c6-thkmw |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-65928-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
model-chainer-6f687ffc4-z65q8 |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-65928-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-65928-predictor-6b77457dbf from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-65928-predictor-6b77457dbf |
SuccessfulCreate |
Created pod: error-404-isvc-65928-predictor-6b77457dbf-g7kr9 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-65928-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-65928-predictor-8d4457c6 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-n9npf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-65928-predictor-8d4457c6 |
SuccessfulCreate |
Created pod: success-200-isvc-65928-predictor-8d4457c6-thkmw | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-65928-predictor-8d4457c6-thkmw |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-65928-predictor-8d4457c6-thkmw |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-65928-predictor-6b77457dbf-g7kr9 |
AddedInterface |
Add eth0 [10.132.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-65928-predictor-6b77457dbf-g7kr9 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-65928-predictor-6b77457dbf-g7kr9 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-2001" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-65928-predictor-6b77457dbf-g7kr9 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-65928-predictor-6b77457dbf-g7kr9 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-65928-predictor-6b77457dbf-g7kr9 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-65928-predictor-8d4457c6-thkmw |
AddedInterface |
Add eth0 [10.133.0.22/23] from ovn-kubernetes | |
| (x10) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.17:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-65928-predictor-8d4457c6-thkmw |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-2001" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-65928-predictor-6b77457dbf-g7kr9 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-65928-predictor-8d4457c6-thkmw |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6586fbcf75-8m8lf |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.17:8643/healthz": dial tcp 10.133.0.17:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-65928-predictor-8d4457c6-thkmw |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-65928-predictor-8d4457c6-thkmw |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-n9npf |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.19:8643/healthz": dial tcp 10.133.0.19:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.20:8643/healthz": dial tcp 10.133.0.20:8643: connect: connection refused | |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-n9npf |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.19:8080: connect: connection refused |
| (x10) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5bb8cf688-7vghr |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.20:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-c5f0c-predictor-78b5f64bc-74flm |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.26:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c5f0c |
InferenceServiceReady |
InferenceService [success-200-isvc-c5f0c] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c5f0c |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c5f0c |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c5f0c |
InferenceServiceReady |
InferenceService [error-404-isvc-c5f0c] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-65928-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-65928-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c5f0c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-c5f0c |
InferenceGraphReady |
InferenceGraph [switch-graph-c5f0c] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-c5f0c |
ScalingReplicaSet |
Scaled up replica set switch-graph-c5f0c-844f475959 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-c5f0c-844f475959 |
SuccessfulCreate |
Created pod: switch-graph-c5f0c-844f475959-vnjtz | |
kserve-ci-e2e-test |
kubelet |
switch-graph-c5f0c-844f475959-vnjtz |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-c5f0c-serving-cert" not found | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c5f0c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
switch-graph-c5f0c-844f475959-vnjtz |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:541f5925144e7631a56252a58e1f72ffb46442ac12f9e86de1bc012876dee338" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-c5f0c-844f475959-vnjtz |
Created |
Created container: switch-graph-c5f0c | |
kserve-ci-e2e-test |
kubelet |
switch-graph-c5f0c-844f475959-vnjtz |
Started |
Started container switch-graph-c5f0c | |
kserve-ci-e2e-test |
multus |
switch-graph-c5f0c-844f475959-vnjtz |
AddedInterface |
Add eth0 [10.132.0.29/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-6f687ffc4-z65q8 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-65928-predictor-8d4457c6-thkmw |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.22:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-65928-predictor-6b77457dbf-g7kr9 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.28:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c5f0c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c5f0c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-c5f0c |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-c5f0c |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-65928-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-65928-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-65928 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-65928 |
InferenceServiceReady |
InferenceService [success-200-isvc-65928] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-65928 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-65928 |
InferenceServiceReady |
InferenceService [error-404-isvc-65928] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-c5f0c |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-c5f0c |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-65928 |
InferenceGraphReady |
InferenceGraph [sequence-graph-65928] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-65928-767fdc487-v7j4m |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:541f5925144e7631a56252a58e1f72ffb46442ac12f9e86de1bc012876dee338" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-65928-767fdc487 |
SuccessfulCreate |
Created pod: sequence-graph-65928-767fdc487-v7j4m | |
kserve-ci-e2e-test |
multus |
sequence-graph-65928-767fdc487-v7j4m |
AddedInterface |
Add eth0 [10.132.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-65928 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-65928-767fdc487 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-65928-767fdc487-v7j4m |
Created |
Created container: sequence-graph-65928 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-65928-767fdc487-v7j4m |
Started |
Started container sequence-graph-65928 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-65928-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-65928 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-65928 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-65928-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-65928-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-65928-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-65928 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-65928 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c5f0c-predictor-78fd55bc98-r8vjb |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c5f0c-predictor-78b5f64bc-74flm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c5f0c-predictor-78b5f64bc-74flm |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c5f0c-predictor-78fd55bc98-r8vjb |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
switch-graph-c5f0c-844f475959-vnjtz |
Killing |
Stopping container switch-graph-c5f0c | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-c1827-predictor-64748d747d |
SuccessfulCreate |
Created pod: success-200-isvc-c1827-predictor-64748d747d-75nl8 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-c1827-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-c1827-predictor-64748d747d from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c1827-predictor-5fccd85d8c-9dtwm |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-c1827-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-c1827-predictor-5fccd85d8c from 0 to 1 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-c1827-predictor-5fccd85d8c-9dtwm |
AddedInterface |
Add eth0 [10.132.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c1827-predictor-5fccd85d8c-9dtwm |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-2001" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c1827-predictor-5fccd85d8c-9dtwm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c1827-predictor-5fccd85d8c-9dtwm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c1827-predictor-5fccd85d8c-9dtwm |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c1827-predictor-5fccd85d8c-9dtwm |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-c1827-predictor-5fccd85d8c |
SuccessfulCreate |
Created pod: error-404-isvc-c1827-predictor-5fccd85d8c-9dtwm | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c1827-predictor-64748d747d-75nl8 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-c1827-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c1827-predictor-64748d747d-75nl8 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c5f0c-predictor-78fd55bc98-r8vjb |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.21:8643/healthz": dial tcp 10.133.0.21:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c1827-predictor-64748d747d-75nl8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c1827-predictor-64748d747d-75nl8 |
Started |
Started container kube-rbac-proxy | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-c5f0c-predictor-78fd55bc98-r8vjb |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.21:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c1827-predictor-64748d747d-75nl8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c1827-predictor-64748d747d-75nl8 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-2001" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-c1827-predictor-64748d747d-75nl8 |
AddedInterface |
Add eth0 [10.133.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c1827-predictor-64748d747d-75nl8 |
Created |
Created container: kube-rbac-proxy | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-c5f0c-844f475959-vnjtz |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c1827-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c1827-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c1827-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c1827-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-31957-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-31957-predictor-5657f8887 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-65928-predictor-8d4457c6-thkmw |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-31957-predictor-bb49bf486-kkdf8 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-31957-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-65928-767fdc487-v7j4m |
Killing |
Stopping container sequence-graph-65928 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-31957-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-31957-predictor-bb49bf486 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-31957-predictor-5657f8887-srjcj |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-31957-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-31957-predictor-5657f8887 |
SuccessfulCreate |
Created pod: error-404-isvc-31957-predictor-5657f8887-srjcj | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-31957-predictor-bb49bf486 |
SuccessfulCreate |
Created pod: success-200-isvc-31957-predictor-bb49bf486-kkdf8 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-65928-predictor-8d4457c6-thkmw |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-65928-predictor-6b77457dbf-g7kr9 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-65928-predictor-6b77457dbf-g7kr9 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-31957-predictor-5657f8887-srjcj |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-31957-predictor-5657f8887-srjcj |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-31957-predictor-bb49bf486-kkdf8 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-31957-predictor-5657f8887-srjcj |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-2001" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-31957-predictor-bb49bf486-kkdf8 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-c1827-predictor-5fccd85d8c-9dtwm |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.31:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-31957-predictor-bb49bf486-kkdf8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-31957-predictor-5657f8887-srjcj |
AddedInterface |
Add eth0 [10.132.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
success-200-isvc-31957-predictor-bb49bf486-kkdf8 |
AddedInterface |
Add eth0 [10.133.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-31957-predictor-bb49bf486-kkdf8 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-2001" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-31957-predictor-5657f8887-srjcj |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-31957-predictor-5657f8887-srjcj |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-31957-predictor-5657f8887-srjcj |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-31957-predictor-bb49bf486-kkdf8 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-31957-predictor-bb49bf486-kkdf8 |
Created |
Created container: kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-c1827-predictor-64748d747d-75nl8 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.23:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c1827 |
InferenceServiceReady |
InferenceService [error-404-isvc-c1827] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c1827 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c1827 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c1827 |
InferenceServiceReady |
InferenceService [success-200-isvc-c1827] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-31957-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-31957-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c1827-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-c1827 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-c1827-745964469b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-c1827-745964469b |
SuccessfulCreate |
Created pod: ensemble-graph-c1827-745964469b-cskkx | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c1827-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c1827-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c1827-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-c1827 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-c1827] is Ready | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-c1827-745964469b-cskkx |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-c1827-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-c1827-745964469b-cskkx |
Created |
Created container: ensemble-graph-c1827 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-c1827-745964469b-cskkx |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:541f5925144e7631a56252a58e1f72ffb46442ac12f9e86de1bc012876dee338" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-c1827-745964469b-cskkx |
Started |
Started container ensemble-graph-c1827 | |
kserve-ci-e2e-test |
multus |
ensemble-graph-c1827-745964469b-cskkx |
AddedInterface |
Add eth0 [10.132.0.33/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-65928-767fdc487-v7j4m |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-10598 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-10598": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-10598": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c1827-predictor-5fccd85d8c-9dtwm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-10598-predictor-756678795d |
SuccessfulCreate |
Created pod: success-200-isvc-10598-predictor-756678795d-kb629 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-10598-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-10598-predictor-756678795d from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-10598 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-10598": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-10598": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-10598 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-10598": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
error-404-isvc-10598-predictor-577cdb5f5f-xf8dr |
AddedInterface |
Add eth0 [10.132.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c1827-predictor-64748d747d-75nl8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-10598-predictor-577cdb5f5f |
SuccessfulCreate |
Created pod: error-404-isvc-10598-predictor-577cdb5f5f-xf8dr | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-10598-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-10598-predictor-577cdb5f5f from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c1827-predictor-64748d747d-75nl8 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-10598-predictor-756678795d-kb629 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-10598-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-10598 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-10598": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c1827-predictor-5fccd85d8c-9dtwm |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-c1827-745964469b-cskkx |
Killing |
Stopping container ensemble-graph-c1827 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-10598-predictor-756678795d-kb629 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-10598-predictor-756678795d-kb629 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-10598-predictor-756678795d-kb629 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-10598-predictor-577cdb5f5f-xf8dr |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-10598-predictor-577cdb5f5f-xf8dr |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-10598-predictor-756678795d-kb629 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-10598-predictor-756678795d-kb629 |
AddedInterface |
Add eth0 [10.133.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-10598-predictor-577cdb5f5f-xf8dr |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-10598-predictor-577cdb5f5f-xf8dr |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-10598-predictor-756678795d-kb629 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-2001" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-10598-predictor-756678795d-kb629 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-10598-predictor-577cdb5f5f-xf8dr |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-2001" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-10598-predictor-577cdb5f5f-xf8dr |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c1827-predictor-5fccd85d8c-9dtwm |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.31:8643/healthz": dial tcp 10.132.0.31:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-31957-predictor-5657f8887-srjcj |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.32:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-31957-predictor-bb49bf486-kkdf8 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.24:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-31957-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-31957-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-31957 |
InferenceServiceReady |
InferenceService [success-200-isvc-31957] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-31957 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-31957 |
InferenceServiceReady |
InferenceService [error-404-isvc-31957] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-31957 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-10598-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-10598-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-31957-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
sequence-graph-31957-5d489cff66-4lgrj |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-31957-serving-cert" not found | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-31957-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-31957-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-31957-5d489cff66 |
SuccessfulCreate |
Created pod: sequence-graph-31957-5d489cff66-4lgrj | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-31957 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-31957-5d489cff66 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-31957 |
InferenceGraphReady |
InferenceGraph [sequence-graph-31957] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-31957-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
sequence-graph-31957-5d489cff66-4lgrj |
Created |
Created container: sequence-graph-31957 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-c1827-745964469b-cskkx |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
sequence-graph-31957-5d489cff66-4lgrj |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:541f5925144e7631a56252a58e1f72ffb46442ac12f9e86de1bc012876dee338" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-31957-5d489cff66-4lgrj |
Started |
Started container sequence-graph-31957 | |
kserve-ci-e2e-test |
multus |
sequence-graph-31957-5d489cff66-4lgrj |
AddedInterface |
Add eth0 [10.132.0.35/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-10598-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-10598-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-31957-predictor-bb49bf486-kkdf8 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-c4e90-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-c4e90-predictor-7889b4769d from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c4e90-predictor-555f9566bc-fnlzr |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-c4e90-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-c4e90-predictor-7889b4769d |
SuccessfulCreate |
Created pod: success-200-isvc-c4e90-predictor-7889b4769d-6wm5n | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-31957-predictor-5657f8887-srjcj |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-31957-predictor-bb49bf486-kkdf8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-31957-predictor-5657f8887-srjcj |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-c4e90-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-c4e90-predictor-555f9566bc from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-31957-5d489cff66-4lgrj |
Killing |
Stopping container sequence-graph-31957 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-c4e90-predictor-555f9566bc |
SuccessfulCreate |
Created pod: error-404-isvc-c4e90-predictor-555f9566bc-fnlzr | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c4e90-predictor-7889b4769d-6wm5n |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c4e90-predictor-7889b4769d-6wm5n |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c4e90-predictor-7889b4769d-6wm5n |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c4e90-predictor-555f9566bc-fnlzr |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c4e90-predictor-555f9566bc-fnlzr |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c4e90-predictor-555f9566bc-fnlzr |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c4e90-predictor-555f9566bc-fnlzr |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-2001" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-c4e90-predictor-555f9566bc-fnlzr |
AddedInterface |
Add eth0 [10.132.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c4e90-predictor-7889b4769d-6wm5n |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c4e90-predictor-7889b4769d-6wm5n |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c4e90-predictor-7889b4769d-6wm5n |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-2001" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-c4e90-predictor-7889b4769d-6wm5n |
AddedInterface |
Add eth0 [10.133.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c4e90-predictor-555f9566bc-fnlzr |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c4e90-predictor-555f9566bc-fnlzr |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-31957-predictor-5657f8887-srjcj |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.32:8643/healthz": dial tcp 10.132.0.32:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-10598 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-10598 |
InferenceServiceReady |
InferenceService [error-404-isvc-10598] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-10598 |
InferenceServiceReady |
InferenceService [success-200-isvc-10598] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-10598 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c4e90-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c4e90-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-10598-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-10598 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-10598] is Ready | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-10598-647cf68fb6-9lwpp |
Started |
Started container ensemble-graph-10598 | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-10598 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-10598-647cf68fb6 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-10598-647cf68fb6-9lwpp |
Created |
Created container: ensemble-graph-10598 | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-10598-647cf68fb6 |
SuccessfulCreate |
Created pod: ensemble-graph-10598-647cf68fb6-9lwpp | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-10598-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-10598-647cf68fb6-9lwpp |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:541f5925144e7631a56252a58e1f72ffb46442ac12f9e86de1bc012876dee338" already present on machine | |
kserve-ci-e2e-test |
multus |
ensemble-graph-10598-647cf68fb6-9lwpp |
AddedInterface |
Add eth0 [10.132.0.37/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-31957-5d489cff66-4lgrj |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-10598-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-10598 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-c4e90-predictor-7889b4769d-6wm5n |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.26:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-10598 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-c4e90-predictor-555f9566bc-fnlzr |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.36:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-10598-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c4e90-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c4e90-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c4e90 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c4e90 |
InferenceServiceReady |
InferenceService [error-404-isvc-c4e90] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c4e90 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c4e90 |
InferenceServiceReady |
InferenceService [success-200-isvc-c4e90] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-c4e90-775bbd874f |
SuccessfulCreate |
Created pod: sequence-graph-c4e90-775bbd874f-t68tg | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-c4e90 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-c4e90-775bbd874f from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-c4e90 |
InferenceGraphReady |
InferenceGraph [sequence-graph-c4e90] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-c4e90-775bbd874f-t68tg |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:541f5925144e7631a56252a58e1f72ffb46442ac12f9e86de1bc012876dee338" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-c4e90-775bbd874f-t68tg |
Created |
Created container: sequence-graph-c4e90 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-c4e90-775bbd874f-t68tg |
Started |
Started container sequence-graph-c4e90 | |
kserve-ci-e2e-test |
multus |
sequence-graph-c4e90-775bbd874f-t68tg |
AddedInterface |
Add eth0 [10.132.0.38/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c4e90-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c4e90-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c4e90-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c4e90-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-c4e90 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-c4e90 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-10598-647cf68fb6-9lwpp |
Killing |
Stopping container ensemble-graph-10598 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-10598-predictor-756678795d-kb629 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-77f5f-predictor-844f655df8-cpff7 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-77f5f-predictor-844f655df8-cpff7 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-2001" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-77f5f-predictor-844f655df8-cpff7 |
AddedInterface |
Add eth0 [10.133.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-10598-predictor-756678795d-kb629 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-77f5f-predictor-844f655df8-cpff7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-10598-predictor-577cdb5f5f-xf8dr |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-77f5f-predictor-844f655df8-cpff7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-77f5f-predictor-844f655df8-cpff7 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-77f5f-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-77f5f-predictor-6995f557bc from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-77f5f-predictor-844f655df8-cpff7 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-77f5f-predictor-844f655df8 |
SuccessfulCreate |
Created pod: success-200-isvc-77f5f-predictor-844f655df8-cpff7 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-77f5f-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-77f5f-predictor-844f655df8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-77f5f-predictor-6995f557bc-s5ttt |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-77f5f-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-77f5f-predictor-6995f557bc |
SuccessfulCreate |
Created pod: error-404-isvc-77f5f-predictor-6995f557bc-s5ttt | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-10598-predictor-577cdb5f5f-xf8dr |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-77f5f-predictor-6995f557bc-s5ttt |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-77f5f-predictor-6995f557bc-s5ttt |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-77f5f-predictor-6995f557bc-s5ttt |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-77f5f-predictor-6995f557bc-s5ttt |
AddedInterface |
Add eth0 [10.132.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-77f5f-predictor-6995f557bc-s5ttt |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-2001" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-77f5f-predictor-6995f557bc-s5ttt |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-77f5f-predictor-6995f557bc-s5ttt |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-10598-predictor-756678795d-kb629 |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.25:8643/healthz": dial tcp 10.133.0.25:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-10598-predictor-577cdb5f5f-xf8dr |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.34:8643/healthz": dial tcp 10.132.0.34:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-10598-predictor-577cdb5f5f-xf8dr |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.34:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-10598-predictor-756678795d-kb629 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.25:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-77f5f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-77f5f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-10598-647cf68fb6-9lwpp |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-77f5f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-77f5f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
sequence-graph-c4e90-775bbd874f-t68tg |
Killing |
Stopping container sequence-graph-c4e90 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-29aad-predictor-658758c67f-4c92z |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-29aad-predictor-6f6bfbbb58-gqwmr |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-29aad-predictor-658758c67f-4c92z |
AddedInterface |
Add eth0 [10.132.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-29aad-predictor-6f6bfbbb58 |
SuccessfulCreate |
Created pod: success-200-isvc-29aad-predictor-6f6bfbbb58-gqwmr | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-29aad-predictor-658758c67f-4c92z |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-29aad-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-29aad-predictor-658758c67f from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-29aad-predictor-658758c67f-4c92z |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-29aad-predictor-6f6bfbbb58-gqwmr |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-29aad-predictor-6f6bfbbb58-gqwmr |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-29aad-predictor-658758c67f-4c92z |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-2001" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-29aad-predictor-658758c67f |
SuccessfulCreate |
Created pod: error-404-isvc-29aad-predictor-658758c67f-4c92z | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c4e90-predictor-555f9566bc-fnlzr |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-29aad-predictor-6f6bfbbb58-gqwmr |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-29aad-predictor-6f6bfbbb58-gqwmr |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-29aad-predictor-6f6bfbbb58-gqwmr |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-2001" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c4e90-predictor-7889b4769d-6wm5n |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c4e90-predictor-7889b4769d-6wm5n |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-29aad-predictor-6f6bfbbb58-gqwmr |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-29aad-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-29aad-predictor-6f6bfbbb58 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c4e90-predictor-555f9566bc-fnlzr |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-29aad-predictor-658758c67f-4c92z |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-29aad-predictor-658758c67f-4c92z |
Created |
Created container: kube-rbac-proxy | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-77f5f-predictor-6995f557bc-s5ttt |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.39:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-77f5f-predictor-844f655df8-cpff7 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.27:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-77f5f |
InferenceServiceReady |
InferenceService [success-200-isvc-77f5f] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-77f5f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-77f5f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-77f5f |
InferenceServiceReady |
InferenceService [error-404-isvc-77f5f] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-29aad-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-29aad-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-77f5f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-77f5f-d7ff746f7 |
SuccessfulCreate |
Created pod: splitter-graph-77f5f-d7ff746f7-hwnc6 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-77f5f-d7ff746f7-hwnc6 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-77f5f-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-77f5f |
InferenceGraphReady |
InferenceGraph [splitter-graph-77f5f] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-77f5f |
ScalingReplicaSet |
Scaled up replica set splitter-graph-77f5f-d7ff746f7 from 0 to 1 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-77f5f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-77f5f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-77f5f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
multus |
splitter-graph-77f5f-d7ff746f7-hwnc6 |
AddedInterface |
Add eth0 [10.132.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-77f5f-d7ff746f7-hwnc6 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:541f5925144e7631a56252a58e1f72ffb46442ac12f9e86de1bc012876dee338" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-77f5f-d7ff746f7-hwnc6 |
Created |
Created container: splitter-graph-77f5f | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-77f5f-d7ff746f7-hwnc6 |
Started |
Started container splitter-graph-77f5f | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-c4e90-775bbd874f-t68tg |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-29aad-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-29aad-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5a2c4-predictor-656b55656b-85ql9 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-5a2c4-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-77f5f-predictor-844f655df8-cpff7 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-5a2c4-predictor-7d688b9859 |
SuccessfulCreate |
Created pod: error-404-isvc-5a2c4-predictor-7d688b9859-9flbs | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-5a2c4-predictor-656b55656b |
SuccessfulCreate |
Created pod: success-200-isvc-5a2c4-predictor-656b55656b-85ql9 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-5a2c4-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-5a2c4-predictor-7d688b9859 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-77f5f-d7ff746f7-hwnc6 |
Killing |
Stopping container splitter-graph-77f5f | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-5a2c4-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-5a2c4-predictor-656b55656b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-77f5f-predictor-6995f557bc-s5ttt |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-77f5f-predictor-6995f557bc-s5ttt |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-77f5f-predictor-844f655df8-cpff7 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5a2c4-predictor-656b55656b-85ql9 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5a2c4-predictor-7d688b9859-9flbs |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5a2c4-predictor-7d688b9859-9flbs |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-5a2c4-predictor-656b55656b-85ql9 |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5a2c4-predictor-7d688b9859-9flbs |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-2001" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5a2c4-predictor-7d688b9859-9flbs |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5a2c4-predictor-656b55656b-85ql9 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-5a2c4-predictor-7d688b9859-9flbs |
AddedInterface |
Add eth0 [10.132.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5a2c4-predictor-656b55656b-85ql9 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-2001" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5a2c4-predictor-656b55656b-85ql9 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5a2c4-predictor-656b55656b-85ql9 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5a2c4-predictor-656b55656b-85ql9 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5a2c4-predictor-7d688b9859-9flbs |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5a2c4-predictor-7d688b9859-9flbs |
Started |
Started container kube-rbac-proxy | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-29aad-predictor-6f6bfbbb58-gqwmr |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.28:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-29aad-predictor-658758c67f-4c92z |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.40:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-29aad |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-29aad |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-29aad |
InferenceServiceReady |
InferenceService [success-200-isvc-29aad] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-29aad |
InferenceServiceReady |
InferenceService [error-404-isvc-29aad] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-29aad-74c87f6b5c-t62mf |
Created |
Created container: switch-graph-29aad | |
kserve-ci-e2e-test |
multus |
switch-graph-29aad-74c87f6b5c-t62mf |
AddedInterface |
Add eth0 [10.132.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-29aad |
InferenceGraphReady |
InferenceGraph [switch-graph-29aad] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-29aad |
ScalingReplicaSet |
Scaled up replica set switch-graph-29aad-74c87f6b5c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-29aad-74c87f6b5c |
SuccessfulCreate |
Created pod: switch-graph-29aad-74c87f6b5c-t62mf | |
kserve-ci-e2e-test |
kubelet |
switch-graph-29aad-74c87f6b5c-t62mf |
Started |
Started container switch-graph-29aad | |
kserve-ci-e2e-test |
kubelet |
switch-graph-29aad-74c87f6b5c-t62mf |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:541f5925144e7631a56252a58e1f72ffb46442ac12f9e86de1bc012876dee338" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-77f5f-d7ff746f7-hwnc6 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-5a2c4-predictor-7d688b9859-9flbs |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.42:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-5a2c4-predictor-656b55656b-85ql9 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.29:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-29aad |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-29aad |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-29aad-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-29aad-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5a2c4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5a2c4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5a2c4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5a2c4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-5a2c4 |
InferenceServiceReady |
InferenceService [error-404-isvc-5a2c4] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-5a2c4 |
InferenceServiceReady |
InferenceService [success-200-isvc-5a2c4] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-5a2c4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-5a2c4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-29aad |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-29aad-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-29aad-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-29aad |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-5a2c4 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-5a2c4-77c5594cb8 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-5a2c4-77c5594cb8 |
SuccessfulCreate |
Created pod: splitter-graph-5a2c4-77c5594cb8-l58pz | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-5a2c4 |
InferenceGraphReady |
InferenceGraph [splitter-graph-5a2c4] is Ready | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-5a2c4-77c5594cb8-l58pz |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:541f5925144e7631a56252a58e1f72ffb46442ac12f9e86de1bc012876dee338" already present on machine | |
kserve-ci-e2e-test |
multus |
splitter-graph-5a2c4-77c5594cb8-l58pz |
AddedInterface |
Add eth0 [10.132.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-5a2c4-77c5594cb8-l58pz |
Started |
Started container splitter-graph-5a2c4 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-5a2c4-77c5594cb8-l58pz |
Created |
Created container: splitter-graph-5a2c4 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5a2c4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-5a2c4 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5a2c4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5a2c4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5a2c4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-5a2c4 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-5a2c4 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-5a2c4 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-5a2c4-77c5594cb8-l58pz |
Killing |
Stopping container splitter-graph-5a2c4 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5a2c4-predictor-7d688b9859-9flbs |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5a2c4-predictor-7d688b9859-9flbs |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5a2c4-predictor-656b55656b-85ql9 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5a2c4-predictor-656b55656b-85ql9 |
Killing |
Stopping container kube-rbac-proxy | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-5a2c4-77c5594cb8-l58pz |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-29aad-predictor-6f6bfbbb58-gqwmr |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-29aad-predictor-658758c67f-4c92z |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-29aad-predictor-6f6bfbbb58-gqwmr |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
switch-graph-29aad-74c87f6b5c-t62mf |
Killing |
Stopping container switch-graph-29aad | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-29aad-predictor-658758c67f-4c92z |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-29aad-predictor-6f6bfbbb58-gqwmr |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.28:8643/healthz": dial tcp 10.133.0.28:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-29aad-predictor-658758c67f-4c92z |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.40:8643/healthz": dial tcp 10.132.0.40:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-29aad-74c87f6b5c-t62mf |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |