| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
success-200-isvc-77aa3-predictor-869969f59f-rj546 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-77aa3-predictor-869969f59f-rj546 to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-34ebc-predictor-86f8b97c9-5m7wn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-34ebc-predictor-86f8b97c9-5m7wn to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-d6b08-56b6fff7d5-vhpwk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-d6b08-56b6fff7d5-vhpwk to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-d1618-predictor-6fb8c89d7d-hw5v8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-d1618-predictor-6fb8c89d7d-hw5v8 to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-896ee-predictor-5f4cdb868-wh8tt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-896ee-predictor-5f4cdb868-wh8tt to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-d6b08-predictor-6878886558-5kjcn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-d6b08-predictor-6878886558-5kjcn to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-6b7b849495-2wvqc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-6b7b849495-2wvqc to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-48fe0-57cb8d9dbf-qqrpz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-48fe0-57cb8d9dbf-qqrpz to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz to ip-10-0-138-0.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-9304d-predictor-5d68f6d5bb-rsq9j |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-9304d-predictor-5d68f6d5bb-rsq9j to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-34ebc-68f4d685-tf2f7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-34ebc-68f4d685-tf2f7 to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-9b322-98666c944-8jgzm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-9b322-98666c944-8jgzm to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-77aa3-6b8c46f78b-8qdqb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-77aa3-6b8c46f78b-8qdqb to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-9304d-6745589549-52c2s |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-9304d-6745589549-52c2s to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-77aa3-predictor-67dd777c88-wqrtn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-77aa3-predictor-67dd777c88-wqrtn to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-896ee-7c6fcdd6fb-r7wgr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-896ee-7c6fcdd6fb-r7wgr to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-ba55b-predictor-578475f44-lgsng |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-ba55b-predictor-578475f44-lgsng to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-ba55b-7558d56dd-crnz5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-ba55b-7558d56dd-crnz5 to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-d1618-57bb6975c5-jrx8r |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-d1618-57bb6975c5-jrx8r to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-df329-predictor-7d679b95bb-4zvtz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-df329-predictor-7d679b95bb-4zvtz to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-df329-65d797bb8c-r45qz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-df329-65d797bb8c-r45qz to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-48fe0-predictor-7c696bdf47-xmhn9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-48fe0-predictor-7c696bdf47-xmhn9 to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-34ebc-predictor-59d677957b-wtgd2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-34ebc-predictor-59d677957b-wtgd2 to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-896ee-predictor-7ddbb75dc5-vz24p |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-896ee-predictor-7ddbb75dc5-vz24p to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-9b322-predictor-56ff68b897-sfxwq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-9b322-predictor-56ff68b897-sfxwq to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-ba55b-predictor-575d4874b7-tx7wh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-ba55b-predictor-575d4874b7-tx7wh to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-48fe0-predictor-87d87457b-zm2hn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-48fe0-predictor-87d87457b-zm2hn to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-9304d-predictor-768c4cd6d5-mrzj5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-9304d-predictor-768c4cd6d5-mrzj5 to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-df329-predictor-84bcc6b5bf-96thc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-df329-predictor-84bcc6b5bf-96thc to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-745b467f-g9mb6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-745b467f-g9mb6 to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-d6b08-predictor-7ff55c75f7-t5xsf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-d6b08-predictor-7ff55c75f7-t5xsf to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-d1618-predictor-6bf69b6c7-q5mvp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-d1618-predictor-6bf69b6c7-q5mvp to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-9b322-predictor-657656b8f8-qjlvl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-9b322-predictor-657656b8f8-qjlvl to ip-10-0-129-73.ec2.internal | ||
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-ba55b-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-ba55b-predictor-575d4874b7 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-ba55b-predictor-575d4874b7 |
SuccessfulCreate |
Created pod: success-200-isvc-ba55b-predictor-575d4874b7-tx7wh | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-54dd4fbd97 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ba55b-predictor-575d4874b7-tx7wh |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-ba55b-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-54dd4fbd97 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx | |
kserve-ci-e2e-test |
multus |
success-200-isvc-ba55b-predictor-575d4874b7-tx7wh |
AddedInterface |
Add eth0 [10.134.0.19/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
error-404-isvc-ba55b-predictor-578475f44-lgsng |
AddedInterface |
Add eth0 [10.134.0.21/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-6ff47cbb9d |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-ba55b-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-ba55b-predictor-578475f44 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:e7d18b8520466922c73925c5601004b31b3c3ec90f89a0821d13bdeee1848812" | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-745b467f |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-745b467f-g9mb6 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-745b467f from 0 to 1 | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx |
AddedInterface |
Add eth0 [10.134.0.20/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-ba55b-predictor-578475f44 |
SuccessfulCreate |
Created pod: error-404-isvc-ba55b-predictor-578475f44-lgsng | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ba55b-predictor-575d4874b7-tx7wh |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1724" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ba55b-predictor-578475f44-lgsng |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1724" | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-6ff47cbb9d from 0 to 1 | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-745b467f-g9mb6 |
AddedInterface |
Add eth0 [10.134.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:e7d18b8520466922c73925c5601004b31b3c3ec90f89a0821d13bdeee1848812" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-745b467f-g9mb6 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:e7d18b8520466922c73925c5601004b31b3c3ec90f89a0821d13bdeee1848812" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:e7d18b8520466922c73925c5601004b31b3c3ec90f89a0821d13bdeee1848812" in 3.353s (3.353s including waiting). Image size: 302769600 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:e7d18b8520466922c73925c5601004b31b3c3ec90f89a0821d13bdeee1848812" in 13.777s (13.777s including waiting). Image size: 302769600 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-745b467f-g9mb6 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:e7d18b8520466922c73925c5601004b31b3c3ec90f89a0821d13bdeee1848812" in 16.399s (16.399s including waiting). Image size: 302769600 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ba55b-predictor-578475f44-lgsng |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1724" in 18.793s (18.793s including waiting). Image size: 1334725746 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-745b467f-g9mb6 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ba55b-predictor-575d4874b7-tx7wh |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1724" in 18.702s (18.702s including waiting). Image size: 1335784057 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ba55b-predictor-575d4874b7-tx7wh |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ba55b-predictor-578475f44-lgsng |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ba55b-predictor-578475f44-lgsng |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ba55b-predictor-578475f44-lgsng |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ba55b-predictor-575d4874b7-tx7wh |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ba55b-predictor-575d4874b7-tx7wh |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-745b467f-g9mb6 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ba55b-predictor-575d4874b7-tx7wh |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ba55b-predictor-578475f44-lgsng |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ba55b-predictor-578475f44-lgsng |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.55s (2.55s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ba55b-predictor-578475f44-lgsng |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ba55b-predictor-575d4874b7-tx7wh |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.562s (2.562s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ba55b-predictor-575d4874b7-tx7wh |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1724" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-745b467f-g9mb6 |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1724" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 20.938s (20.938s including waiting). Image size: 1305567991 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-745b467f-g9mb6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-745b467f-g9mb6 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1724" in 6.394s (6.394s including waiting). Image size: 1560931772 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-745b467f-g9mb6 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-745b467f-g9mb6 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-745b467f-g9mb6 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-745b467f-g9mb6 |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1724" in 6.408s (6.408s including waiting). Image size: 1560931772 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.467s (2.467s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz |
Started |
Started container kube-rbac-proxy | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ba55b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ba55b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-ba55b-predictor-575d4874b7-tx7wh |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.19:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ba55b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ba55b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-ba55b-predictor-578475f44-lgsng |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.21:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ba55b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ba55b |
InferenceServiceReady |
InferenceService [success-200-isvc-ba55b] is Ready | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ba55b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ba55b |
InferenceServiceReady |
InferenceService [error-404-isvc-ba55b] is Ready | |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-745b467f-g9mb6 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.22:8080: connect: connection refused |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-ba55b |
UpdateFailed |
Failed to update status for InferenceGraph "switch-graph-ba55b": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-ba55b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
switch-graph-ba55b-7558d56dd-crnz5 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-ba55b-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-ba55b |
ScalingReplicaSet |
Scaled up replica set switch-graph-ba55b-7558d56dd from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-ba55b |
InferenceGraphReady |
InferenceGraph [switch-graph-ba55b] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ba55b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ba55b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-ba55b |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-ba55b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-ba55b-7558d56dd |
SuccessfulCreate |
Created pod: switch-graph-ba55b-7558d56dd-crnz5 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ba55b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ba55b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.29:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
switch-graph-ba55b-7558d56dd-crnz5 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:8b2b640cecca2c5abab08a86fa1fe077f2518209438c00eb88348417ca75cab6" | |
kserve-ci-e2e-test |
multus |
switch-graph-ba55b-7558d56dd-crnz5 |
AddedInterface |
Add eth0 [10.134.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-ba55b-7558d56dd-crnz5 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:8b2b640cecca2c5abab08a86fa1fe077f2518209438c00eb88348417ca75cab6" in 2.191s (2.191s including waiting). Image size: 218009189 bytes. | |
kserve-ci-e2e-test |
kubelet |
switch-graph-ba55b-7558d56dd-crnz5 |
Started |
Started container switch-graph-ba55b | |
kserve-ci-e2e-test |
kubelet |
switch-graph-ba55b-7558d56dd-crnz5 |
Created |
Created container: switch-graph-ba55b | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-d6b08-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-d6b08-predictor-7ff55c75f7 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-ba55b-7558d56dd-crnz5 |
Killing |
Stopping container switch-graph-ba55b | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d6b08 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-d6b08": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d6b08 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-d6b08": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-d6b08": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d6b08-predictor-6878886558-5kjcn |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d6b08-predictor-6878886558-5kjcn |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d6b08-predictor-7ff55c75f7-t5xsf |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d6b08-predictor-7ff55c75f7-t5xsf |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d6b08-predictor-7ff55c75f7-t5xsf |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d6b08 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-d6b08": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d6b08 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-d6b08": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-d6b08": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
success-200-isvc-d6b08-predictor-7ff55c75f7-t5xsf |
AddedInterface |
Add eth0 [10.134.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-d6b08-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-d6b08-predictor-6878886558 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ba55b-predictor-575d4874b7-tx7wh |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ba55b-predictor-575d4874b7-tx7wh |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d6b08-predictor-6878886558-5kjcn |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d6b08-predictor-7ff55c75f7-t5xsf |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1724" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d6b08-predictor-7ff55c75f7-t5xsf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d6b08-predictor-6878886558-5kjcn |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d6b08-predictor-7ff55c75f7-t5xsf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ba55b-predictor-575d4874b7-tx7wh |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.19:8643/healthz": dial tcp 10.134.0.19:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d6b08-predictor-6878886558-5kjcn |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1724" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-d6b08-predictor-6878886558-5kjcn |
AddedInterface |
Add eth0 [10.134.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-d6b08-predictor-7ff55c75f7 |
SuccessfulCreate |
Created pod: success-200-isvc-d6b08-predictor-7ff55c75f7-t5xsf | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ba55b-predictor-578475f44-lgsng |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ba55b-predictor-578475f44-lgsng |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d6b08-predictor-6878886558-5kjcn |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-d6b08-predictor-6878886558 |
SuccessfulCreate |
Created pod: error-404-isvc-d6b08-predictor-6878886558-5kjcn | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d6b08-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d6b08-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-6b7b849495 |
SuccessfulCreate |
Created pod: model-chainer-6b7b849495-2wvqc | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-6b7b849495 from 0 to 1 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-ba55b-7558d56dd-crnz5 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
kubelet |
model-chainer-6b7b849495-2wvqc |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-6b7b849495-2wvqc |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
multus |
model-chainer-6b7b849495-2wvqc |
AddedInterface |
Add eth0 [10.134.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
model-chainer-6b7b849495-2wvqc |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8b2b640cecca2c5abab08a86fa1fe077f2518209438c00eb88348417ca75cab6" already present on machine | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
model-chainer-6b7b849495-2wvqc |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-745b467f-g9mb6 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-34ebc-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-34ebc-predictor-86f8b97c9 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-745b467f-g9mb6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-34ebc-predictor-86f8b97c9-5m7wn |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-34ebc-predictor-59d677957b-wtgd2 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1724" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-34ebc-predictor-86f8b97c9-5m7wn |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-34ebc-predictor-86f8b97c9-5m7wn |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-34ebc-predictor-86f8b97c9-5m7wn |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-34ebc-predictor-86f8b97c9-5m7wn |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-34ebc-predictor-59d677957b-wtgd2 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-34ebc-predictor-59d677957b-wtgd2 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-34ebc-predictor-59d677957b-wtgd2 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-34ebc-predictor-86f8b97c9-5m7wn |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1724" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-34ebc-predictor-86f8b97c9-5m7wn |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-34ebc-predictor-86f8b97c9 |
SuccessfulCreate |
Created pod: success-200-isvc-34ebc-predictor-86f8b97c9-5m7wn | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-34ebc-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-34ebc-predictor-59d677957b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-34ebc-predictor-59d677957b |
SuccessfulCreate |
Created pod: error-404-isvc-34ebc-predictor-59d677957b-wtgd2 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-34ebc-predictor-59d677957b-wtgd2 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-34ebc-predictor-59d677957b-wtgd2 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-6ff47cbb9d-rkhwz |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-34ebc-predictor-59d677957b-wtgd2 |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
| (x10) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.20:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-54dd4fbd97-nzxvx |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.20:8643/healthz": dial tcp 10.134.0.20:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-745b467f-g9mb6 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.22:8643/healthz": dial tcp 10.134.0.22:8643: connect: connection refused | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d6b08-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d6b08-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d6b08 |
InferenceServiceReady |
InferenceService [error-404-isvc-d6b08] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d6b08 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d6b08 |
InferenceServiceReady |
InferenceService [success-200-isvc-d6b08] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d6b08 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-6b7b849495-2wvqc |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-34ebc-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-34ebc-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-34ebc-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-34ebc-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d6b08-56b6fff7d5-vhpwk |
Created |
Created container: switch-graph-d6b08 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d6b08-56b6fff7d5-vhpwk |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8b2b640cecca2c5abab08a86fa1fe077f2518209438c00eb88348417ca75cab6" already present on machine | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-d6b08 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-d6b08": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-d6b08 |
UpdateFailed |
Failed to update status for InferenceGraph "switch-graph-d6b08": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-d6b08": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
switch-graph-d6b08-56b6fff7d5-vhpwk |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d6b08-56b6fff7d5-vhpwk |
Started |
Started container switch-graph-d6b08 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-d6b08-56b6fff7d5 |
SuccessfulCreate |
Created pod: switch-graph-d6b08-56b6fff7d5-vhpwk | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-d6b08 |
ScalingReplicaSet |
Scaled up replica set switch-graph-d6b08-56b6fff7d5 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-d6b08 |
InferenceGraphReady |
InferenceGraph [switch-graph-d6b08] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-34ebc |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-34ebc |
InferenceServiceReady |
InferenceService [error-404-isvc-34ebc] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-34ebc |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-34ebc |
InferenceServiceReady |
InferenceService [success-200-isvc-34ebc] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d6b08-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d6b08-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d6b08-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d6b08-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-34ebc |
ScalingReplicaSet |
Scaled up replica set sequence-graph-34ebc-68f4d685 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-34ebc-68f4d685 |
SuccessfulCreate |
Created pod: sequence-graph-34ebc-68f4d685-tf2f7 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-34ebc |
InferenceGraphReady |
InferenceGraph [sequence-graph-34ebc] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-34ebc-68f4d685-tf2f7 |
Started |
Started container sequence-graph-34ebc | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-34ebc-68f4d685-tf2f7 |
Created |
Created container: sequence-graph-34ebc | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-34ebc-68f4d685-tf2f7 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8b2b640cecca2c5abab08a86fa1fe077f2518209438c00eb88348417ca75cab6" already present on machine | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-34ebc-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-34ebc-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
multus |
sequence-graph-34ebc-68f4d685-tf2f7 |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-34ebc-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-34ebc-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-d6b08 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-d6b08 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-34ebc |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-34ebc |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-48fe0-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-48fe0-predictor-7c696bdf47 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-48fe0 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-48fe0": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-48fe0": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-48fe0 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-48fe0": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
switch-graph-d6b08-56b6fff7d5-vhpwk |
Killing |
Stopping container switch-graph-d6b08 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d6b08-predictor-6878886558-5kjcn |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-48fe0 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-48fe0": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-48fe0": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-48fe0 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-48fe0": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-48fe0-predictor-7c696bdf47-xmhn9 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-48fe0-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-48fe0-predictor-7c696bdf47 |
SuccessfulCreate |
Created pod: success-200-isvc-48fe0-predictor-7c696bdf47-xmhn9 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-48fe0-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-48fe0-predictor-87d87457b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-48fe0-predictor-87d87457b |
SuccessfulCreate |
Created pod: error-404-isvc-48fe0-predictor-87d87457b-zm2hn | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-48fe0-predictor-87d87457b-zm2hn |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-48fe0-predictor-87d87457b-zm2hn |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-48fe0-predictor-87d87457b-zm2hn |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-48fe0-predictor-87d87457b-zm2hn |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-48fe0-predictor-87d87457b-zm2hn |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-48fe0-predictor-87d87457b-zm2hn |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1724" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-48fe0-predictor-87d87457b-zm2hn |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d6b08-predictor-6878886558-5kjcn |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d6b08-predictor-7ff55c75f7-t5xsf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d6b08-predictor-7ff55c75f7-t5xsf |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-48fe0-predictor-7c696bdf47-xmhn9 |
Started |
Started container kube-rbac-proxy | |
| (x8) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-d6b08-predictor-6878886558-5kjcn |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.25:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-48fe0-predictor-7c696bdf47-xmhn9 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-48fe0-predictor-7c696bdf47-xmhn9 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-48fe0-predictor-7c696bdf47-xmhn9 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-48fe0-predictor-7c696bdf47-xmhn9 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-48fe0-predictor-7c696bdf47-xmhn9 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1724" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d6b08-predictor-6878886558-5kjcn |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.25:8643/healthz": dial tcp 10.134.0.25:8643: connect: connection refused | |
kserve-ci-e2e-test |
multus |
success-200-isvc-48fe0-predictor-7c696bdf47-xmhn9 |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
| (x8) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-d6b08-predictor-7ff55c75f7-t5xsf |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.24:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d6b08-predictor-7ff55c75f7-t5xsf |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.24:8643/healthz": dial tcp 10.134.0.24:8643: connect: connection refused | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9304d |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-9304d": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-34ebc-68f4d685-tf2f7 |
Killing |
Stopping container sequence-graph-34ebc | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9304d |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-9304d": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-9304d-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-9304d-predictor-5d68f6d5bb from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9304d |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-9304d": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-9304d": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-34ebc-predictor-59d677957b-wtgd2 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-9304d-predictor-768c4cd6d5 |
SuccessfulCreate |
Created pod: success-200-isvc-9304d-predictor-768c4cd6d5-mrzj5 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9304d |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-9304d": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-9304d": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-9304d-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-9304d-predictor-768c4cd6d5 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-34ebc-predictor-86f8b97c9-5m7wn |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-34ebc-predictor-86f8b97c9-5m7wn |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-34ebc-predictor-59d677957b-wtgd2 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9304d-predictor-768c4cd6d5-mrzj5 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9304d-predictor-5d68f6d5bb-rsq9j |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9304d-predictor-5d68f6d5bb-rsq9j |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9304d-predictor-5d68f6d5bb-rsq9j |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9304d-predictor-768c4cd6d5-mrzj5 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9304d-predictor-5d68f6d5bb-rsq9j |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1724" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-9304d-predictor-5d68f6d5bb |
SuccessfulCreate |
Created pod: error-404-isvc-9304d-predictor-5d68f6d5bb-rsq9j | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9304d-predictor-5d68f6d5bb-rsq9j |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9304d-predictor-768c4cd6d5-mrzj5 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9304d-predictor-768c4cd6d5-mrzj5 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9304d-predictor-768c4cd6d5-mrzj5 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1724" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9304d-predictor-768c4cd6d5-mrzj5 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9304d-predictor-5d68f6d5bb-rsq9j |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-9304d-predictor-768c4cd6d5-mrzj5 |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
error-404-isvc-9304d-predictor-5d68f6d5bb-rsq9j |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-d6b08-56b6fff7d5-vhpwk |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-34ebc-predictor-86f8b97c9-5m7wn |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.27:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-34ebc-predictor-86f8b97c9-5m7wn |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.27:8643/healthz": dial tcp 10.134.0.27:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-34ebc-predictor-59d677957b-wtgd2 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.28:8643/healthz": dial tcp 10.134.0.28:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-34ebc-predictor-59d677957b-wtgd2 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.28:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-48fe0-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-48fe0-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-48fe0-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-48fe0-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-48fe0-predictor-7c696bdf47-xmhn9 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.31:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-48fe0-predictor-87d87457b-zm2hn |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.32:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-34ebc-68f4d685-tf2f7 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9304d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9304d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9304d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9304d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-48fe0 |
InferenceServiceReady |
InferenceService [error-404-isvc-48fe0] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-48fe0 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-48fe0 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-48fe0 |
InferenceServiceReady |
InferenceService [success-200-isvc-48fe0] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-9304d-predictor-768c4cd6d5-mrzj5 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.33:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-9304d-predictor-5d68f6d5bb-rsq9j |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.34:8080: connect: connection refused |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-48fe0-57cb8d9dbf |
SuccessfulCreate |
Created pod: ensemble-graph-48fe0-57cb8d9dbf-qqrpz | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-48fe0 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-48fe0] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-48fe0 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-48fe0-57cb8d9dbf from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-48fe0-57cb8d9dbf-qqrpz |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-48fe0-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-48fe0-57cb8d9dbf-qqrpz |
Started |
Started container ensemble-graph-48fe0 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-48fe0-57cb8d9dbf-qqrpz |
Created |
Created container: ensemble-graph-48fe0 | |
kserve-ci-e2e-test |
multus |
ensemble-graph-48fe0-57cb8d9dbf-qqrpz |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-48fe0-57cb8d9dbf-qqrpz |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8b2b640cecca2c5abab08a86fa1fe077f2518209438c00eb88348417ca75cab6" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9304d |
InferenceServiceReady |
InferenceService [success-200-isvc-9304d] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9304d |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9304d |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9304d |
InferenceServiceReady |
InferenceService [error-404-isvc-9304d] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-48fe0-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-48fe0-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-48fe0-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-48fe0-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-9b322-predictor-56ff68b897 |
SuccessfulCreate |
Created pod: success-200-isvc-9b322-predictor-56ff68b897-sfxwq | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9b322 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-9b322": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-9b322": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9b322 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-9b322": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-48fe0-57cb8d9dbf-qqrpz |
Killing |
Stopping container ensemble-graph-48fe0 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-48fe0-predictor-87d87457b-zm2hn |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9b322-predictor-657656b8f8-qjlvl |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-9b322-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-48fe0-predictor-87d87457b-zm2hn |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-9b322-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-9b322-predictor-56ff68b897 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9b322 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-9b322": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-48fe0-predictor-7c696bdf47-xmhn9 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-9b322-predictor-657656b8f8 |
SuccessfulCreate |
Created pod: error-404-isvc-9b322-predictor-657656b8f8-qjlvl | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9b322 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-9b322": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-9b322": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-9b322-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-9b322-predictor-657656b8f8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-48fe0-predictor-7c696bdf47-xmhn9 |
Killing |
Stopping container kserve-container | |
| (x2) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-9b322-predictor-56ff68b897-sfxwq |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-9b322-predictor-serving-cert" not found |
kserve-ci-e2e-test |
multus |
error-404-isvc-9b322-predictor-657656b8f8-qjlvl |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9b322-predictor-657656b8f8-qjlvl |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9b322-predictor-657656b8f8-qjlvl |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9b322-predictor-657656b8f8-qjlvl |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9b322-predictor-657656b8f8-qjlvl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9b322-predictor-657656b8f8-qjlvl |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9b322-predictor-657656b8f8-qjlvl |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1724" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-9b322-predictor-56ff68b897-sfxwq |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9b322-predictor-56ff68b897-sfxwq |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-48fe0-predictor-7c696bdf47-xmhn9 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.31:8643/healthz": dial tcp 10.134.0.31:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9b322-predictor-56ff68b897-sfxwq |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9b322-predictor-56ff68b897-sfxwq |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9b322-predictor-56ff68b897-sfxwq |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1724" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9b322-predictor-56ff68b897-sfxwq |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9b322-predictor-56ff68b897-sfxwq |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-48fe0-predictor-87d87457b-zm2hn |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.32:8643/healthz": dial tcp 10.134.0.32:8643: connect: connection refused | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-9304d-6745589549 |
SuccessfulCreate |
Created pod: sequence-graph-9304d-6745589549-52c2s | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9304d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9304d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-9304d |
ScalingReplicaSet |
Scaled up replica set sequence-graph-9304d-6745589549 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-9304d |
InferenceGraphReady |
InferenceGraph [sequence-graph-9304d] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9304d-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
sequence-graph-9304d-6745589549-52c2s |
Started |
Started container sequence-graph-9304d | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9304d-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
multus |
sequence-graph-9304d-6745589549-52c2s |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-9304d-6745589549-52c2s |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8b2b640cecca2c5abab08a86fa1fe077f2518209438c00eb88348417ca75cab6" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-9304d-6745589549-52c2s |
Created |
Created container: sequence-graph-9304d | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-77aa3-predictor-869969f59f-rj546 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1724" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-77aa3-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-77aa3-predictor-869969f59f from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-77aa3-predictor-869969f59f-rj546 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9304d-predictor-5d68f6d5bb-rsq9j |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-77aa3 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-77aa3": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-77aa3-predictor-869969f59f-rj546 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-77aa3-predictor-869969f59f-rj546 |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-77aa3 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-77aa3": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-77aa3": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9304d-predictor-768c4cd6d5-mrzj5 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9304d-predictor-768c4cd6d5-mrzj5 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-9304d-6745589549-52c2s |
Killing |
Stopping container sequence-graph-9304d | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-77aa3-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-77aa3-predictor-67dd777c88 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-77aa3-predictor-67dd777c88-wqrtn |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-77aa3-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-77aa3-predictor-67dd777c88 |
SuccessfulCreate |
Created pod: error-404-isvc-77aa3-predictor-67dd777c88-wqrtn | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9304d-predictor-5d68f6d5bb-rsq9j |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-77aa3-predictor-869969f59f |
SuccessfulCreate |
Created pod: success-200-isvc-77aa3-predictor-869969f59f-rj546 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-77aa3-predictor-869969f59f-rj546 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-77aa3-predictor-67dd777c88-wqrtn |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-77aa3-predictor-67dd777c88-wqrtn |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-77aa3-predictor-67dd777c88-wqrtn |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-77aa3-predictor-67dd777c88-wqrtn |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-77aa3-predictor-67dd777c88-wqrtn |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-77aa3-predictor-67dd777c88-wqrtn |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1724" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-77aa3-predictor-67dd777c88-wqrtn |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-77aa3-predictor-869969f59f-rj546 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-77aa3-predictor-869969f59f-rj546 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9304d-predictor-768c4cd6d5-mrzj5 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.33:8643/healthz": dial tcp 10.134.0.33:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9304d-predictor-5d68f6d5bb-rsq9j |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.34:8643/healthz": dial tcp 10.134.0.34:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-48fe0-57cb8d9dbf-qqrpz |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9b322-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9b322-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-9b322-predictor-56ff68b897-sfxwq |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.36:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-9304d-6745589549-52c2s |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9b322-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9b322-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-77aa3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-77aa3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9b322 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9b322 |
InferenceServiceReady |
InferenceService [success-200-isvc-9b322] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-77aa3-predictor-869969f59f-rj546 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.39:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9b322 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9b322 |
InferenceServiceReady |
InferenceService [error-404-isvc-9b322] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-9b322-98666c944 |
SuccessfulCreate |
Created pod: ensemble-graph-9b322-98666c944-8jgzm | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-9b322-98666c944-8jgzm |
Started |
Started container ensemble-graph-9b322 | |
kserve-ci-e2e-test |
multus |
ensemble-graph-9b322-98666c944-8jgzm |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-9b322-98666c944-8jgzm |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8b2b640cecca2c5abab08a86fa1fe077f2518209438c00eb88348417ca75cab6" already present on machine | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-9b322 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-9b322] is Ready | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-9b322-98666c944-8jgzm |
Created |
Created container: ensemble-graph-9b322 | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-9b322 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-9b322-98666c944 from 0 to 1 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-77aa3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-77aa3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-77aa3 |
InferenceServiceReady |
InferenceService [success-200-isvc-77aa3] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-77aa3 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9b322-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9b322-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-77aa3 |
InferenceServiceReady |
InferenceService [error-404-isvc-77aa3] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9b322-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9b322-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-77aa3 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-77aa3 |
InferenceGraphReady |
InferenceGraph [sequence-graph-77aa3] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-77aa3-6b8c46f78b-8qdqb |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8b2b640cecca2c5abab08a86fa1fe077f2518209438c00eb88348417ca75cab6" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-77aa3-6b8c46f78b-8qdqb |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-77aa3 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-77aa3-6b8c46f78b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-77aa3-6b8c46f78b |
SuccessfulCreate |
Created pod: sequence-graph-77aa3-6b8c46f78b-8qdqb | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-77aa3-6b8c46f78b-8qdqb |
Started |
Started container sequence-graph-77aa3 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-77aa3-6b8c46f78b-8qdqb |
Created |
Created container: sequence-graph-77aa3 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-9b322 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-9b322 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-77aa3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-77aa3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-77aa3 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-77aa3-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-77aa3-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-77aa3 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-9b322-98666c944-8jgzm |
Killing |
Stopping container ensemble-graph-9b322 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-896ee-predictor-5f4cdb868-wh8tt |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-896ee |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-896ee": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-896ee": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-896ee-predictor-7ddbb75dc5-vz24p |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-896ee-predictor-7ddbb75dc5-vz24p |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1724" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-896ee-predictor-7ddbb75dc5-vz24p |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-896ee |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-896ee": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-896ee |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-896ee": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-896ee": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-896ee-predictor-5f4cdb868-wh8tt |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-896ee-predictor-5f4cdb868-wh8tt |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-896ee-predictor-5f4cdb868-wh8tt |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1724" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-896ee-predictor-5f4cdb868-wh8tt |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-896ee-predictor-5f4cdb868-wh8tt |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-896ee-predictor-7ddbb75dc5-vz24p |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-896ee-predictor-5f4cdb868 |
SuccessfulCreate |
Created pod: error-404-isvc-896ee-predictor-5f4cdb868-wh8tt | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-896ee-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-896ee-predictor-5f4cdb868 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-896ee-predictor-7ddbb75dc5-vz24p |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9b322-predictor-657656b8f8-qjlvl |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9b322-predictor-657656b8f8-qjlvl |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-896ee-predictor-7ddbb75dc5-vz24p |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-896ee-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-896ee-predictor-7ddbb75dc5 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-896ee-predictor-7ddbb75dc5 |
SuccessfulCreate |
Created pod: success-200-isvc-896ee-predictor-7ddbb75dc5-vz24p | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-896ee-predictor-7ddbb75dc5-vz24p |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-896ee-predictor-5f4cdb868-wh8tt |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-896ee |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-896ee": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9b322-predictor-56ff68b897-sfxwq |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9b322-predictor-56ff68b897-sfxwq |
Killing |
Stopping container kserve-container | |
| (x8) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-9b322-predictor-657656b8f8-qjlvl |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.37:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9b322-predictor-657656b8f8-qjlvl |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.37:8643/healthz": dial tcp 10.134.0.37:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-77aa3-6b8c46f78b-8qdqb |
Killing |
Stopping container sequence-graph-77aa3 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-df329 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-df329": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-77aa3-predictor-67dd777c88-wqrtn |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-df329-predictor-84bcc6b5bf-96thc |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-df329-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-77aa3-predictor-869969f59f-rj546 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-df329-predictor-7d679b95bb-4zvtz |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-df329-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-df329-predictor-84bcc6b5bf |
SuccessfulCreate |
Created pod: success-200-isvc-df329-predictor-84bcc6b5bf-96thc | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-df329-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-df329-predictor-84bcc6b5bf from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-df329-predictor-7d679b95bb |
SuccessfulCreate |
Created pod: error-404-isvc-df329-predictor-7d679b95bb-4zvtz | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-df329-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-df329-predictor-7d679b95bb from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-77aa3-predictor-869969f59f-rj546 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-df329 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-df329": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-df329": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-77aa3-predictor-67dd777c88-wqrtn |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-df329-predictor-84bcc6b5bf-96thc |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-df329-predictor-7d679b95bb-4zvtz |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-df329-predictor-84bcc6b5bf-96thc |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-df329-predictor-7d679b95bb-4zvtz |
AddedInterface |
Add eth0 [10.134.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-df329-predictor-7d679b95bb-4zvtz |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1724" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-df329-predictor-7d679b95bb-4zvtz |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-df329-predictor-7d679b95bb-4zvtz |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-df329-predictor-7d679b95bb-4zvtz |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-df329-predictor-7d679b95bb-4zvtz |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-df329-predictor-84bcc6b5bf-96thc |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-df329-predictor-84bcc6b5bf-96thc |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-df329-predictor-84bcc6b5bf-96thc |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-df329-predictor-84bcc6b5bf-96thc |
AddedInterface |
Add eth0 [10.134.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-df329-predictor-84bcc6b5bf-96thc |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1724" already present on machine | |
| (x8) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-77aa3-predictor-67dd777c88-wqrtn |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.40:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-77aa3-predictor-67dd777c88-wqrtn |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.40:8643/healthz": dial tcp 10.134.0.40:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-9b322-98666c944-8jgzm |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-896ee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-896ee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-896ee-predictor-5f4cdb868-wh8tt |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.44:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-77aa3-6b8c46f78b-8qdqb |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-896ee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-896ee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-896ee |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-896ee-predictor-7ddbb75dc5-vz24p |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.43:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-896ee |
InferenceServiceReady |
InferenceService [error-404-isvc-896ee] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-896ee |
InferenceServiceReady |
InferenceService [success-200-isvc-896ee] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-896ee |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-896ee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-896ee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-df329-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-df329-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-df329-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-df329-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-df329-predictor-84bcc6b5bf-96thc |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.45:8080: connect: connection refused |
| (x8) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-df329-predictor-7d679b95bb-4zvtz |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.46:8080: connect: connection refused |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-896ee-7c6fcdd6fb |
SuccessfulCreate |
Created pod: splitter-graph-896ee-7c6fcdd6fb-r7wgr | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-896ee-7c6fcdd6fb-r7wgr |
Started |
Started container splitter-graph-896ee | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-896ee |
InferenceGraphReady |
InferenceGraph [splitter-graph-896ee] is Ready | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-896ee-7c6fcdd6fb-r7wgr |
Created |
Created container: splitter-graph-896ee | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-896ee |
UpdateFailed |
Failed to update status for InferenceGraph "splitter-graph-896ee": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "splitter-graph-896ee": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-896ee-7c6fcdd6fb-r7wgr |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8b2b640cecca2c5abab08a86fa1fe077f2518209438c00eb88348417ca75cab6" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-896ee |
ScalingReplicaSet |
Scaled up replica set splitter-graph-896ee-7c6fcdd6fb from 0 to 1 | |
kserve-ci-e2e-test |
multus |
splitter-graph-896ee-7c6fcdd6fb-r7wgr |
AddedInterface |
Add eth0 [10.134.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-896ee |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "splitter-graph-896ee": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-df329 |
InferenceServiceReady |
InferenceService [success-200-isvc-df329] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-df329 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-df329 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-896ee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-896ee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-df329 |
InferenceServiceReady |
InferenceService [error-404-isvc-df329] is Ready | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-896ee-predictor-7ddbb75dc5-vz24p |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-d1618-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-d1618-predictor-6fb8c89d7d from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d1618 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-d1618": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d1618 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-d1618": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-d1618": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-896ee-predictor-7ddbb75dc5-vz24p |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-896ee-7c6fcdd6fb-r7wgr |
Killing |
Stopping container splitter-graph-896ee | |
kserve-ci-e2e-test |
multus |
error-404-isvc-d1618-predictor-6fb8c89d7d-hw5v8 |
AddedInterface |
Add eth0 [10.134.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d1618-predictor-6fb8c89d7d-hw5v8 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1724" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-896ee-predictor-5f4cdb868-wh8tt |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d1618 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-d1618": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d1618 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-d1618": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-d1618": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-896ee-predictor-5f4cdb868-wh8tt |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-d1618-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-d1618-predictor-6bf69b6c7 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-d1618-predictor-6bf69b6c7 |
SuccessfulCreate |
Created pod: success-200-isvc-d1618-predictor-6bf69b6c7-q5mvp | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d1618-predictor-6bf69b6c7-q5mvp |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-d1618-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-d1618-predictor-6fb8c89d7d |
SuccessfulCreate |
Created pod: error-404-isvc-d1618-predictor-6fb8c89d7d-hw5v8 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d1618-predictor-6bf69b6c7-q5mvp |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1724" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d1618-predictor-6bf69b6c7-q5mvp |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d1618-predictor-6fb8c89d7d-hw5v8 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-d1618-predictor-6bf69b6c7-q5mvp |
AddedInterface |
Add eth0 [10.134.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d1618-predictor-6bf69b6c7-q5mvp |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d1618-predictor-6fb8c89d7d-hw5v8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d1618-predictor-6fb8c89d7d-hw5v8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d1618-predictor-6bf69b6c7-q5mvp |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d1618-predictor-6fb8c89d7d-hw5v8 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d1618-predictor-6bf69b6c7-q5mvp |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d1618-predictor-6fb8c89d7d-hw5v8 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d1618-predictor-6bf69b6c7-q5mvp |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-896ee-predictor-7ddbb75dc5-vz24p |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.43:8643/healthz": dial tcp 10.134.0.43:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-896ee-predictor-5f4cdb868-wh8tt |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.44:8643/healthz": dial tcp 10.134.0.44:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
switch-graph-df329-65d797bb8c-r45qz |
Created |
Created container: switch-graph-df329 | |
kserve-ci-e2e-test |
multus |
switch-graph-df329-65d797bb8c-r45qz |
AddedInterface |
Add eth0 [10.134.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-df329-65d797bb8c-r45qz |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8b2b640cecca2c5abab08a86fa1fe077f2518209438c00eb88348417ca75cab6" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-df329-65d797bb8c-r45qz |
Started |
Started container switch-graph-df329 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-df329-65d797bb8c |
SuccessfulCreate |
Created pod: switch-graph-df329-65d797bb8c-r45qz | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-df329 |
ScalingReplicaSet |
Scaled up replica set switch-graph-df329-65d797bb8c from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-df329 |
InferenceGraphReady |
InferenceGraph [switch-graph-df329] is Ready | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-df329-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-df329-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-df329-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-df329-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-896ee-7c6fcdd6fb-r7wgr |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d1618-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d1618-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d1618-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d1618-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-df329 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-df329 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-d1618-predictor-6fb8c89d7d-hw5v8 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.49:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-d1618-predictor-6bf69b6c7-q5mvp |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.48:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d1618 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d1618 |
InferenceServiceReady |
InferenceService [success-200-isvc-d1618] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d1618 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d1618 |
InferenceServiceReady |
InferenceService [error-404-isvc-d1618] is Ready | |
kserve-ci-e2e-test |
multus |
splitter-graph-d1618-57bb6975c5-jrx8r |
AddedInterface |
Add eth0 [10.134.0.51/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-d1618 |
InferenceGraphReady |
InferenceGraph [splitter-graph-d1618] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d1618-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-d1618 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-d1618-57bb6975c5 from 0 to 1 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d1618-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
splitter-graph-d1618-57bb6975c5-jrx8r |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8b2b640cecca2c5abab08a86fa1fe077f2518209438c00eb88348417ca75cab6" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-d1618-57bb6975c5 |
SuccessfulCreate |
Created pod: splitter-graph-d1618-57bb6975c5-jrx8r | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-d1618-57bb6975c5-jrx8r |
Created |
Created container: splitter-graph-d1618 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-d1618-57bb6975c5-jrx8r |
Started |
Started container splitter-graph-d1618 | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d1618-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d1618-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-d1618 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-d1618 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
splitter-graph-d1618-57bb6975c5-jrx8r |
Killing |
Stopping container splitter-graph-d1618 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d1618-predictor-6bf69b6c7-q5mvp |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d1618-predictor-6fb8c89d7d-hw5v8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d1618-predictor-6bf69b6c7-q5mvp |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d1618-predictor-6fb8c89d7d-hw5v8 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d1618-predictor-6fb8c89d7d-hw5v8 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.49:8643/healthz": context deadline exceeded | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d1618-predictor-6bf69b6c7-q5mvp |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.48:8080: i/o timeout | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d1618-predictor-6bf69b6c7-q5mvp |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.48:8643/healthz": context deadline exceeded | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d1618-predictor-6fb8c89d7d-hw5v8 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.49:8080: i/o timeout | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-d1618-57bb6975c5-jrx8r |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
switch-graph-df329-65d797bb8c-r45qz |
Killing |
Stopping container switch-graph-df329 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-df329-predictor-84bcc6b5bf-96thc |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-df329-predictor-84bcc6b5bf-96thc |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-df329-predictor-7d679b95bb-4zvtz |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-df329-predictor-7d679b95bb-4zvtz |
Killing |
Stopping container kube-rbac-proxy | |
| (x5) | kserve-ci-e2e-test |
kubelet |
switch-graph-df329-65d797bb8c-r45qz |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |