| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-555fc69d56-t2j4m |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-t2j4m to ip-10-0-135-229.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-887e9-predictor-5968877ff5-9hz8j |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-887e9-predictor-5968877ff5-9hz8j to ip-10-0-135-229.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-5af63-predictor-5659c95479-447vt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-5af63-predictor-5659c95479-447vt to ip-10-0-135-229.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl to ip-10-0-136-140.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-4f962-predictor-59c67d446c-fhfht |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-4f962-predictor-59c67d446c-fhfht to ip-10-0-135-229.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-058d2-ff64f56f7-mmrgh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-058d2-ff64f56f7-mmrgh to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-5af63-859f6674f8-mf5dr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-5af63-859f6674f8-mf5dr to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-887e9-57cbf8598b-fvfbt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-887e9-57cbf8598b-fvfbt to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-3efeb-c7897dd95-9nm5f |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-3efeb-c7897dd95-9nm5f to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-46c43-774db8878c-6vckc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-46c43-774db8878c-6vckc to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-058d2-predictor-6df78f8b6-drsmk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-058d2-predictor-6df78f8b6-drsmk to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-3efeb-predictor-9b86cfccd-4z9t5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-3efeb-predictor-9b86cfccd-4z9t5 to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-a006b-757f96b786-hwwfz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-a006b-757f96b786-hwwfz to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-bd292-8446b7b59d-5t2pc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-bd292-8446b7b59d-5t2pc to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-46c43-predictor-569ff545b8-d5d4c |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-46c43-predictor-569ff545b8-d5d4c to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-4f962-predictor-8576b94ccd-8d4zs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-4f962-predictor-8576b94ccd-8d4zs to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-5af63-predictor-5945f9cd94-h6gbc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-5af63-predictor-5945f9cd94-h6gbc to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-e2192-predictor-74c95f44b7-ndfvf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-e2192-predictor-74c95f44b7-ndfvf to ip-10-0-135-229.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-7989f-predictor-749fdfd4db-6qthz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-7989f-predictor-749fdfd4db-6qthz to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-678bbd4574-qz25r |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-678bbd4574-qz25r to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l to ip-10-0-136-140.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-7989f-predictor-5999f84fc9-5kctr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-7989f-predictor-5999f84fc9-5kctr to ip-10-0-135-229.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-e2192-7f99675849-4dd6h |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-e2192-7f99675849-4dd6h to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-46c43-predictor-5db8845cfc-4r9g6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-46c43-predictor-5db8845cfc-4r9g6 to ip-10-0-135-229.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-7989f-64d5897b47-4j958 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-7989f-64d5897b47-4j958 to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-058d2-predictor-7df8c9df5f-rprn6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-058d2-predictor-7df8c9df5f-rprn6 to ip-10-0-135-229.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-e2192-predictor-79886769c8-v9dc9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-e2192-predictor-79886769c8-v9dc9 to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-bd292-predictor-549cc54f5d-kc77q |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-bd292-predictor-549cc54f5d-kc77q to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-4f962-798db48b9d-tcld9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-4f962-798db48b9d-tcld9 to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-a006b-predictor-85d585c4ff-p948h |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-a006b-predictor-85d585c4ff-p948h to ip-10-0-135-229.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-887e9-predictor-7989ccbd74-bm7jl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-887e9-predictor-7989ccbd74-bm7jl to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-a006b-predictor-6cfbdfb69d-g6ltl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-a006b-predictor-6cfbdfb69d-g6ltl to ip-10-0-139-5.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm to ip-10-0-135-229.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-bd292-predictor-78cb685867-gd85p |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-bd292-predictor-78cb685867-gd85p to ip-10-0-135-229.ec2.internal | ||
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-a006b-predictor-85d585c4ff |
SuccessfulCreate |
Created pod: error-404-isvc-a006b-predictor-85d585c4ff-p948h | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-a006b-predictor-6cfbdfb69d |
SuccessfulCreate |
Created pod: success-200-isvc-a006b-predictor-6cfbdfb69d-g6ltl | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-555fc69d56 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-555fc69d56 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-555fc69d56-t2j4m | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-a006b-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-a006b-predictor-85d585c4ff from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-t2j4m |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:8c792ea2263cb7bd85dd8cea9bd693efabbe50ba34c2b979249ca9af5c8c2385" | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-759886b4dc |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-555fc69d56-t2j4m |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-759886b4dc from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-sklearn-graph-2-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-5fc4c74ccb from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-5fc4c74ccb |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a006b-predictor-6cfbdfb69d-g6ltl |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-a006b-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-a006b-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-a006b-predictor-6cfbdfb69d from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a006b-predictor-85d585c4ff-p948h |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-a006b-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l |
AddedInterface |
Add eth0 [10.133.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl |
AddedInterface |
Add eth0 [10.133.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8c792ea2263cb7bd85dd8cea9bd693efabbe50ba34c2b979249ca9af5c8c2385" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-a006b-predictor-6cfbdfb69d-g6ltl |
AddedInterface |
Add eth0 [10.132.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8c792ea2263cb7bd85dd8cea9bd693efabbe50ba34c2b979249ca9af5c8c2385" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a006b-predictor-85d585c4ff-p948h |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1978" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a006b-predictor-6cfbdfb69d-g6ltl |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1978" | |
kserve-ci-e2e-test |
multus |
error-404-isvc-a006b-predictor-85d585c4ff-p948h |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1978" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1978" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-t2j4m |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:8c792ea2263cb7bd85dd8cea9bd693efabbe50ba34c2b979249ca9af5c8c2385" in 11.743s (11.743s including waiting). Image size: 308251564 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a006b-predictor-6cfbdfb69d-g6ltl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a006b-predictor-6cfbdfb69d-g6ltl |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1978" in 12.283s (12.283s including waiting). Image size: 1356854351 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a006b-predictor-6cfbdfb69d-g6ltl |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a006b-predictor-6cfbdfb69d-g6ltl |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a006b-predictor-85d585c4ff-p948h |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1978" in 12.715s (12.715s including waiting). Image size: 1355862088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-t2j4m |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a006b-predictor-85d585c4ff-p948h |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a006b-predictor-85d585c4ff-p948h |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-t2j4m |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a006b-predictor-85d585c4ff-p948h |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a006b-predictor-6cfbdfb69d-g6ltl |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.305s (2.305s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a006b-predictor-6cfbdfb69d-g6ltl |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a006b-predictor-6cfbdfb69d-g6ltl |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a006b-predictor-85d585c4ff-p948h |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.177s (2.177s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a006b-predictor-85d585c4ff-p948h |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a006b-predictor-85d585c4ff-p948h |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-t2j4m |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1978" in 15.837s (15.837s including waiting). Image size: 1580862866 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1978" in 15.812s (15.812s including waiting). Image size: 1580862866 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.865s (2.865s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.915s (2.915s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-t2j4m |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-t2j4m |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-t2j4m |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-t2j4m |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 20.274s (20.274s including waiting). Image size: 1435742979 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-t2j4m |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-t2j4m |
Started |
Started container kube-rbac-proxy | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a006b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a006b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a006b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a006b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-a006b-predictor-6cfbdfb69d-g6ltl |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.23:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a006b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a006b |
InferenceServiceReady |
InferenceService [success-200-isvc-a006b] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a006b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a006b |
InferenceServiceReady |
InferenceService [error-404-isvc-a006b] is Ready | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-a006b |
ScalingReplicaSet |
Scaled up replica set switch-graph-a006b-757f96b786 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-a006b |
InferenceGraphReady |
InferenceGraph [switch-graph-a006b] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-a006b-757f96b786 |
SuccessfulCreate |
Created pod: switch-graph-a006b-757f96b786-hwwfz | |
kserve-ci-e2e-test |
multus |
switch-graph-a006b-757f96b786-hwwfz |
AddedInterface |
Add eth0 [10.132.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-a006b-757f96b786-hwwfz |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:2782a67dec8fa239db76fc1c924628ff8f465c00269682467a2b9b0a7132f8a4" | |
kserve-ci-e2e-test |
kubelet |
switch-graph-a006b-757f96b786-hwwfz |
Started |
Started container switch-graph-a006b | |
kserve-ci-e2e-test |
kubelet |
switch-graph-a006b-757f96b786-hwwfz |
Created |
Created container: switch-graph-a006b | |
kserve-ci-e2e-test |
kubelet |
switch-graph-a006b-757f96b786-hwwfz |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:2782a67dec8fa239db76fc1c924628ff8f465c00269682467a2b9b0a7132f8a4" in 2.411s (2.411s including waiting). Image size: 211751500 bytes. | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a006b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a006b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a006b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a006b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a006b-predictor-85d585c4ff-p948h |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.31:8643/healthz": dial tcp 10.134.0.31:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
switch-graph-a006b-757f96b786-hwwfz |
Killing |
Stopping container switch-graph-a006b | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a006b-predictor-6cfbdfb69d-g6ltl |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a006b-predictor-6cfbdfb69d-g6ltl |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a006b-predictor-85d585c4ff-p948h |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a006b-predictor-85d585c4ff-p948h |
Killing |
Stopping container kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-a006b-predictor-85d585c4ff-p948h |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.31:8080: connect: connection refused |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-7989f-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-7989f-predictor-749fdfd4db from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-7989f-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-7989f-predictor-5999f84fc9 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-7989f-predictor-749fdfd4db |
SuccessfulCreate |
Created pod: success-200-isvc-7989f-predictor-749fdfd4db-6qthz | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-7989f-predictor-5999f84fc9 |
SuccessfulCreate |
Created pod: error-404-isvc-7989f-predictor-5999f84fc9-5kctr | |
kserve-ci-e2e-test |
multus |
error-404-isvc-7989f-predictor-5999f84fc9-5kctr |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7989f-predictor-5999f84fc9-5kctr |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7989f-predictor-749fdfd4db-6qthz |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7989f-predictor-749fdfd4db-6qthz |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1978" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-7989f-predictor-749fdfd4db-6qthz |
AddedInterface |
Add eth0 [10.132.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7989f-predictor-749fdfd4db-6qthz |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7989f-predictor-5999f84fc9-5kctr |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7989f-predictor-749fdfd4db-6qthz |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7989f-predictor-5999f84fc9-5kctr |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7989f-predictor-749fdfd4db-6qthz |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7989f-predictor-5999f84fc9-5kctr |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7989f-predictor-5999f84fc9-5kctr |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7989f-predictor-749fdfd4db-6qthz |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7989f-predictor-5999f84fc9-5kctr |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1978" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x9) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-t2j4m |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.30:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7989f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7989f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-a006b-757f96b786-hwwfz |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7989f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7989f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-678bbd4574 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
model-chainer-678bbd4574-qz25r |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "model-chainer-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-678bbd4574 |
SuccessfulCreate |
Created pod: model-chainer-678bbd4574-qz25r | |
kserve-ci-e2e-test |
kubelet |
model-chainer-678bbd4574-qz25r |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-678bbd4574-qz25r |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-678bbd4574-qz25r |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:2782a67dec8fa239db76fc1c924628ff8f465c00269682467a2b9b0a7132f8a4" already present on machine | |
kserve-ci-e2e-test |
multus |
model-chainer-678bbd4574-qz25r |
AddedInterface |
Add eth0 [10.132.0.26/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-7989f-predictor-5999f84fc9-5kctr |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.32:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-t2j4m |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-887e9-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-887e9-predictor-7989ccbd74 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-t2j4m |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-887e9-predictor-7989ccbd74 |
SuccessfulCreate |
Created pod: success-200-isvc-887e9-predictor-7989ccbd74-bm7jl | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
model-chainer-678bbd4574-qz25r |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-887e9-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-887e9-predictor-5968877ff5 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l |
Killing |
Stopping container kserve-container | |
| (x10) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.23:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-887e9-predictor-7989ccbd74-bm7jl |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1978" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-887e9-predictor-5968877ff5 |
SuccessfulCreate |
Created pod: error-404-isvc-887e9-predictor-5968877ff5-9hz8j | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-887e9-predictor-7989ccbd74-bm7jl |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-887e9-predictor-7989ccbd74-bm7jl |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-887e9-predictor-7989ccbd74-bm7jl |
AddedInterface |
Add eth0 [10.132.0.27/23] from ovn-kubernetes | |
| (x10) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.24:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-887e9-predictor-7989ccbd74-bm7jl |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-887e9-predictor-7989ccbd74-bm7jl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-887e9-predictor-5968877ff5-9hz8j |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-887e9-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-887e9-predictor-7989ccbd74-bm7jl |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-887e9-predictor-5968877ff5-9hz8j |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-887e9-predictor-5968877ff5-9hz8j |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-887e9-predictor-5968877ff5-9hz8j |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7989f |
InferenceServiceReady |
InferenceService [success-200-isvc-7989f] is Ready | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-887e9-predictor-5968877ff5-9hz8j |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-887e9-predictor-5968877ff5-9hz8j |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1978" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-887e9-predictor-5968877ff5-9hz8j |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7989f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-887e9-predictor-5968877ff5-9hz8j |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7989f |
InferenceServiceReady |
InferenceService [error-404-isvc-7989f] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7989f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-759886b4dc-s7xvl |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.23:8643/healthz": dial tcp 10.133.0.23:8643: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-5fc4c74ccb-qm49l |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.24:8643/healthz": dial tcp 10.133.0.24:8643: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
switch-graph-7989f-64d5897b47-4j958 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-7989f-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-7989f |
InferenceGraphReady |
InferenceGraph [switch-graph-7989f] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7989f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7989f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-7989f-64d5897b47 |
SuccessfulCreate |
Created pod: switch-graph-7989f-64d5897b47-4j958 | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-7989f |
ScalingReplicaSet |
Scaled up replica set switch-graph-7989f-64d5897b47 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-7989f-64d5897b47-4j958 |
Created |
Created container: switch-graph-7989f | |
kserve-ci-e2e-test |
multus |
switch-graph-7989f-64d5897b47-4j958 |
AddedInterface |
Add eth0 [10.132.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-7989f-64d5897b47-4j958 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:2782a67dec8fa239db76fc1c924628ff8f465c00269682467a2b9b0a7132f8a4" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-7989f-64d5897b47-4j958 |
Started |
Started container switch-graph-7989f | |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-678bbd4574-qz25r |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-7989f |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-7989f |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-887e9-predictor-5968877ff5-9hz8j |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.33:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7989f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7989f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-7989f |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-7989f |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-887e9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-887e9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-887e9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-887e9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-887e9 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-887e9 |
InferenceServiceReady |
InferenceService [success-200-isvc-887e9] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-887e9 |
InferenceServiceReady |
InferenceService [error-404-isvc-887e9] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-887e9 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-887e9 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-887e9-57cbf8598b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-887e9-57cbf8598b |
SuccessfulCreate |
Created pod: sequence-graph-887e9-57cbf8598b-fvfbt | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-887e9 |
InferenceGraphReady |
InferenceGraph [sequence-graph-887e9] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-887e9-57cbf8598b-fvfbt |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-887e9-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-887e9-57cbf8598b-fvfbt |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:2782a67dec8fa239db76fc1c924628ff8f465c00269682467a2b9b0a7132f8a4" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-887e9-57cbf8598b-fvfbt |
Started |
Started container sequence-graph-887e9 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-887e9-57cbf8598b-fvfbt |
Created |
Created container: sequence-graph-887e9 | |
kserve-ci-e2e-test |
multus |
sequence-graph-887e9-57cbf8598b-fvfbt |
AddedInterface |
Add eth0 [10.132.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-887e9 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-887e9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-887e9 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-887e9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-887e9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-887e9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-887e9 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-887e9 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
switch-graph-7989f-64d5897b47-4j958 |
Killing |
Stopping container switch-graph-7989f | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-4f962-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-4f962-predictor-8576b94ccd from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-4f962-predictor-8576b94ccd |
SuccessfulCreate |
Created pod: success-200-isvc-4f962-predictor-8576b94ccd-8d4zs | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-4f962-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-4f962-predictor-59c67d446c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-4f962-predictor-59c67d446c |
SuccessfulCreate |
Created pod: error-404-isvc-4f962-predictor-59c67d446c-fhfht | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7989f-predictor-5999f84fc9-5kctr |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7989f-predictor-749fdfd4db-6qthz |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7989f-predictor-749fdfd4db-6qthz |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7989f-predictor-5999f84fc9-5kctr |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f962-predictor-8576b94ccd-8d4zs |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1978" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-4f962-predictor-59c67d446c-fhfht |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
success-200-isvc-4f962-predictor-8576b94ccd-8d4zs |
AddedInterface |
Add eth0 [10.132.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f962-predictor-8576b94ccd-8d4zs |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f962-predictor-8576b94ccd-8d4zs |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f962-predictor-8576b94ccd-8d4zs |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f962-predictor-8576b94ccd-8d4zs |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f962-predictor-59c67d446c-fhfht |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f962-predictor-59c67d446c-fhfht |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1978" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f962-predictor-59c67d446c-fhfht |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f962-predictor-8576b94ccd-8d4zs |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f962-predictor-59c67d446c-fhfht |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f962-predictor-59c67d446c-fhfht |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f962-predictor-59c67d446c-fhfht |
Started |
Started container kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-7989f-predictor-749fdfd4db-6qthz |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.25:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7989f-predictor-749fdfd4db-6qthz |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.25:8643/healthz": dial tcp 10.132.0.25:8643: connect: connection refused | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4f962-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4f962-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-7989f-64d5897b47-4j958 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4f962-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4f962-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f962-predictor-8576b94ccd-8d4zs |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.30:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f962-predictor-59c67d446c-fhfht |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.34:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-887e9-predictor-5968877ff5-9hz8j |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-887e9-57cbf8598b-fvfbt |
Killing |
Stopping container sequence-graph-887e9 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-5af63-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-5af63-predictor-5945f9cd94 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-5af63-predictor-5945f9cd94 |
SuccessfulCreate |
Created pod: success-200-isvc-5af63-predictor-5945f9cd94-h6gbc | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-887e9-predictor-5968877ff5-9hz8j |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-887e9-predictor-7989ccbd74-bm7jl |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-887e9-predictor-7989ccbd74-bm7jl |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-5af63-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-5af63-predictor-5659c95479 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-5af63-predictor-5659c95479 |
SuccessfulCreate |
Created pod: error-404-isvc-5af63-predictor-5659c95479-447vt | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5af63-predictor-5945f9cd94-h6gbc |
Started |
Started container kube-rbac-proxy | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-4f962 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5af63-predictor-5659c95479-447vt |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5af63-predictor-5659c95479-447vt |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5af63-predictor-5659c95479-447vt |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-5af63-predictor-5659c95479-447vt |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5af63-predictor-5659c95479-447vt |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1978" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5af63-predictor-5945f9cd94-h6gbc |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-4f962 |
InferenceServiceReady |
InferenceService [success-200-isvc-4f962] is Ready | |
kserve-ci-e2e-test |
multus |
success-200-isvc-5af63-predictor-5945f9cd94-h6gbc |
AddedInterface |
Add eth0 [10.132.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5af63-predictor-5659c95479-447vt |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5af63-predictor-5945f9cd94-h6gbc |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5af63-predictor-5945f9cd94-h6gbc |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1978" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5af63-predictor-5945f9cd94-h6gbc |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5af63-predictor-5945f9cd94-h6gbc |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5af63-predictor-5659c95479-447vt |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4f962 |
InferenceServiceReady |
InferenceService [error-404-isvc-4f962] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4f962 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-887e9-predictor-7989ccbd74-bm7jl |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.27:8643/healthz": dial tcp 10.132.0.27:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-887e9-predictor-7989ccbd74-bm7jl |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.27:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4f962-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-4f962-798db48b9d-tcld9 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-4f962-serving-cert" not found | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4f962-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-4f962 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "ensemble-graph-4f962": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-4f962 |
UpdateFailed |
Failed to update status for InferenceGraph "ensemble-graph-4f962": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "ensemble-graph-4f962": the object has been modified; please apply your changes to the latest version and try again | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4f962-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-4f962-798db48b9d |
SuccessfulCreate |
Created pod: ensemble-graph-4f962-798db48b9d-tcld9 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4f962-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-4f962 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-4f962] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-4f962 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-4f962-798db48b9d from 0 to 1 | |
kserve-ci-e2e-test |
multus |
ensemble-graph-4f962-798db48b9d-tcld9 |
AddedInterface |
Add eth0 [10.132.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-4f962-798db48b9d-tcld9 |
Created |
Created container: ensemble-graph-4f962 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-4f962-798db48b9d-tcld9 |
Started |
Started container ensemble-graph-4f962 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-4f962-798db48b9d-tcld9 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:2782a67dec8fa239db76fc1c924628ff8f465c00269682467a2b9b0a7132f8a4" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f962-predictor-59c67d446c-fhfht |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f962-predictor-59c67d446c-fhfht |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f962-predictor-8576b94ccd-8d4zs |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f962-predictor-8576b94ccd-8d4zs |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-4f962-798db48b9d-tcld9 |
Killing |
Stopping container ensemble-graph-4f962 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-bd292-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-bd292-predictor-549cc54f5d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-bd292-predictor-549cc54f5d |
SuccessfulCreate |
Created pod: success-200-isvc-bd292-predictor-549cc54f5d-kc77q | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-bd292-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-bd292-predictor-78cb685867 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-bd292-predictor-78cb685867 |
SuccessfulCreate |
Created pod: error-404-isvc-bd292-predictor-78cb685867-gd85p | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4f962-predictor-8576b94ccd-8d4zs |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.30:8643/healthz": dial tcp 10.132.0.30:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4f962-predictor-59c67d446c-fhfht |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.34:8643/healthz": dial tcp 10.134.0.34:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bd292-predictor-549cc54f5d-kc77q |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1978" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bd292-predictor-549cc54f5d-kc77q |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bd292-predictor-549cc54f5d-kc77q |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bd292-predictor-549cc54f5d-kc77q |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bd292-predictor-549cc54f5d-kc77q |
Started |
Started container kube-rbac-proxy | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-887e9-57cbf8598b-fvfbt |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bd292-predictor-78cb685867-gd85p |
FailedMount |
MountVolume.SetUp failed for volume "kube-rbac-proxy-sar-config" : failed to sync configmap cache: timed out waiting for the condition | |
kserve-ci-e2e-test |
multus |
success-200-isvc-bd292-predictor-549cc54f5d-kc77q |
AddedInterface |
Add eth0 [10.132.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bd292-predictor-549cc54f5d-kc77q |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bd292-predictor-78cb685867-gd85p |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : failed to sync secret cache: timed out waiting for the condition | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bd292-predictor-78cb685867-gd85p |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bd292-predictor-78cb685867-gd85p |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1978" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bd292-predictor-78cb685867-gd85p |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-bd292-predictor-78cb685867-gd85p |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bd292-predictor-78cb685867-gd85p |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bd292-predictor-78cb685867-gd85p |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bd292-predictor-78cb685867-gd85p |
Started |
Started container kube-rbac-proxy | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5af63-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5af63-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-5af63-predictor-5945f9cd94-h6gbc |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.31:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-5af63-predictor-5659c95479-447vt |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.35:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5af63-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5af63-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-5af63 |
InferenceServiceReady |
InferenceService [success-200-isvc-5af63] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-5af63 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-5af63 |
InferenceServiceReady |
InferenceService [error-404-isvc-5af63] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-5af63 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-4f962-798db48b9d-tcld9 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-bd292-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-bd292-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-bd292-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-bd292-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5af63-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5af63-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-5af63-859f6674f8 |
SuccessfulCreate |
Created pod: sequence-graph-5af63-859f6674f8-mf5dr | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-5af63 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-5af63-859f6674f8 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-5af63 |
InferenceGraphReady |
InferenceGraph [sequence-graph-5af63] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-5af63-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-5af63-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-5af63-859f6674f8-mf5dr |
Started |
Started container sequence-graph-5af63 | |
kserve-ci-e2e-test |
multus |
sequence-graph-5af63-859f6674f8-mf5dr |
AddedInterface |
Add eth0 [10.132.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-5af63-859f6674f8-mf5dr |
Created |
Created container: sequence-graph-5af63 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-5af63-859f6674f8-mf5dr |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:2782a67dec8fa239db76fc1c924628ff8f465c00269682467a2b9b0a7132f8a4" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-bd292-predictor-549cc54f5d-kc77q |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.33:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-bd292-predictor-78cb685867-gd85p |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.36:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5af63-predictor-5945f9cd94-h6gbc |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-058d2 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-058d2": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-058d2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-058d2 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-058d2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5af63-predictor-5659c95479-447vt |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5af63-predictor-5945f9cd94-h6gbc |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-5af63-859f6674f8-mf5dr |
Killing |
Stopping container sequence-graph-5af63 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-5af63-predictor-5659c95479-447vt |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-058d2-predictor-6df78f8b6 |
SuccessfulCreate |
Created pod: success-200-isvc-058d2-predictor-6df78f8b6-drsmk | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-058d2-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-058d2-predictor-6df78f8b6 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-058d2-predictor-6df78f8b6-drsmk |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-058d2-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-058d2-predictor-7df8c9df5f-rprn6 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-058d2 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-058d2": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-058d2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-058d2 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-058d2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-058d2-predictor-7df8c9df5f-rprn6 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1978" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-058d2-predictor-7df8c9df5f-rprn6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-058d2-predictor-7df8c9df5f-rprn6 |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-058d2-predictor-7df8c9df5f-rprn6 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-058d2-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-058d2-predictor-7df8c9df5f from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-058d2-predictor-7df8c9df5f |
SuccessfulCreate |
Created pod: error-404-isvc-058d2-predictor-7df8c9df5f-rprn6 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-058d2-predictor-7df8c9df5f-rprn6 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-058d2-predictor-7df8c9df5f-rprn6 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-058d2-predictor-6df78f8b6-drsmk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-058d2-predictor-6df78f8b6-drsmk |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-058d2-predictor-6df78f8b6-drsmk |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-058d2-predictor-6df78f8b6-drsmk |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-058d2-predictor-6df78f8b6-drsmk |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-058d2-predictor-6df78f8b6-drsmk |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1978" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-058d2-predictor-6df78f8b6-drsmk |
AddedInterface |
Add eth0 [10.132.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-5af63-predictor-5945f9cd94-h6gbc |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.31:8643/healthz": dial tcp 10.132.0.31:8643: connect: connection refused | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-bd292 |
InferenceServiceReady |
InferenceService [success-200-isvc-bd292] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-bd292 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-bd292 |
InferenceServiceReady |
InferenceService [error-404-isvc-bd292] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-bd292 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-bd292-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-bd292-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-bd292 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-bd292-8446b7b59d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-bd292-8446b7b59d |
SuccessfulCreate |
Created pod: ensemble-graph-bd292-8446b7b59d-5t2pc | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-bd292 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-bd292] is Ready | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-bd292-8446b7b59d-5t2pc |
Created |
Created container: ensemble-graph-bd292 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-bd292-8446b7b59d-5t2pc |
Started |
Started container ensemble-graph-bd292 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-bd292-8446b7b59d-5t2pc |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:2782a67dec8fa239db76fc1c924628ff8f465c00269682467a2b9b0a7132f8a4" already present on machine | |
kserve-ci-e2e-test |
multus |
ensemble-graph-bd292-8446b7b59d-5t2pc |
AddedInterface |
Add eth0 [10.132.0.36/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-5af63-859f6674f8-mf5dr |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-bd292-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-058d2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-058d2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-bd292-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-058d2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-058d2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-058d2 |
InferenceServiceReady |
InferenceService [error-404-isvc-058d2] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-058d2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-058d2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-058d2 |
InferenceServiceReady |
InferenceService [success-200-isvc-058d2] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-058d2 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-058d2-ff64f56f7 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-058d2 |
InferenceGraphReady |
InferenceGraph [sequence-graph-058d2] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-058d2-ff64f56f7-mmrgh |
Started |
Started container sequence-graph-058d2 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-058d2-ff64f56f7 |
SuccessfulCreate |
Created pod: sequence-graph-058d2-ff64f56f7-mmrgh | |
kserve-ci-e2e-test |
multus |
sequence-graph-058d2-ff64f56f7-mmrgh |
AddedInterface |
Add eth0 [10.132.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-058d2-ff64f56f7-mmrgh |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:2782a67dec8fa239db76fc1c924628ff8f465c00269682467a2b9b0a7132f8a4" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-058d2-ff64f56f7-mmrgh |
Created |
Created container: sequence-graph-058d2 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-bd292 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-bd292 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-058d2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-058d2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-058d2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-058d2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-058d2 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-058d2 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-3efeb-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-3efeb-predictor-9b86cfccd from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3efeb |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-3efeb": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bd292-predictor-549cc54f5d-kc77q |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bd292-predictor-549cc54f5d-kc77q |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bd292-predictor-78cb685867-gd85p |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3efeb |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-3efeb": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-3efeb": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-3efeb-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-3efeb-predictor-f8bf5d4ff from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-3efeb-predictor-f8bf5d4ff |
SuccessfulCreate |
Created pod: error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bd292-predictor-78cb685867-gd85p |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3efeb |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-3efeb": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3efeb |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-3efeb": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-3efeb": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-bd292-8446b7b59d-5t2pc |
Killing |
Stopping container ensemble-graph-bd292 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-3efeb-predictor-9b86cfccd |
SuccessfulCreate |
Created pod: success-200-isvc-3efeb-predictor-9b86cfccd-4z9t5 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3efeb-predictor-9b86cfccd-4z9t5 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3efeb-predictor-9b86cfccd-4z9t5 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1978" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bd292-predictor-78cb685867-gd85p |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.36:8643/healthz": dial tcp 10.134.0.36:8643: connect: connection refused | |
kserve-ci-e2e-test |
multus |
success-200-isvc-3efeb-predictor-9b86cfccd-4z9t5 |
AddedInterface |
Add eth0 [10.132.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bd292-predictor-549cc54f5d-kc77q |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.33:8643/healthz": dial tcp 10.132.0.33:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3efeb-predictor-9b86cfccd-4z9t5 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3efeb-predictor-9b86cfccd-4z9t5 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3efeb-predictor-9b86cfccd-4z9t5 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3efeb-predictor-9b86cfccd-4z9t5 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1978" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-bd292-8446b7b59d-5t2pc |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-058d2-predictor-7df8c9df5f-rprn6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-058d2-predictor-6df78f8b6-drsmk |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-058d2-ff64f56f7-mmrgh |
Killing |
Stopping container sequence-graph-058d2 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-058d2-predictor-6df78f8b6-drsmk |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-058d2-predictor-7df8c9df5f-rprn6 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-e2192-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-e2192-predictor-79886769c8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e2192-predictor-74c95f44b7-ndfvf |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-e2192-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-e2192-predictor-74c95f44b7 |
SuccessfulCreate |
Created pod: error-404-isvc-e2192-predictor-74c95f44b7-ndfvf | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-e2192-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-e2192-predictor-74c95f44b7 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e2192-predictor-79886769c8-v9dc9 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-e2192-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-e2192-predictor-79886769c8 |
SuccessfulCreate |
Created pod: success-200-isvc-e2192-predictor-79886769c8-v9dc9 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-3efeb-predictor-9b86cfccd-4z9t5 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.38:8080: connect: connection refused |
kserve-ci-e2e-test |
multus |
success-200-isvc-e2192-predictor-79886769c8-v9dc9 |
AddedInterface |
Add eth0 [10.132.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e2192-predictor-79886769c8-v9dc9 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e2192-predictor-74c95f44b7-ndfvf |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1978" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e2192-predictor-74c95f44b7-ndfvf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e2192-predictor-74c95f44b7-ndfvf |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e2192-predictor-79886769c8-v9dc9 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e2192-predictor-79886769c8-v9dc9 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1978" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e2192-predictor-79886769c8-v9dc9 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-e2192-predictor-74c95f44b7-ndfvf |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e2192-predictor-74c95f44b7-ndfvf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e2192-predictor-79886769c8-v9dc9 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e2192-predictor-79886769c8-v9dc9 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e2192-predictor-74c95f44b7-ndfvf |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e2192-predictor-74c95f44b7-ndfvf |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.38:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-058d2-predictor-6df78f8b6-drsmk |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.35:8643/healthz": dial tcp 10.132.0.35:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-058d2-predictor-6df78f8b6-drsmk |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.35:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-058d2-predictor-7df8c9df5f-rprn6 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.37:8643/healthz": dial tcp 10.134.0.37:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-058d2-predictor-7df8c9df5f-rprn6 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.37:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3efeb-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3efeb-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3efeb-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3efeb-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3efeb |
InferenceServiceReady |
InferenceService [success-200-isvc-3efeb] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3efeb |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3efeb |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3efeb |
InferenceServiceReady |
InferenceService [error-404-isvc-3efeb] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e2192-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e2192-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3efeb-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-3efeb |
ScalingReplicaSet |
Scaled up replica set splitter-graph-3efeb-c7897dd95 from 0 to 1 | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3efeb-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3efeb-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-3efeb-c7897dd95 |
SuccessfulCreate |
Created pod: splitter-graph-3efeb-c7897dd95-9nm5f | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3efeb-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-3efeb-c7897dd95-9nm5f |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-3efeb-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-3efeb |
InferenceGraphReady |
InferenceGraph [splitter-graph-3efeb] is Ready | |
kserve-ci-e2e-test |
multus |
splitter-graph-3efeb-c7897dd95-9nm5f |
AddedInterface |
Add eth0 [10.132.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-3efeb-c7897dd95-9nm5f |
Started |
Started container splitter-graph-3efeb | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-3efeb-c7897dd95-9nm5f |
Created |
Created container: splitter-graph-3efeb | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-3efeb-c7897dd95-9nm5f |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:2782a67dec8fa239db76fc1c924628ff8f465c00269682467a2b9b0a7132f8a4" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-058d2-ff64f56f7-mmrgh |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e2192-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e2192-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3efeb-predictor-9b86cfccd-4z9t5 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3efeb-predictor-9b86cfccd-4z9t5 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-3efeb-c7897dd95-9nm5f |
Killing |
Stopping container splitter-graph-3efeb | |
kserve-ci-e2e-test |
multus |
success-200-isvc-46c43-predictor-569ff545b8-d5d4c |
AddedInterface |
Add eth0 [10.132.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-46c43-predictor-569ff545b8-d5d4c |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-46c43-predictor-5db8845cfc-4r9g6 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-46c43-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-46c43-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-46c43-predictor-569ff545b8 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-46c43-predictor-5db8845cfc |
SuccessfulCreate |
Created pod: error-404-isvc-46c43-predictor-5db8845cfc-4r9g6 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-46c43-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-46c43-predictor-5db8845cfc from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-46c43-predictor-569ff545b8 |
SuccessfulCreate |
Created pod: success-200-isvc-46c43-predictor-569ff545b8-d5d4c | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-46c43-predictor-569ff545b8-d5d4c |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-46c43-predictor-569ff545b8-d5d4c |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1978" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-46c43-predictor-569ff545b8-d5d4c |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-46c43-predictor-569ff545b8-d5d4c |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-46c43-predictor-569ff545b8-d5d4c |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-46c43-predictor-5db8845cfc-4r9g6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-46c43-predictor-5db8845cfc-4r9g6 |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-46c43-predictor-5db8845cfc-4r9g6 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-46c43-predictor-5db8845cfc-4r9g6 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3efeb-predictor-9b86cfccd-4z9t5 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.38:8643/healthz": dial tcp 10.132.0.38:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-46c43-predictor-5db8845cfc-4r9g6 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-46c43-predictor-5db8845cfc-4r9g6 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-46c43-predictor-5db8845cfc-4r9g6 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1978" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3efeb-predictor-f8bf5d4ff-cvnqm |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.38:8643/healthz": dial tcp 10.134.0.38:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-e2192-predictor-74c95f44b7-ndfvf |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.39:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-e2192-predictor-79886769c8-v9dc9 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.39:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e2192 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e2192 |
InferenceServiceReady |
InferenceService [error-404-isvc-e2192] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e2192 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e2192 |
InferenceServiceReady |
InferenceService [success-200-isvc-e2192] is Ready | |
kserve-ci-e2e-test |
multus |
switch-graph-e2192-7f99675849-4dd6h |
AddedInterface |
Add eth0 [10.132.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-e2192-7f99675849-4dd6h |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:2782a67dec8fa239db76fc1c924628ff8f465c00269682467a2b9b0a7132f8a4" already present on machine | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-e2192 |
InferenceGraphReady |
InferenceGraph [switch-graph-e2192] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-e2192-7f99675849 |
SuccessfulCreate |
Created pod: switch-graph-e2192-7f99675849-4dd6h | |
kserve-ci-e2e-test |
kubelet |
switch-graph-e2192-7f99675849-4dd6h |
Started |
Started container switch-graph-e2192 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-e2192-7f99675849-4dd6h |
Created |
Created container: switch-graph-e2192 | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-e2192 |
ScalingReplicaSet |
Scaled up replica set switch-graph-e2192-7f99675849 from 0 to 1 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-3efeb-c7897dd95-9nm5f |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-46c43-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-46c43-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-46c43-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-46c43-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-46c43-predictor-5db8845cfc-4r9g6 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.40:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e2192-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e2192-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e2192-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e2192-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-46c43 |
InferenceServiceReady |
InferenceService [success-200-isvc-46c43] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-46c43 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-46c43 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-46c43 |
InferenceServiceReady |
InferenceService [error-404-isvc-46c43] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-e2192 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-e2192 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
splitter-graph-46c43-774db8878c-6vckc |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-46c43-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-46c43 |
InferenceGraphReady |
InferenceGraph [splitter-graph-46c43] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-46c43 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-46c43-774db8878c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-46c43-774db8878c |
SuccessfulCreate |
Created pod: splitter-graph-46c43-774db8878c-6vckc | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-46c43-774db8878c-6vckc |
Started |
Started container splitter-graph-46c43 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-46c43-774db8878c-6vckc |
Created |
Created container: splitter-graph-46c43 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-46c43-774db8878c-6vckc |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:2782a67dec8fa239db76fc1c924628ff8f465c00269682467a2b9b0a7132f8a4" already present on machine | |
kserve-ci-e2e-test |
multus |
splitter-graph-46c43-774db8878c-6vckc |
AddedInterface |
Add eth0 [10.132.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-46c43 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-46c43-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-46c43 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-46c43-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-46c43-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-46c43 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-46c43 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-46c43-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-46c43-predictor-569ff545b8-d5d4c |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-46c43-774db8878c-6vckc |
Killing |
Stopping container splitter-graph-46c43 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-46c43-predictor-569ff545b8-d5d4c |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-46c43-predictor-5db8845cfc-4r9g6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-46c43-predictor-5db8845cfc-4r9g6 |
Killing |
Stopping container kube-rbac-proxy | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-46c43-predictor-569ff545b8-d5d4c |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.41:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-46c43-predictor-569ff545b8-d5d4c |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.41:8643/healthz": dial tcp 10.132.0.41:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-46c43-774db8878c-6vckc |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e2192-predictor-79886769c8-v9dc9 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
switch-graph-e2192-7f99675849-4dd6h |
Killing |
Stopping container switch-graph-e2192 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e2192-predictor-74c95f44b7-ndfvf |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e2192-predictor-79886769c8-v9dc9 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e2192-predictor-74c95f44b7-ndfvf |
Killing |
Stopping container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-e2192-7f99675849-4dd6h |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |