| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
switch-graph-a37f5-68dd44b8fb-97nlg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-a37f5-68dd44b8fb-97nlg to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-e1f95-6b4654b7f9-bt48g |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-e1f95-6b4654b7f9-bt48g to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-c9f9f-5dd8ccddf4-44z4s |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-c9f9f-5dd8ccddf4-44z4s to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm to ip-10-0-135-201.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-41340-79656bc944-xx8ss |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-41340-79656bc944-xx8ss to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-b9ddf-6dfbc67fd6-5m5nx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-b9ddf-6dfbc67fd6-5m5nx to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-b9319-predictor-65db6866c5-fqs22 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-b9319-predictor-65db6866c5-fqs22 to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-d627c-predictor-859777b8f9-r2nqq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-d627c-predictor-859777b8f9-r2nqq to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-ac6c8-predictor-6bb86d49d9-btthf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-ac6c8-predictor-6bb86d49d9-btthf to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-7621b-predictor-5f89d47788-7mplf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-7621b-predictor-5f89d47788-7mplf to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-a37f5-predictor-68dfd7bf6d-p6m6w |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-a37f5-predictor-68dfd7bf6d-p6m6w to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-ac6c8-predictor-864c9c7dfd-5fqlc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-ac6c8-predictor-864c9c7dfd-5fqlc to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-d627c-66c94ccd96-ml4rc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-d627c-66c94ccd96-ml4rc to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-b9319-predictor-67fcdd6676-f9tsk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-b9319-predictor-67fcdd6676-f9tsk to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-b9ddf-predictor-66459c556f-np74k |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-b9ddf-predictor-66459c556f-np74k to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-b9319-859cc9dd58-k7xmt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-b9319-859cc9dd58-k7xmt to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-6fc6549cd8-x4sbs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-6fc6549cd8-x4sbs to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-669d8d6456-xh9nx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-669d8d6456-xh9nx to ip-10-0-142-30.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-7621b-7fdfb8f889-6blhd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-7621b-7fdfb8f889-6blhd to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-a37f5-predictor-547f4c9447-g2whm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-a37f5-predictor-547f4c9447-g2whm to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-41340-predictor-897fcb-v7pwp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-41340-predictor-897fcb-v7pwp to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-c9f9f-predictor-75597dd9f7-czccf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-c9f9f-predictor-75597dd9f7-czccf to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-ac6c8-87cf995b8-z6wk9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-ac6c8-87cf995b8-z6wk9 to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-41340-predictor-694448f7cf-n9r4s |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-41340-predictor-694448f7cf-n9r4s to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-b9ddf-predictor-75548d844b-lf92z |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-b9ddf-predictor-75548d844b-lf92z to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-4fa95-predictor-5756bcc86-4mc9k |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-4fa95-predictor-5756bcc86-4mc9k to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-e1f95-predictor-6cb95bc7c9-qwdsm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-e1f95-predictor-6cb95bc7c9-qwdsm to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-7621b-predictor-6d5bd65f5f-bjtpt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-7621b-predictor-6d5bd65f5f-bjtpt to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-4fa95-549f8ff959-xxjk6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-4fa95-549f8ff959-xxjk6 to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-e1f95-predictor-78c8c57784-68slp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-e1f95-predictor-78c8c57784-68slp to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-4fa95-predictor-7fbb84df9c-ktxjt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-4fa95-predictor-7fbb84df9c-ktxjt to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-c9f9f-predictor-8b8564854-4sftk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-c9f9f-predictor-8b8564854-4sftk to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-d627c-predictor-549977b56d-df86j |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-d627c-predictor-549977b56d-df86j to ip-10-0-129-98.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq to ip-10-0-135-201.ec2.internal | ||
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-4fa95-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-4fa95-predictor-5756bcc86 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-669d8d6456 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-669d8d6456-xh9nx | |
kserve-ci-e2e-test |
multus |
error-404-isvc-4fa95-predictor-7fbb84df9c-ktxjt |
AddedInterface |
Add eth0 [10.133.0.21/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-4fa95-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-4fa95-predictor-7fbb84df9c from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-cd88dc55b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-cd88dc55b |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-4fa95-predictor-5756bcc86 |
SuccessfulCreate |
Created pod: success-200-isvc-4fa95-predictor-5756bcc86-4mc9k | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-4fa95 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-4fa95": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-4fa95": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-4fa95 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-4fa95": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-76c859ccb from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-4fa95-predictor-5756bcc86-4mc9k |
AddedInterface |
Add eth0 [10.133.0.20/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-669d8d6456 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-4fa95-predictor-7fbb84df9c |
SuccessfulCreate |
Created pod: error-404-isvc-4fa95-predictor-7fbb84df9c-ktxjt | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4fa95-predictor-7fbb84df9c-ktxjt |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1435" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:72e9a53b4f6609f050c864ccf8bba3bc53b15bbbb0a09e5de74a3bdc7465dd84" | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm |
AddedInterface |
Add eth0 [10.132.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4fa95-predictor-5756bcc86-4mc9k |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1435" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xh9nx |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:72e9a53b4f6609f050c864ccf8bba3bc53b15bbbb0a09e5de74a3bdc7465dd84" | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-76c859ccb |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq |
AddedInterface |
Add eth0 [10.132.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:72e9a53b4f6609f050c864ccf8bba3bc53b15bbbb0a09e5de74a3bdc7465dd84" | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-669d8d6456-xh9nx |
AddedInterface |
Add eth0 [10.134.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xh9nx |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xh9nx |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xh9nx |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:72e9a53b4f6609f050c864ccf8bba3bc53b15bbbb0a09e5de74a3bdc7465dd84" in 3.29s (3.29s including waiting). Image size: 301492132 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:72e9a53b4f6609f050c864ccf8bba3bc53b15bbbb0a09e5de74a3bdc7465dd84" in 3.627s (3.627s including waiting). Image size: 301492132 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:72e9a53b4f6609f050c864ccf8bba3bc53b15bbbb0a09e5de74a3bdc7465dd84" in 2.579s (2.579s including waiting). Image size: 301492132 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1435" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1435" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xh9nx |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4fa95-predictor-5756bcc86-4mc9k |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4fa95-predictor-7fbb84df9c-ktxjt |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4fa95-predictor-7fbb84df9c-ktxjt |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4fa95-predictor-7fbb84df9c-ktxjt |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4fa95-predictor-7fbb84df9c-ktxjt |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1435" in 14.786s (14.786s including waiting). Image size: 1334716508 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4fa95-predictor-5756bcc86-4mc9k |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4fa95-predictor-5756bcc86-4mc9k |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4fa95-predictor-5756bcc86-4mc9k |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1435" in 15.06s (15.06s including waiting). Image size: 1337632867 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4fa95-predictor-5756bcc86-4mc9k |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4fa95-predictor-7fbb84df9c-ktxjt |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.48s (2.48s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4fa95-predictor-5756bcc86-4mc9k |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.471s (2.471s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4fa95-predictor-5756bcc86-4mc9k |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4fa95-predictor-7fbb84df9c-ktxjt |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4fa95-predictor-7fbb84df9c-ktxjt |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1435" in 16.593s (16.593s including waiting). Image size: 1560924583 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1435" in 16.604s (16.604s including waiting). Image size: 1560924583 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.548s (2.548s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.561s (2.561s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xh9nx |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xh9nx |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 21.583s (21.583s including waiting). Image size: 1306417402 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xh9nx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xh9nx |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xh9nx |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.309s (2.309s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xh9nx |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xh9nx |
Created |
Created container: kube-rbac-proxy | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4fa95-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4fa95-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4fa95-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4fa95-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-4fa95-predictor-7fbb84df9c-ktxjt |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.21:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4fa95 |
InferenceServiceReady |
InferenceService [error-404-isvc-4fa95] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-4fa95 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-4fa95 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-4fa95 |
InferenceServiceReady |
InferenceService [success-200-isvc-4fa95] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4fa95-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-4fa95-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-4fa95 |
ScalingReplicaSet |
Scaled up replica set switch-graph-4fa95-549f8ff959 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-4fa95-549f8ff959-xxjk6 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:8608123ddb1fc42bff2e1c9ce408ce175b3696948e68bd4ec98a77fff89c49f4" | |
| (x7) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xh9nx |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.22:8080: connect: connection refused |
kserve-ci-e2e-test |
multus |
switch-graph-4fa95-549f8ff959-xxjk6 |
AddedInterface |
Add eth0 [10.133.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-4fa95-549f8ff959 |
SuccessfulCreate |
Created pod: switch-graph-4fa95-549f8ff959-xxjk6 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-4fa95 |
InferenceGraphReady |
InferenceGraph [switch-graph-4fa95] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-4fa95-549f8ff959-xxjk6 |
Started |
Started container switch-graph-4fa95 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-4fa95-549f8ff959-xxjk6 |
Created |
Created container: switch-graph-4fa95 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-4fa95-549f8ff959-xxjk6 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:8608123ddb1fc42bff2e1c9ce408ce175b3696948e68bd4ec98a77fff89c49f4" in 3.211s (3.211s including waiting). Image size: 216346185 bytes. | |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.32:8080: connect: connection refused |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.33:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4fa95-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-4fa95-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-b9319-predictor-67fcdd6676 |
SuccessfulCreate |
Created pod: success-200-isvc-b9319-predictor-67fcdd6676-f9tsk | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b9319 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-b9319": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-b9319": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4fa95-predictor-7fbb84df9c-ktxjt |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
switch-graph-4fa95-549f8ff959-xxjk6 |
Killing |
Stopping container switch-graph-4fa95 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b9319 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-b9319": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b9319 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-b9319": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-b9319": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-b9319-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-b9319-predictor-67fcdd6676 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-4fa95-predictor-7fbb84df9c-ktxjt |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-b9319-predictor-65db6866c5 |
SuccessfulCreate |
Created pod: error-404-isvc-b9319-predictor-65db6866c5-fqs22 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-b9319-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-b9319-predictor-65db6866c5 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b9319 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-b9319": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4fa95-predictor-5756bcc86-4mc9k |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4fa95-predictor-5756bcc86-4mc9k |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9319-predictor-67fcdd6676-f9tsk |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1435" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9319-predictor-67fcdd6676-f9tsk |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-4fa95-predictor-5756bcc86-4mc9k |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.20:8643/healthz": dial tcp 10.133.0.20:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-4fa95-predictor-5756bcc86-4mc9k |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.20:8080: connect: connection refused |
kserve-ci-e2e-test |
multus |
error-404-isvc-b9319-predictor-65db6866c5-fqs22 |
AddedInterface |
Add eth0 [10.133.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9319-predictor-67fcdd6676-f9tsk |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9319-predictor-67fcdd6676-f9tsk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9319-predictor-67fcdd6676-f9tsk |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9319-predictor-67fcdd6676-f9tsk |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-b9319-predictor-67fcdd6676-f9tsk |
AddedInterface |
Add eth0 [10.133.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9319-predictor-65db6866c5-fqs22 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1435" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9319-predictor-65db6866c5-fqs22 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9319-predictor-65db6866c5-fqs22 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9319-predictor-65db6866c5-fqs22 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9319-predictor-65db6866c5-fqs22 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9319-predictor-65db6866c5-fqs22 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x8) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b9319-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b9319-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
model-chainer-6fc6549cd8-x4sbs |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-6fc6549cd8-x4sbs |
Created |
Created container: model-chainer | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-4fa95-549f8ff959-xxjk6 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
model-chainer-6fc6549cd8-x4sbs |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8608123ddb1fc42bff2e1c9ce408ce175b3696948e68bd4ec98a77fff89c49f4" already present on machine | |
kserve-ci-e2e-test |
multus |
model-chainer-6fc6549cd8-x4sbs |
AddedInterface |
Add eth0 [10.133.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-6fc6549cd8 |
SuccessfulCreate |
Created pod: model-chainer-6fc6549cd8-x4sbs | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-6fc6549cd8 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b9319-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b9319-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-b9ddf-predictor-66459c556f |
SuccessfulCreate |
Created pod: error-404-isvc-b9ddf-predictor-66459c556f-np74k | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b9ddf |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-b9ddf": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9ddf-predictor-75548d844b-lf92z |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1435" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-b9ddf-predictor-75548d844b |
SuccessfulCreate |
Created pod: success-200-isvc-b9ddf-predictor-75548d844b-lf92z | |
kserve-ci-e2e-test |
multus |
error-404-isvc-b9ddf-predictor-66459c556f-np74k |
AddedInterface |
Add eth0 [10.133.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9ddf-predictor-66459c556f-np74k |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1435" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xh9nx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-xh9nx |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.33:8643/healthz": dial tcp 10.132.0.33:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9ddf-predictor-75548d844b-lf92z |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-76c859ccb-xxwlq |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9ddf-predictor-75548d844b-lf92z |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9ddf-predictor-75548d844b-lf92z |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-b9ddf-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-b9ddf-predictor-66459c556f from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9ddf-predictor-75548d844b-lf92z |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9ddf-predictor-75548d844b-lf92z |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.32:8643/healthz": dial tcp 10.132.0.32:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-cd88dc55b-j42rm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
model-chainer-6fc6549cd8-x4sbs |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b9ddf |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-b9ddf": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-b9ddf": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-b9ddf-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-b9ddf-predictor-75548d844b from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-b9ddf-predictor-75548d844b-lf92z |
AddedInterface |
Add eth0 [10.133.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9ddf-predictor-66459c556f-np74k |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9ddf-predictor-66459c556f-np74k |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9ddf-predictor-66459c556f-np74k |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9ddf-predictor-66459c556f-np74k |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9ddf-predictor-66459c556f-np74k |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b9319 |
InferenceServiceReady |
InferenceService [error-404-isvc-b9319] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b9319 |
InferenceServiceReady |
InferenceService [success-200-isvc-b9319] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b9319 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b9319 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b9319-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b9319-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-b9319 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-b9319": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-b9319 |
ScalingReplicaSet |
Scaled up replica set switch-graph-b9319-859cc9dd58 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-b9319 |
InferenceGraphReady |
InferenceGraph [switch-graph-b9319] is Ready | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-b9319 |
UpdateFailed |
Failed to update status for InferenceGraph "switch-graph-b9319": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-b9319": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-b9319-859cc9dd58 |
SuccessfulCreate |
Created pod: switch-graph-b9319-859cc9dd58-k7xmt | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b9319-859cc9dd58-k7xmt |
Created |
Created container: switch-graph-b9319 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b9319-859cc9dd58-k7xmt |
Started |
Started container switch-graph-b9319 | |
kserve-ci-e2e-test |
multus |
switch-graph-b9319-859cc9dd58-k7xmt |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b9319-859cc9dd58-k7xmt |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8608123ddb1fc42bff2e1c9ce408ce175b3696948e68bd4ec98a77fff89c49f4" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-6fc6549cd8-x4sbs |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b9319-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b9319-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b9ddf-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b9ddf-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b9ddf-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b9ddf-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b9ddf |
InferenceServiceReady |
InferenceService [success-200-isvc-b9ddf] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b9ddf |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b9ddf |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b9ddf |
InferenceServiceReady |
InferenceService [error-404-isvc-b9ddf] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-b9319 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-b9319 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
sequence-graph-b9ddf-6dfbc67fd6-5m5nx |
Started |
Started container sequence-graph-b9ddf | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-b9ddf-6dfbc67fd6-5m5nx |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8608123ddb1fc42bff2e1c9ce408ce175b3696948e68bd4ec98a77fff89c49f4" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-b9ddf |
ScalingReplicaSet |
Scaled up replica set sequence-graph-b9ddf-6dfbc67fd6 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-b9ddf |
InferenceGraphReady |
InferenceGraph [sequence-graph-b9ddf] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-b9ddf-6dfbc67fd6 |
SuccessfulCreate |
Created pod: sequence-graph-b9ddf-6dfbc67fd6-5m5nx | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-b9ddf-6dfbc67fd6-5m5nx |
Created |
Created container: sequence-graph-b9ddf | |
kserve-ci-e2e-test |
multus |
sequence-graph-b9ddf-6dfbc67fd6-5m5nx |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-b9ddf |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b9ddf-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b9ddf-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-b9ddf |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-b9ddf |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-b9ddf |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b9ddf-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b9ddf-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-d627c-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-d627c-predictor-549977b56d from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d627c |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-d627c": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-d627c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9319-predictor-67fcdd6676-f9tsk |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9319-predictor-65db6866c5-fqs22 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9319-predictor-65db6866c5-fqs22 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
switch-graph-b9319-859cc9dd58-k7xmt |
Killing |
Stopping container switch-graph-b9319 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d627c |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-d627c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d627c |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-d627c": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-d627c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
success-200-isvc-d627c-predictor-549977b56d-df86j |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d627c-predictor-549977b56d-df86j |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1435" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d627c-predictor-549977b56d-df86j |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d627c-predictor-549977b56d-df86j |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d627c-predictor-549977b56d-df86j |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d627c-predictor-549977b56d-df86j |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d627c-predictor-549977b56d-df86j |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-d627c-predictor-549977b56d |
SuccessfulCreate |
Created pod: success-200-isvc-d627c-predictor-549977b56d-df86j | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9319-predictor-67fcdd6676-f9tsk |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d627c-predictor-859777b8f9-r2nqq |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-d627c-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-d627c-predictor-859777b8f9 |
SuccessfulCreate |
Created pod: error-404-isvc-d627c-predictor-859777b8f9-r2nqq | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-d627c-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-d627c-predictor-859777b8f9 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d627c |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-d627c": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d627c-predictor-859777b8f9-r2nqq |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-d627c-predictor-859777b8f9-r2nqq |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d627c-predictor-859777b8f9-r2nqq |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1435" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d627c-predictor-859777b8f9-r2nqq |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d627c-predictor-859777b8f9-r2nqq |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d627c-predictor-859777b8f9-r2nqq |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d627c-predictor-859777b8f9-r2nqq |
Started |
Started container kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9319-predictor-65db6866c5-fqs22 |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.24:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9319-predictor-67fcdd6676-f9tsk |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.23:8643/healthz": dial tcp 10.133.0.23:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9319-predictor-67fcdd6676-f9tsk |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.23:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9319-predictor-65db6866c5-fqs22 |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.24:8643/healthz": dial tcp 10.133.0.24:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-b9319-859cc9dd58-k7xmt |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d627c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d627c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d627c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d627c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9ddf-predictor-66459c556f-np74k |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9ddf-predictor-66459c556f-np74k |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c9f9f-predictor-75597dd9f7-czccf |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1435" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c9f9f |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-c9f9f": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
error-404-isvc-c9f9f-predictor-75597dd9f7-czccf |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c9f9f-predictor-75597dd9f7-czccf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c9f9f-predictor-75597dd9f7-czccf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c9f9f |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-c9f9f": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-c9f9f": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-c9f9f-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-c9f9f-predictor-8b8564854 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-c9f9f-predictor-8b8564854 |
SuccessfulCreate |
Created pod: success-200-isvc-c9f9f-predictor-8b8564854-4sftk | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c9f9f-predictor-75597dd9f7-czccf |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c9f9f-predictor-75597dd9f7-czccf |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-c9f9f-predictor-75597dd9f7 |
SuccessfulCreate |
Created pod: error-404-isvc-c9f9f-predictor-75597dd9f7-czccf | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-b9ddf-6dfbc67fd6-5m5nx |
Killing |
Stopping container sequence-graph-b9ddf | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-c9f9f-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-c9f9f-predictor-75597dd9f7 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c9f9f |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-c9f9f": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-c9f9f": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c9f9f |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-c9f9f": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9ddf-predictor-75548d844b-lf92z |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9ddf-predictor-75548d844b-lf92z |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c9f9f-predictor-8b8564854-4sftk |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-c9f9f-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c9f9f-predictor-8b8564854-4sftk |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1435" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-c9f9f-predictor-8b8564854-4sftk |
AddedInterface |
Add eth0 [10.133.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c9f9f-predictor-8b8564854-4sftk |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c9f9f-predictor-75597dd9f7-czccf |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c9f9f-predictor-8b8564854-4sftk |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c9f9f-predictor-8b8564854-4sftk |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c9f9f-predictor-8b8564854-4sftk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c9f9f-predictor-8b8564854-4sftk |
Created |
Created container: kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9ddf-predictor-75548d844b-lf92z |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.26:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9ddf-predictor-66459c556f-np74k |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.27:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b9ddf-predictor-66459c556f-np74k |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.27:8643/healthz": dial tcp 10.133.0.27:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-d627c-predictor-859777b8f9-r2nqq |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.31:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b9ddf-predictor-75548d844b-lf92z |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.26:8643/healthz": dial tcp 10.133.0.26:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-d627c-predictor-549977b56d-df86j |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.30:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d627c |
InferenceServiceReady |
InferenceService [error-404-isvc-d627c] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-d627c |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d627c |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-d627c |
InferenceServiceReady |
InferenceService [success-200-isvc-d627c] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-b9ddf-6dfbc67fd6-5m5nx |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-d627c |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-d627c-66c94ccd96 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-d627c-66c94ccd96 |
SuccessfulCreate |
Created pod: ensemble-graph-d627c-66c94ccd96-ml4rc | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-d627c |
InferenceGraphReady |
InferenceGraph [ensemble-graph-d627c] is Ready | |
| (x2) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-d627c-66c94ccd96-ml4rc |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-d627c-serving-cert" not found |
kserve-ci-e2e-test |
multus |
ensemble-graph-d627c-66c94ccd96-ml4rc |
AddedInterface |
Add eth0 [10.133.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-d627c-66c94ccd96-ml4rc |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8608123ddb1fc42bff2e1c9ce408ce175b3696948e68bd4ec98a77fff89c49f4" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-d627c-66c94ccd96-ml4rc |
Created |
Created container: ensemble-graph-d627c | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-d627c-66c94ccd96-ml4rc |
Started |
Started container ensemble-graph-d627c | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-c9f9f-predictor-75597dd9f7-czccf |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.33:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d627c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-d627c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-c9f9f-predictor-8b8564854-4sftk |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.32:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d627c-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-d627c-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-d627c-66c94ccd96-ml4rc |
Killing |
Stopping container ensemble-graph-d627c | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d627c-predictor-549977b56d-df86j |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d627c-predictor-859777b8f9-r2nqq |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-ac6c8-predictor-864c9c7dfd |
SuccessfulCreate |
Created pod: success-200-isvc-ac6c8-predictor-864c9c7dfd-5fqlc | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d627c-predictor-549977b56d-df86j |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-ac6c8-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-ac6c8-predictor-864c9c7dfd from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ac6c8 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-ac6c8": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d627c-predictor-859777b8f9-r2nqq |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ac6c8 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-ac6c8": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-ac6c8": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ac6c8-predictor-864c9c7dfd-5fqlc |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-ac6c8-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ac6c8 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-ac6c8": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-ac6c8": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ac6c8 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-ac6c8": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-ac6c8-predictor-6bb86d49d9 |
SuccessfulCreate |
Created pod: error-404-isvc-ac6c8-predictor-6bb86d49d9-btthf | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-ac6c8-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-ac6c8-predictor-6bb86d49d9 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-ac6c8-predictor-864c9c7dfd-5fqlc |
AddedInterface |
Add eth0 [10.133.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ac6c8-predictor-864c9c7dfd-5fqlc |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1435" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ac6c8-predictor-6bb86d49d9-btthf |
Created |
Created container: kube-rbac-proxy | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c9f9f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c9f9f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ac6c8-predictor-6bb86d49d9-btthf |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ac6c8-predictor-6bb86d49d9-btthf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ac6c8-predictor-6bb86d49d9-btthf |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ac6c8-predictor-6bb86d49d9-btthf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ac6c8-predictor-6bb86d49d9-btthf |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1435" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-ac6c8-predictor-6bb86d49d9-btthf |
AddedInterface |
Add eth0 [10.133.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ac6c8-predictor-864c9c7dfd-5fqlc |
Created |
Created container: kserve-container | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c9f9f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c9f9f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ac6c8-predictor-864c9c7dfd-5fqlc |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ac6c8-predictor-864c9c7dfd-5fqlc |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ac6c8-predictor-864c9c7dfd-5fqlc |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ac6c8-predictor-864c9c7dfd-5fqlc |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-d627c-predictor-549977b56d-df86j |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.30:8643/healthz": dial tcp 10.133.0.30:8643: connect: connection refused | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c9f9f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-c9f9f |
InferenceServiceReady |
InferenceService [error-404-isvc-c9f9f] is Ready | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-d627c-predictor-859777b8f9-r2nqq |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.31:8643/healthz": dial tcp 10.133.0.31:8643: connect: connection refused | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c9f9f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-c9f9f |
InferenceServiceReady |
InferenceService [success-200-isvc-c9f9f] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ac6c8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ac6c8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-c9f9f-5dd8ccddf4-44z4s |
Started |
Started container sequence-graph-c9f9f | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-c9f9f-5dd8ccddf4-44z4s |
Created |
Created container: sequence-graph-c9f9f | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-c9f9f |
ScalingReplicaSet |
Scaled up replica set sequence-graph-c9f9f-5dd8ccddf4 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-c9f9f-5dd8ccddf4 |
SuccessfulCreate |
Created pod: sequence-graph-c9f9f-5dd8ccddf4-44z4s | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c9f9f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-c9f9f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-c9f9f |
InferenceGraphReady |
InferenceGraph [sequence-graph-c9f9f] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-c9f9f-5dd8ccddf4-44z4s |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8608123ddb1fc42bff2e1c9ce408ce175b3696948e68bd4ec98a77fff89c49f4" already present on machine | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c9f9f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-c9f9f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
multus |
sequence-graph-c9f9f-5dd8ccddf4-44z4s |
AddedInterface |
Add eth0 [10.133.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c9f9f-predictor-75597dd9f7-czccf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1f95-predictor-78c8c57784-68slp |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-e1f95-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c9f9f-predictor-75597dd9f7-czccf |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-e1f95-predictor-6cb95bc7c9 |
SuccessfulCreate |
Created pod: error-404-isvc-e1f95-predictor-6cb95bc7c9-qwdsm | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c9f9f-predictor-8b8564854-4sftk |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-c9f9f-predictor-8b8564854-4sftk |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e1f95 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-e1f95": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-e1f95": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e1f95 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-e1f95": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-e1f95-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-e1f95-predictor-6cb95bc7c9 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-c9f9f-5dd8ccddf4-44z4s |
Killing |
Stopping container sequence-graph-c9f9f | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e1f95 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-e1f95": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-e1f95": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e1f95 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-e1f95": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-e1f95-predictor-78c8c57784 |
SuccessfulCreate |
Created pod: success-200-isvc-e1f95-predictor-78c8c57784-68slp | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-e1f95-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-e1f95-predictor-78c8c57784 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1f95-predictor-6cb95bc7c9-qwdsm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1f95-predictor-78c8c57784-68slp |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-e1f95-predictor-6cb95bc7c9-qwdsm |
AddedInterface |
Add eth0 [10.133.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1f95-predictor-78c8c57784-68slp |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1f95-predictor-78c8c57784-68slp |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1f95-predictor-78c8c57784-68slp |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1435" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-e1f95-predictor-78c8c57784-68slp |
AddedInterface |
Add eth0 [10.133.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1f95-predictor-6cb95bc7c9-qwdsm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1f95-predictor-6cb95bc7c9-qwdsm |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1f95-predictor-6cb95bc7c9-qwdsm |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1435" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1f95-predictor-6cb95bc7c9-qwdsm |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1f95-predictor-6cb95bc7c9-qwdsm |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1f95-predictor-78c8c57784-68slp |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1f95-predictor-78c8c57784-68slp |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-d627c-66c94ccd96-ml4rc |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-c9f9f-predictor-75597dd9f7-czccf |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.33:8643/healthz": dial tcp 10.133.0.33:8643: connect: connection refused | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ac6c8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ac6c8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-ac6c8-predictor-864c9c7dfd-5fqlc |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.35:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-c9f9f-5dd8ccddf4-44z4s |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e1f95-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e1f95-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e1f95-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e1f95-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ac6c8 |
InferenceServiceReady |
InferenceService [error-404-isvc-ac6c8] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-ac6c8 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ac6c8 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-ac6c8 |
InferenceServiceReady |
InferenceService [success-200-isvc-ac6c8] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1f95-predictor-78c8c57784-68slp |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.38:8080: connect: connection refused |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-ac6c8 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-ac6c8] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-ac6c8-87cf995b8 |
SuccessfulCreate |
Created pod: ensemble-graph-ac6c8-87cf995b8-z6wk9 | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-ac6c8 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-ac6c8-87cf995b8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-ac6c8-87cf995b8-z6wk9 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8608123ddb1fc42bff2e1c9ce408ce175b3696948e68bd4ec98a77fff89c49f4" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-ac6c8-87cf995b8-z6wk9 |
Created |
Created container: ensemble-graph-ac6c8 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-ac6c8-87cf995b8-z6wk9 |
Started |
Started container ensemble-graph-ac6c8 | |
kserve-ci-e2e-test |
multus |
ensemble-graph-ac6c8-87cf995b8-z6wk9 |
AddedInterface |
Add eth0 [10.133.0.40/23] from ovn-kubernetes | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e1f95 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-e1f95 |
InferenceServiceReady |
InferenceService [error-404-isvc-e1f95] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e1f95 |
InferenceServiceReady |
InferenceService [success-200-isvc-e1f95] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-e1f95 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-e1f95-6b4654b7f9 |
SuccessfulCreate |
Created pod: sequence-graph-e1f95-6b4654b7f9-bt48g | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-e1f95 |
InferenceGraphReady |
InferenceGraph [sequence-graph-e1f95] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-e1f95 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-e1f95-6b4654b7f9 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-e1f95-6b4654b7f9-bt48g |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8608123ddb1fc42bff2e1c9ce408ce175b3696948e68bd4ec98a77fff89c49f4" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-e1f95-6b4654b7f9-bt48g |
Started |
Started container sequence-graph-e1f95 | |
kserve-ci-e2e-test |
multus |
sequence-graph-e1f95-6b4654b7f9-bt48g |
AddedInterface |
Add eth0 [10.133.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-e1f95-6b4654b7f9-bt48g |
Created |
Created container: sequence-graph-e1f95 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ac6c8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-ac6c8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-ac6c8 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-ac6c8 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e1f95-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-e1f95-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ac6c8-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-ac6c8-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-e1f95 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-e1f95 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e1f95-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-e1f95-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7621b-predictor-5f89d47788-7mplf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ac6c8-predictor-864c9c7dfd-5fqlc |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7621b |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-7621b": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-7621b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7621b |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-7621b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-7621b-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-7621b-predictor-5f89d47788 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-7621b-predictor-6d5bd65f5f |
SuccessfulCreate |
Created pod: error-404-isvc-7621b-predictor-6d5bd65f5f-bjtpt | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-7621b-predictor-5f89d47788 |
SuccessfulCreate |
Created pod: success-200-isvc-7621b-predictor-5f89d47788-7mplf | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-7621b-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-7621b-predictor-6d5bd65f5f from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7621b-predictor-5f89d47788-7mplf |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7621b-predictor-5f89d47788-7mplf |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7621b-predictor-5f89d47788-7mplf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-7621b-predictor-6d5bd65f5f-bjtpt |
AddedInterface |
Add eth0 [10.133.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7621b-predictor-5f89d47788-7mplf |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1435" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-7621b-predictor-5f89d47788-7mplf |
AddedInterface |
Add eth0 [10.133.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7621b-predictor-6d5bd65f5f-bjtpt |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1435" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7621b |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-7621b": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-7621b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-ac6c8-predictor-864c9c7dfd-5fqlc |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-ac6c8-87cf995b8-z6wk9 |
Killing |
Stopping container ensemble-graph-ac6c8 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7621b |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-7621b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ac6c8-predictor-6bb86d49d9-btthf |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ac6c8-predictor-6bb86d49d9-btthf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7621b-predictor-6d5bd65f5f-bjtpt |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7621b-predictor-6d5bd65f5f-bjtpt |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7621b-predictor-6d5bd65f5f-bjtpt |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7621b-predictor-6d5bd65f5f-bjtpt |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7621b-predictor-5f89d47788-7mplf |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7621b-predictor-6d5bd65f5f-bjtpt |
Started |
Started container kube-rbac-proxy | |
| (x8) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-ac6c8-predictor-6bb86d49d9-btthf |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.36:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-ac6c8-predictor-6bb86d49d9-btthf |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.36:8643/healthz": dial tcp 10.133.0.36:8643: connect: connection refused | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-a37f5-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-a37f5-predictor-68dfd7bf6d from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a37f5 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-a37f5": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-a37f5": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1f95-predictor-78c8c57784-68slp |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-a37f5-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-a37f5-predictor-547f4c9447 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-a37f5-predictor-547f4c9447 |
SuccessfulCreate |
Created pod: error-404-isvc-a37f5-predictor-547f4c9447-g2whm | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-a37f5-predictor-68dfd7bf6d |
SuccessfulCreate |
Created pod: success-200-isvc-a37f5-predictor-68dfd7bf6d-p6m6w | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1f95-predictor-6cb95bc7c9-qwdsm |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-e1f95-6b4654b7f9-bt48g |
Killing |
Stopping container sequence-graph-e1f95 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-e1f95-predictor-78c8c57784-68slp |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a37f5-predictor-68dfd7bf6d-p6m6w |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1f95-predictor-6cb95bc7c9-qwdsm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a37f5-predictor-68dfd7bf6d-p6m6w |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a37f5-predictor-68dfd7bf6d-p6m6w |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a37f5-predictor-68dfd7bf6d-p6m6w |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a37f5-predictor-68dfd7bf6d-p6m6w |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a37f5-predictor-547f4c9447-g2whm |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-a37f5-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a37f5 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-a37f5": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
success-200-isvc-a37f5-predictor-68dfd7bf6d-p6m6w |
AddedInterface |
Add eth0 [10.133.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a37f5-predictor-68dfd7bf6d-p6m6w |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1435" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-a37f5-predictor-547f4c9447-g2whm |
AddedInterface |
Add eth0 [10.133.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a37f5-predictor-547f4c9447-g2whm |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1435" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a37f5-predictor-547f4c9447-g2whm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a37f5-predictor-547f4c9447-g2whm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a37f5-predictor-547f4c9447-g2whm |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a37f5-predictor-547f4c9447-g2whm |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a37f5-predictor-547f4c9447-g2whm |
Started |
Started container kube-rbac-proxy | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1f95-predictor-6cb95bc7c9-qwdsm |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.39:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-e1f95-predictor-6cb95bc7c9-qwdsm |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.39:8643/healthz": dial tcp 10.133.0.39:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-ac6c8-87cf995b8-z6wk9 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7621b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7621b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7621b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7621b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-7621b-predictor-6d5bd65f5f-bjtpt |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.43:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-e1f95-6b4654b7f9-bt48g |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7621b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7621b |
InferenceServiceReady |
InferenceService [error-404-isvc-7621b] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-a37f5-predictor-68dfd7bf6d-p6m6w |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.44:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7621b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7621b |
InferenceServiceReady |
InferenceService [success-200-isvc-7621b] is Ready | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-a37f5-predictor-547f4c9447-g2whm |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.45:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a37f5 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a37f5 |
InferenceServiceReady |
InferenceService [success-200-isvc-a37f5] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-7621b-7fdfb8f889 |
SuccessfulCreate |
Created pod: splitter-graph-7621b-7fdfb8f889-6blhd | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-7621b |
InferenceGraphReady |
InferenceGraph [splitter-graph-7621b] is Ready | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-7621b-7fdfb8f889-6blhd |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-7621b-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-7621b |
ScalingReplicaSet |
Scaled up replica set splitter-graph-7621b-7fdfb8f889 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-7621b-7fdfb8f889-6blhd |
Started |
Started container splitter-graph-7621b | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-7621b-7fdfb8f889-6blhd |
Created |
Created container: splitter-graph-7621b | |
kserve-ci-e2e-test |
multus |
splitter-graph-7621b-7fdfb8f889-6blhd |
AddedInterface |
Add eth0 [10.133.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-7621b-7fdfb8f889-6blhd |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8608123ddb1fc42bff2e1c9ce408ce175b3696948e68bd4ec98a77fff89c49f4" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a37f5 |
InferenceServiceReady |
InferenceService [error-404-isvc-a37f5] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a37f5 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7621b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7621b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7621b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7621b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-a37f5 |
InferenceGraphReady |
InferenceGraph [switch-graph-a37f5] is Ready | |
kserve-ci-e2e-test |
multus |
switch-graph-a37f5-68dd44b8fb-97nlg |
AddedInterface |
Add eth0 [10.133.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-a37f5-68dd44b8fb-97nlg |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8608123ddb1fc42bff2e1c9ce408ce175b3696948e68bd4ec98a77fff89c49f4" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-a37f5-68dd44b8fb-97nlg |
Created |
Created container: switch-graph-a37f5 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-a37f5-68dd44b8fb-97nlg |
Started |
Started container switch-graph-a37f5 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-a37f5-68dd44b8fb |
SuccessfulCreate |
Created pod: switch-graph-a37f5-68dd44b8fb-97nlg | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-a37f5 |
ScalingReplicaSet |
Scaled up replica set switch-graph-a37f5-68dd44b8fb from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7621b-predictor-6d5bd65f5f-bjtpt |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7621b-predictor-5f89d47788-7mplf |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-41340 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-41340": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-7621b-7fdfb8f889-6blhd |
Killing |
Stopping container splitter-graph-7621b | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-41340-predictor-897fcb |
SuccessfulCreate |
Created pod: success-200-isvc-41340-predictor-897fcb-v7pwp | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-41340-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-41340-predictor-694448f7cf from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-41340 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-41340": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-41340": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7621b-predictor-6d5bd65f5f-bjtpt |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-41340 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-41340": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-41340-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-41340-predictor-897fcb from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-41340-predictor-694448f7cf |
SuccessfulCreate |
Created pod: error-404-isvc-41340-predictor-694448f7cf-n9r4s | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-41340 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-41340": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-41340": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7621b-predictor-5f89d47788-7mplf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-41340-predictor-694448f7cf-n9r4s |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-41340-predictor-897fcb-v7pwp |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-41340-predictor-897fcb-v7pwp |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-41340-predictor-897fcb-v7pwp |
AddedInterface |
Add eth0 [10.133.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-41340-predictor-897fcb-v7pwp |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-41340-predictor-694448f7cf-n9r4s |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-41340-predictor-897fcb-v7pwp |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1435" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-41340-predictor-694448f7cf-n9r4s |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-41340-predictor-694448f7cf-n9r4s |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-41340-predictor-694448f7cf-n9r4s |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1435" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-41340-predictor-694448f7cf-n9r4s |
AddedInterface |
Add eth0 [10.133.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-41340-predictor-694448f7cf-n9r4s |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-41340-predictor-897fcb-v7pwp |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-41340-predictor-897fcb-v7pwp |
Created |
Created container: kube-rbac-proxy | |
| (x8) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-7621b-predictor-5f89d47788-7mplf |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.42:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7621b-predictor-5f89d47788-7mplf |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.42:8643/healthz": dial tcp 10.133.0.42:8643: connect: connection refused | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-41340-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-41340-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a37f5-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a37f5-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a37f5-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a37f5-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-7621b-7fdfb8f889-6blhd |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-a37f5 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a37f5-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-a37f5 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a37f5-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-41340-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-41340-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-41340 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-41340 |
InferenceServiceReady |
InferenceService [error-404-isvc-41340] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-41340 |
InferenceServiceReady |
InferenceService [success-200-isvc-41340] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-41340 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a37f5-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a37f5-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-41340 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-41340-79656bc944 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-41340-79656bc944-xx8ss |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "splitter-graph-41340-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-41340-79656bc944 |
SuccessfulCreate |
Created pod: splitter-graph-41340-79656bc944-xx8ss | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-41340 |
InferenceGraphReady |
InferenceGraph [splitter-graph-41340] is Ready | |
kserve-ci-e2e-test |
multus |
splitter-graph-41340-79656bc944-xx8ss |
AddedInterface |
Add eth0 [10.133.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-41340-79656bc944-xx8ss |
Started |
Started container splitter-graph-41340 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-41340-79656bc944-xx8ss |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:8608123ddb1fc42bff2e1c9ce408ce175b3696948e68bd4ec98a77fff89c49f4" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-41340-79656bc944-xx8ss |
Created |
Created container: splitter-graph-41340 | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-41340-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-41340-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-41340-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-41340-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-41340 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-41340 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-41340-predictor-694448f7cf-n9r4s |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-41340-predictor-897fcb-v7pwp |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-41340-79656bc944-xx8ss |
Killing |
Stopping container splitter-graph-41340 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-41340-predictor-897fcb-v7pwp |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-41340-predictor-694448f7cf-n9r4s |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-41340-predictor-897fcb-v7pwp |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.48:8643/healthz": dial tcp 10.133.0.48:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-41340-predictor-694448f7cf-n9r4s |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.49:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-41340-predictor-694448f7cf-n9r4s |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.49:8643/healthz": dial tcp 10.133.0.49:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-41340-predictor-897fcb-v7pwp |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.48:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-41340-79656bc944-xx8ss |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a37f5-predictor-68dfd7bf6d-p6m6w |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a37f5-predictor-68dfd7bf6d-p6m6w |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
switch-graph-a37f5-68dd44b8fb-97nlg |
Killing |
Stopping container switch-graph-a37f5 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a37f5-predictor-547f4c9447-g2whm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a37f5-predictor-547f4c9447-g2whm |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a37f5-predictor-68dfd7bf6d-p6m6w |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.44:8643/healthz": dial tcp 10.133.0.44:8643: connect: connection refused | |
| (x5) | kserve-ci-e2e-test |
kubelet |
switch-graph-a37f5-68dd44b8fb-97nlg |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |