| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
success-200-isvc-1f299-predictor-5f5c5bc97d-gfzpj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-1f299-predictor-5f5c5bc97d-gfzpj to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-566f7f6cdf-kxkvs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-566f7f6cdf-kxkvs to ip-10-0-142-196.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-1d1fb-predictor-5c99c98b8f-cn2lm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-1d1fb-predictor-5c99c98b8f-cn2lm to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-1f299-predictor-576964885f-fklcx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-1f299-predictor-576964885f-fklcx to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-fcea7-predictor-597cb8b869-vsl4f |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-fcea7-predictor-597cb8b869-vsl4f to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-6457847f78-pbmzs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-6457847f78-pbmzs to ip-10-0-128-222.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-19dbe-5c5f9dbf9c-465cw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-19dbe-5c5f9dbf9c-465cw to ip-10-0-142-196.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-555fc69d56-6lsvv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-6lsvv to ip-10-0-142-196.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-6a778-predictor-84cc69f4d7-sn28q |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-6a778-predictor-84cc69f4d7-sn28q to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-fcea7-predictor-6bfb44d5b-5wgj8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-fcea7-predictor-6bfb44d5b-5wgj8 to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk to ip-10-0-128-222.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-19dbe-predictor-7bddfb8787-tsf9j |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-19dbe-predictor-7bddfb8787-tsf9j to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-969ee-predictor-7bffb9f7df-jdmch |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-969ee-predictor-7bffb9f7df-jdmch to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-fcea7-55b4968c6b-9nlgt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-fcea7-55b4968c6b-9nlgt to ip-10-0-142-196.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-daa19-predictor-64588c679c-fz4x9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-daa19-predictor-64588c679c-fz4x9 to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-cf726-predictor-68d66b987c-qrz2j |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-cf726-predictor-68d66b987c-qrz2j to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-19dbe-predictor-96fddc7c8-lvhzp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-19dbe-predictor-96fddc7c8-lvhzp to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-969ee-6dc8cf5c6c-t4wgz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-969ee-6dc8cf5c6c-t4wgz to ip-10-0-142-196.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-0591a-predictor-78848d555b-bpb6k |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-0591a-predictor-78848d555b-bpb6k to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-6a778-predictor-ff6c4454b-ftnlq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-6a778-predictor-ff6c4454b-ftnlq to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-969ee-predictor-84b4498f4d-sfpj9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-969ee-predictor-84b4498f4d-sfpj9 to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-6a778-54754f5494-z6lzx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-6a778-54754f5494-z6lzx to ip-10-0-142-196.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-9d406-predictor-9dcd77c94-qkb6v |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-9d406-predictor-9dcd77c94-qkb6v to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-daa19-predictor-78598b9488-nx46r |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-daa19-predictor-78598b9488-nx46r to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-0591a-predictor-dcb65fbbf-8qnfv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-0591a-predictor-dcb65fbbf-8qnfv to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-cf726-predictor-5d84565df6-lmbtw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-cf726-predictor-5d84565df6-lmbtw to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-0591a-587c6c6dd5-mlq7d |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-0591a-587c6c6dd5-mlq7d to ip-10-0-142-196.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-1d1fb-predictor-7c46f69ccb-95727 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-1d1fb-predictor-7c46f69ccb-95727 to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-1f299-85d87f69dc-7z9ns |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-1f299-85d87f69dc-7z9ns to ip-10-0-142-196.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-daa19-76989745dd-jw7xv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-daa19-76989745dd-jw7xv to ip-10-0-142-196.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-9d406-6b5656b658-2hfxw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-9d406-6b5656b658-2hfxw to ip-10-0-142-196.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-1d1fb-76459958d-swdvz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-1d1fb-76459958d-swdvz to ip-10-0-142-196.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-9d406-predictor-c94cb4b67-9qvp9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-9d406-predictor-c94cb4b67-9qvp9 to ip-10-0-134-77.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-cf726-66cb7b9f5f-c4q86 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-cf726-66cb7b9f5f-c4q86 to ip-10-0-142-196.ec2.internal | ||
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-19dbe-predictor-96fddc7c8 |
SuccessfulCreate |
Created pod: success-200-isvc-19dbe-predictor-96fddc7c8-lvhzp | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-64bf96469d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-6457847f78 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-6457847f78-pbmzs | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-19dbe-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-19dbe-predictor-96fddc7c8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-sklearn-graph-2-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-555fc69d56 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-555fc69d56 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-555fc69d56-6lsvv | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-19dbe-predictor-96fddc7c8-lvhzp |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-19dbe-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-19dbe-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-19dbe-predictor-7bddfb8787 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6457847f78-pbmzs |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-19dbe-predictor-7bddfb8787-tsf9j |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-19dbe-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-19dbe-predictor-7bddfb8787 |
SuccessfulCreate |
Created pod: error-404-isvc-19dbe-predictor-7bddfb8787-tsf9j | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6lsvv |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-xgboost-graph-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-6457847f78-pbmzs |
AddedInterface |
Add eth0 [10.133.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6457847f78-pbmzs |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:2c11b2794471bf8dc3adcf7eb800ee2cb196dcfdf71ab24c64a7547822ee5ced" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6457847f78-pbmzs |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-64bf96469d |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-6457847f78 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-19dbe-predictor-96fddc7c8-lvhzp |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1974" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:2c11b2794471bf8dc3adcf7eb800ee2cb196dcfdf71ab24c64a7547822ee5ced" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-19dbe-predictor-7bddfb8787-tsf9j |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1974" | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-555fc69d56-6lsvv |
AddedInterface |
Add eth0 [10.132.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6lsvv |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:2c11b2794471bf8dc3adcf7eb800ee2cb196dcfdf71ab24c64a7547822ee5ced" | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk |
AddedInterface |
Add eth0 [10.133.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
error-404-isvc-19dbe-predictor-7bddfb8787-tsf9j |
AddedInterface |
Add eth0 [10.134.0.16/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
success-200-isvc-19dbe-predictor-96fddc7c8-lvhzp |
AddedInterface |
Add eth0 [10.134.0.15/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6lsvv |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6457847f78-pbmzs |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1974" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6lsvv |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6lsvv |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:2c11b2794471bf8dc3adcf7eb800ee2cb196dcfdf71ab24c64a7547822ee5ced" in 3.389s (3.389s including waiting). Image size: 308214719 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1974" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6lsvv |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-19dbe-predictor-7bddfb8787-tsf9j |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-19dbe-predictor-7bddfb8787-tsf9j |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-19dbe-predictor-96fddc7c8-lvhzp |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1974" in 16.052s (16.052s including waiting). Image size: 1356696664 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-19dbe-predictor-96fddc7c8-lvhzp |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-19dbe-predictor-96fddc7c8-lvhzp |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-19dbe-predictor-96fddc7c8-lvhzp |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-19dbe-predictor-7bddfb8787-tsf9j |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1974" in 15.826s (15.826s including waiting). Image size: 1355712080 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-19dbe-predictor-7bddfb8787-tsf9j |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-19dbe-predictor-96fddc7c8-lvhzp |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-19dbe-predictor-7bddfb8787-tsf9j |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-19dbe-predictor-96fddc7c8-lvhzp |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.592s (2.592s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-19dbe-predictor-7bddfb8787-tsf9j |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.582s (2.582s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-19dbe-predictor-96fddc7c8-lvhzp |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-19dbe-predictor-7bddfb8787-tsf9j |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6457847f78-pbmzs |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6457847f78-pbmzs |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6457847f78-pbmzs |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1974" in 16.034s (16.034s including waiting). Image size: 1582981531 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6457847f78-pbmzs |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1974" in 16.943s (16.943s including waiting). Image size: 1582981531 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.426s (2.426s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6457847f78-pbmzs |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6457847f78-pbmzs |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6457847f78-pbmzs |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.475s (2.475s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6lsvv |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 17.856s (17.856s including waiting). Image size: 1332356353 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6lsvv |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6lsvv |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6lsvv |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6lsvv |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6lsvv |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6lsvv |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.157s (2.157s including waiting). Image size: 211946088 bytes. | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-19dbe-predictor-96fddc7c8-lvhzp |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.15:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-19dbe-predictor-7bddfb8787-tsf9j |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.16:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-19dbe-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-19dbe-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-19dbe-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-19dbe-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-19dbe |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-19dbe |
InferenceServiceReady |
InferenceService [success-200-isvc-19dbe] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-19dbe |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-19dbe |
InferenceServiceReady |
InferenceService [error-404-isvc-19dbe] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-19dbe-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-19dbe-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
switch-graph-19dbe-5c5f9dbf9c-465cw |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:a9a6602e4ff6d231668f86dd27b8a0b42e39ad3e4d5853d739607bad79c35374" | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-19dbe |
ScalingReplicaSet |
Scaled up replica set switch-graph-19dbe-5c5f9dbf9c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-19dbe-5c5f9dbf9c |
SuccessfulCreate |
Created pod: switch-graph-19dbe-5c5f9dbf9c-465cw | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-19dbe |
InferenceGraphReady |
InferenceGraph [switch-graph-19dbe] is Ready | |
kserve-ci-e2e-test |
multus |
switch-graph-19dbe-5c5f9dbf9c-465cw |
AddedInterface |
Add eth0 [10.132.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-19dbe-5c5f9dbf9c-465cw |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:a9a6602e4ff6d231668f86dd27b8a0b42e39ad3e4d5853d739607bad79c35374" in 2.199s (2.199s including waiting). Image size: 214921316 bytes. | |
kserve-ci-e2e-test |
kubelet |
switch-graph-19dbe-5c5f9dbf9c-465cw |
Started |
Started container switch-graph-19dbe | |
kserve-ci-e2e-test |
kubelet |
switch-graph-19dbe-5c5f9dbf9c-465cw |
Created |
Created container: switch-graph-19dbe | |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6lsvv |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.38:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-19dbe-predictor-7bddfb8787-tsf9j |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-cf726-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-cf726-predictor-5d84565df6 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cf726-predictor-68d66b987c-qrz2j |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-cf726-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-19dbe-predictor-96fddc7c8-lvhzp |
Killing |
Stopping container kube-rbac-proxy | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-19dbe-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-19dbe-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cf726-predictor-5d84565df6-lmbtw |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-cf726-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-cf726-predictor-68d66b987c |
SuccessfulCreate |
Created pod: error-404-isvc-cf726-predictor-68d66b987c-qrz2j | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-cf726-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-cf726-predictor-68d66b987c from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-19dbe-5c5f9dbf9c-465cw |
Killing |
Stopping container switch-graph-19dbe | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-19dbe-predictor-96fddc7c8-lvhzp |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-cf726-predictor-5d84565df6 |
SuccessfulCreate |
Created pod: success-200-isvc-cf726-predictor-5d84565df6-lmbtw | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-19dbe-predictor-7bddfb8787-tsf9j |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cf726-predictor-5d84565df6-lmbtw |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-cf726-predictor-5d84565df6-lmbtw |
AddedInterface |
Add eth0 [10.134.0.17/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cf726-predictor-68d66b987c-qrz2j |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1974" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cf726-predictor-68d66b987c-qrz2j |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cf726-predictor-68d66b987c-qrz2j |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cf726-predictor-68d66b987c-qrz2j |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cf726-predictor-5d84565df6-lmbtw |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1974" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cf726-predictor-5d84565df6-lmbtw |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-cf726-predictor-68d66b987c-qrz2j |
AddedInterface |
Add eth0 [10.134.0.18/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cf726-predictor-5d84565df6-lmbtw |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cf726-predictor-5d84565df6-lmbtw |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cf726-predictor-5d84565df6-lmbtw |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-19dbe-predictor-7bddfb8787-tsf9j |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.16:8643/healthz": dial tcp 10.134.0.16:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cf726-predictor-68d66b987c-qrz2j |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cf726-predictor-68d66b987c-qrz2j |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-19dbe-predictor-96fddc7c8-lvhzp |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.15:8643/healthz": dial tcp 10.134.0.15:8643: connect: connection refused | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-19dbe-5c5f9dbf9c-465cw |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cf726-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cf726-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-cf726-predictor-5d84565df6-lmbtw |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.17:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-cf726-predictor-68d66b987c-qrz2j |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.18:8080: connect: connection refused |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-566f7f6cdf from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-566f7f6cdf |
SuccessfulCreate |
Created pod: model-chainer-566f7f6cdf-kxkvs | |
| (x2) | kserve-ci-e2e-test |
kubelet |
model-chainer-566f7f6cdf-kxkvs |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "model-chainer-serving-cert" not found |
kserve-ci-e2e-test |
kubelet |
model-chainer-566f7f6cdf-kxkvs |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a9a6602e4ff6d231668f86dd27b8a0b42e39ad3e4d5853d739607bad79c35374" already present on machine | |
kserve-ci-e2e-test |
kubelet |
model-chainer-566f7f6cdf-kxkvs |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
multus |
model-chainer-566f7f6cdf-kxkvs |
AddedInterface |
Add eth0 [10.132.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
model-chainer-566f7f6cdf-kxkvs |
Created |
Created container: model-chainer | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cf726-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cf726-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-cf726 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-cf726 |
InferenceServiceReady |
InferenceService [success-200-isvc-cf726] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-cf726 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-cf726 |
InferenceServiceReady |
InferenceService [error-404-isvc-cf726] is Ready | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-daa19-predictor-64588c679c-fz4x9 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-daa19-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-daa19-predictor-78598b9488 |
SuccessfulCreate |
Created pod: success-200-isvc-daa19-predictor-78598b9488-nx46r | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6457847f78-pbmzs |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6lsvv |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6lsvv |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6457847f78-pbmzs |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-daa19-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-daa19-predictor-78598b9488 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
model-chainer-566f7f6cdf-kxkvs |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-daa19-predictor-64588c679c |
SuccessfulCreate |
Created pod: error-404-isvc-daa19-predictor-64588c679c-fz4x9 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-daa19-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-daa19-predictor-64588c679c from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-daa19-predictor-64588c679c-fz4x9 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-daa19-predictor-64588c679c-fz4x9 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-daa19-predictor-78598b9488-nx46r |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-daa19-predictor-64588c679c-fz4x9 |
AddedInterface |
Add eth0 [10.134.0.20/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-daa19-predictor-64588c679c-fz4x9 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1974" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-daa19-predictor-64588c679c-fz4x9 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-daa19-predictor-78598b9488-nx46r |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-daa19-predictor-78598b9488-nx46r |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1974" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-daa19-predictor-64588c679c-fz4x9 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-daa19-predictor-78598b9488-nx46r |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-daa19-predictor-78598b9488-nx46r |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-daa19-predictor-78598b9488-nx46r |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-daa19-predictor-64588c679c-fz4x9 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-daa19-predictor-78598b9488-nx46r |
AddedInterface |
Add eth0 [10.134.0.19/23] from ovn-kubernetes | |
| (x10) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6457847f78-pbmzs |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.22:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-6lsvv |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.38:8643/healthz": dial tcp 10.132.0.38:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.23:8643/healthz": dial tcp 10.133.0.23:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-6457847f78-pbmzs |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.22:8643/healthz": dial tcp 10.133.0.22:8643: connect: connection refused | |
| (x11) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-64bf96469d-tlqzk |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.23:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
switch-graph-cf726-66cb7b9f5f-c4q86 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-cf726-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-cf726-66cb7b9f5f |
SuccessfulCreate |
Created pod: switch-graph-cf726-66cb7b9f5f-c4q86 | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-cf726 |
ScalingReplicaSet |
Scaled up replica set switch-graph-cf726-66cb7b9f5f from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-cf726 |
InferenceGraphReady |
InferenceGraph [switch-graph-cf726] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-cf726-66cb7b9f5f-c4q86 |
Started |
Started container switch-graph-cf726 | |
kserve-ci-e2e-test |
multus |
switch-graph-cf726-66cb7b9f5f-c4q86 |
AddedInterface |
Add eth0 [10.132.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-cf726-66cb7b9f5f-c4q86 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a9a6602e4ff6d231668f86dd27b8a0b42e39ad3e4d5853d739607bad79c35374" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-cf726-66cb7b9f5f-c4q86 |
Created |
Created container: switch-graph-cf726 | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-daa19-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-daa19-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cf726-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-cf726-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cf726-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-cf726-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-566f7f6cdf-kxkvs |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-daa19-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-daa19-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-daa19 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-daa19 |
InferenceServiceReady |
InferenceService [error-404-isvc-daa19] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-daa19 |
InferenceServiceReady |
InferenceService [success-200-isvc-daa19] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-daa19 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-cf726 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-cf726 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-daa19 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-daa19-76989745dd from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-daa19-76989745dd |
SuccessfulCreate |
Created pod: sequence-graph-daa19-76989745dd-jw7xv | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-daa19 |
InferenceGraphReady |
InferenceGraph [sequence-graph-daa19] is Ready | |
kserve-ci-e2e-test |
multus |
sequence-graph-daa19-76989745dd-jw7xv |
AddedInterface |
Add eth0 [10.132.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-daa19-76989745dd-jw7xv |
Started |
Started container sequence-graph-daa19 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-daa19-76989745dd-jw7xv |
Created |
Created container: sequence-graph-daa19 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-daa19-76989745dd-jw7xv |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a9a6602e4ff6d231668f86dd27b8a0b42e39ad3e4d5853d739607bad79c35374" already present on machine | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-daa19-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-daa19-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-daa19-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-daa19-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-daa19 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-daa19 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-fcea7-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-fcea7-predictor-6bfb44d5b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-fcea7-predictor-6bfb44d5b |
SuccessfulCreate |
Created pod: success-200-isvc-fcea7-predictor-6bfb44d5b-5wgj8 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fcea7-predictor-6bfb44d5b-5wgj8 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-fcea7-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
switch-graph-cf726-66cb7b9f5f-c4q86 |
Killing |
Stopping container switch-graph-cf726 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cf726-predictor-68d66b987c-qrz2j |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cf726-predictor-5d84565df6-lmbtw |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-cf726-predictor-68d66b987c-qrz2j |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-cf726-predictor-5d84565df6-lmbtw |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-fcea7-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-fcea7-predictor-597cb8b869 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-fcea7-predictor-597cb8b869 |
SuccessfulCreate |
Created pod: error-404-isvc-fcea7-predictor-597cb8b869-vsl4f | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fcea7-predictor-597cb8b869-vsl4f |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-fcea7-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fcea7-predictor-597cb8b869-vsl4f |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fcea7-predictor-6bfb44d5b-5wgj8 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-fcea7-predictor-597cb8b869-vsl4f |
AddedInterface |
Add eth0 [10.134.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fcea7-predictor-597cb8b869-vsl4f |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fcea7-predictor-597cb8b869-vsl4f |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-fcea7-predictor-6bfb44d5b-5wgj8 |
AddedInterface |
Add eth0 [10.134.0.21/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fcea7-predictor-6bfb44d5b-5wgj8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fcea7-predictor-597cb8b869-vsl4f |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1974" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fcea7-predictor-6bfb44d5b-5wgj8 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1974" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fcea7-predictor-6bfb44d5b-5wgj8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fcea7-predictor-6bfb44d5b-5wgj8 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fcea7-predictor-6bfb44d5b-5wgj8 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fcea7-predictor-597cb8b869-vsl4f |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fcea7-predictor-597cb8b869-vsl4f |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-fcea7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-fcea7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-cf726-66cb7b9f5f-c4q86 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-fcea7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-fcea7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-fcea7-predictor-597cb8b869-vsl4f |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.22:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-fcea7-predictor-6bfb44d5b-5wgj8 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.21:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-fcea7 |
InferenceServiceReady |
InferenceService [error-404-isvc-fcea7] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-fcea7 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-fcea7 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-fcea7 |
InferenceServiceReady |
InferenceService [success-200-isvc-fcea7] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-1d1fb-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-1d1fb-predictor-7c46f69ccb from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-daa19-predictor-78598b9488-nx46r |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-daa19-predictor-78598b9488-nx46r |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-daa19-76989745dd-jw7xv |
Killing |
Stopping container sequence-graph-daa19 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-1d1fb-predictor-7c46f69ccb |
SuccessfulCreate |
Created pod: success-200-isvc-1d1fb-predictor-7c46f69ccb-95727 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-daa19-predictor-64588c679c-fz4x9 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-1d1fb-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-1d1fb-predictor-5c99c98b8f from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-1d1fb-predictor-5c99c98b8f |
SuccessfulCreate |
Created pod: error-404-isvc-1d1fb-predictor-5c99c98b8f-cn2lm | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-daa19-predictor-64588c679c-fz4x9 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1d1fb-predictor-7c46f69ccb-95727 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-1d1fb-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1d1fb-predictor-5c99c98b8f-cn2lm |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-1d1fb-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1d1fb-predictor-5c99c98b8f-cn2lm |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1974" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1d1fb-predictor-7c46f69ccb-95727 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1d1fb-predictor-5c99c98b8f-cn2lm |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1d1fb-predictor-5c99c98b8f-cn2lm |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1d1fb-predictor-5c99c98b8f-cn2lm |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1d1fb-predictor-5c99c98b8f-cn2lm |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1d1fb-predictor-7c46f69ccb-95727 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-1d1fb-predictor-5c99c98b8f-cn2lm |
AddedInterface |
Add eth0 [10.134.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1d1fb-predictor-5c99c98b8f-cn2lm |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1d1fb-predictor-7c46f69ccb-95727 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1d1fb-predictor-7c46f69ccb-95727 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-1d1fb-predictor-7c46f69ccb-95727 |
AddedInterface |
Add eth0 [10.134.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1d1fb-predictor-7c46f69ccb-95727 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1974" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1d1fb-predictor-7c46f69ccb-95727 |
Created |
Created container: kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-daa19-predictor-78598b9488-nx46r |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.19:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-daa19-predictor-64588c679c-fz4x9 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.20:8643/healthz": dial tcp 10.134.0.20:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-daa19-predictor-64588c679c-fz4x9 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.20:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-daa19-predictor-78598b9488-nx46r |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.19:8643/healthz": dial tcp 10.134.0.19:8643: connect: connection refused | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-fcea7-55b4968c6b |
SuccessfulCreate |
Created pod: ensemble-graph-fcea7-55b4968c6b-9nlgt | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-fcea7-55b4968c6b-9nlgt |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-fcea7-serving-cert" not found | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-fcea7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-fcea7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-fcea7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-fcea7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-fcea7 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-fcea7] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-fcea7 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-fcea7-55b4968c6b from 0 to 1 | |
kserve-ci-e2e-test |
multus |
ensemble-graph-fcea7-55b4968c6b-9nlgt |
AddedInterface |
Add eth0 [10.132.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-fcea7-55b4968c6b-9nlgt |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a9a6602e4ff6d231668f86dd27b8a0b42e39ad3e4d5853d739607bad79c35374" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-fcea7-55b4968c6b-9nlgt |
Created |
Created container: ensemble-graph-fcea7 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-fcea7-55b4968c6b-9nlgt |
Started |
Started container ensemble-graph-fcea7 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fcea7-predictor-6bfb44d5b-5wgj8 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-0591a-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-0591a-predictor-dcb65fbbf from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-fcea7-55b4968c6b-9nlgt |
Killing |
Stopping container ensemble-graph-fcea7 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-0591a-predictor-dcb65fbbf |
SuccessfulCreate |
Created pod: error-404-isvc-0591a-predictor-dcb65fbbf-8qnfv | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-0591a-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-0591a-predictor-78848d555b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-0591a-predictor-78848d555b |
SuccessfulCreate |
Created pod: success-200-isvc-0591a-predictor-78848d555b-bpb6k | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fcea7-predictor-6bfb44d5b-5wgj8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fcea7-predictor-597cb8b869-vsl4f |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fcea7-predictor-597cb8b869-vsl4f |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0591a-predictor-dcb65fbbf-8qnfv |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0591a-predictor-dcb65fbbf-8qnfv |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0591a-predictor-dcb65fbbf-8qnfv |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1974" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0591a-predictor-dcb65fbbf-8qnfv |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0591a-predictor-dcb65fbbf-8qnfv |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-0591a-predictor-dcb65fbbf-8qnfv |
AddedInterface |
Add eth0 [10.134.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0591a-predictor-78848d555b-bpb6k |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-0591a-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0591a-predictor-dcb65fbbf-8qnfv |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0591a-predictor-78848d555b-bpb6k |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0591a-predictor-78848d555b-bpb6k |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-0591a-predictor-78848d555b-bpb6k |
AddedInterface |
Add eth0 [10.134.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0591a-predictor-78848d555b-bpb6k |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0591a-predictor-78848d555b-bpb6k |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0591a-predictor-78848d555b-bpb6k |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1974" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0591a-predictor-78848d555b-bpb6k |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-fcea7-predictor-6bfb44d5b-5wgj8 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.21:8643/healthz": dial tcp 10.134.0.21:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-fcea7-predictor-597cb8b869-vsl4f |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.22:8643/healthz": dial tcp 10.134.0.22:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-daa19-76989745dd-jw7xv |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-1d1fb-predictor-7c46f69ccb-95727 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.23:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-1d1fb-predictor-5c99c98b8f-cn2lm |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.24:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1d1fb-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1d1fb-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1d1fb-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1d1fb-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-fcea7-55b4968c6b-9nlgt |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1d1fb |
InferenceServiceReady |
InferenceService [success-200-isvc-1d1fb] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1d1fb |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1d1fb |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1d1fb |
InferenceServiceReady |
InferenceService [error-404-isvc-1d1fb] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0591a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0591a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0591a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0591a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-0591a-predictor-dcb65fbbf-8qnfv |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.26:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1d1fb-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1d1fb-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1d1fb-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-1d1fb-76459958d |
SuccessfulCreate |
Created pod: sequence-graph-1d1fb-76459958d-swdvz | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-1d1fb |
ScalingReplicaSet |
Scaled up replica set sequence-graph-1d1fb-76459958d from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-1d1fb |
InferenceGraphReady |
InferenceGraph [sequence-graph-1d1fb] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1d1fb-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
multus |
sequence-graph-1d1fb-76459958d-swdvz |
AddedInterface |
Add eth0 [10.132.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-1d1fb-76459958d-swdvz |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a9a6602e4ff6d231668f86dd27b8a0b42e39ad3e4d5853d739607bad79c35374" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-1d1fb-76459958d-swdvz |
Created |
Created container: sequence-graph-1d1fb | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-1d1fb-76459958d-swdvz |
Started |
Started container sequence-graph-1d1fb | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0591a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-0591a |
InferenceServiceReady |
InferenceService [error-404-isvc-0591a] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-1d1fb-76459958d-swdvz |
Killing |
Stopping container sequence-graph-1d1fb | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1d1fb-predictor-7c46f69ccb-95727 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1d1fb-predictor-7c46f69ccb-95727 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1d1fb-predictor-5c99c98b8f-cn2lm |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1d1fb-predictor-5c99c98b8f-cn2lm |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-9d406-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-9d406-predictor-9dcd77c94 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-9d406-predictor-9dcd77c94 |
SuccessfulCreate |
Created pod: success-200-isvc-9d406-predictor-9dcd77c94-qkb6v | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-9d406-predictor-c94cb4b67 |
SuccessfulCreate |
Created pod: error-404-isvc-9d406-predictor-c94cb4b67-9qvp9 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-9d406-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-9d406-predictor-c94cb4b67 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d406-predictor-c94cb4b67-9qvp9 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d406-predictor-9dcd77c94-qkb6v |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d406-predictor-c94cb4b67-9qvp9 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d406-predictor-c94cb4b67-9qvp9 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d406-predictor-c94cb4b67-9qvp9 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d406-predictor-c94cb4b67-9qvp9 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1974" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d406-predictor-c94cb4b67-9qvp9 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-9d406-predictor-9dcd77c94-qkb6v |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
error-404-isvc-9d406-predictor-c94cb4b67-9qvp9 |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d406-predictor-9dcd77c94-qkb6v |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d406-predictor-9dcd77c94-qkb6v |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d406-predictor-9dcd77c94-qkb6v |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d406-predictor-9dcd77c94-qkb6v |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1974" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d406-predictor-9dcd77c94-qkb6v |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1d1fb-predictor-7c46f69ccb-95727 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.23:8643/healthz": dial tcp 10.134.0.23:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1d1fb-predictor-5c99c98b8f-cn2lm |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.24:8643/healthz": dial tcp 10.134.0.24:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0591a |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-0591a |
InferenceServiceReady |
InferenceService [success-200-isvc-0591a] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9d406-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9d406-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-0591a |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-0591a-587c6c6dd5 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-0591a-587c6c6dd5 |
SuccessfulCreate |
Created pod: ensemble-graph-0591a-587c6c6dd5-mlq7d | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-0591a |
InferenceGraphReady |
InferenceGraph [ensemble-graph-0591a] is Ready | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0591a-587c6c6dd5-mlq7d |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-0591a-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0591a-587c6c6dd5-mlq7d |
Started |
Started container ensemble-graph-0591a | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0591a-587c6c6dd5-mlq7d |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a9a6602e4ff6d231668f86dd27b8a0b42e39ad3e4d5853d739607bad79c35374" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0591a-587c6c6dd5-mlq7d |
Created |
Created container: ensemble-graph-0591a | |
kserve-ci-e2e-test |
multus |
ensemble-graph-0591a-587c6c6dd5-mlq7d |
AddedInterface |
Add eth0 [10.132.0.45/23] from ovn-kubernetes | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0591a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0591a-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-0591a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-0591a-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-1d1fb-76459958d-swdvz |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9d406-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9d406-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9d406 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9d406 |
InferenceServiceReady |
InferenceService [error-404-isvc-9d406] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9d406 |
InferenceServiceReady |
InferenceService [success-200-isvc-9d406] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9d406 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-9d406-6b5656b658 |
SuccessfulCreate |
Created pod: sequence-graph-9d406-6b5656b658-2hfxw | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-9d406 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-9d406-6b5656b658 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-9d406 |
InferenceGraphReady |
InferenceGraph [sequence-graph-9d406] is Ready | |
kserve-ci-e2e-test |
multus |
sequence-graph-9d406-6b5656b658-2hfxw |
AddedInterface |
Add eth0 [10.132.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-9d406-6b5656b658-2hfxw |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a9a6602e4ff6d231668f86dd27b8a0b42e39ad3e4d5853d739607bad79c35374" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-9d406-6b5656b658-2hfxw |
Created |
Created container: sequence-graph-9d406 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-9d406-6b5656b658-2hfxw |
Started |
Started container sequence-graph-9d406 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-0591a |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-0591a |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9d406-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9d406-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-9d406 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9d406-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-9d406 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9d406-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6a778 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-6a778": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-6a778": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0591a-predictor-dcb65fbbf-8qnfv |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-0591a-predictor-dcb65fbbf-8qnfv |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-6a778-predictor-ff6c4454b |
SuccessfulCreate |
Created pod: success-200-isvc-6a778-predictor-ff6c4454b-ftnlq | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-6a778-predictor-84cc69f4d7 |
SuccessfulCreate |
Created pod: error-404-isvc-6a778-predictor-84cc69f4d7-sn28q | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-0591a-587c6c6dd5-mlq7d |
Killing |
Stopping container ensemble-graph-0591a | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0591a-predictor-78848d555b-bpb6k |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0591a-predictor-78848d555b-bpb6k |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-6a778-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-6a778-predictor-84cc69f4d7 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6a778 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-6a778": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6a778 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-6a778": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-6a778": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6a778 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-6a778": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-6a778-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-6a778-predictor-ff6c4454b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6a778-predictor-84cc69f4d7-sn28q |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-6a778-predictor-84cc69f4d7-sn28q |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6a778-predictor-ff6c4454b-ftnlq |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6a778-predictor-ff6c4454b-ftnlq |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6a778-predictor-ff6c4454b-ftnlq |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6a778-predictor-ff6c4454b-ftnlq |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6a778-predictor-84cc69f4d7-sn28q |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1974" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6a778-predictor-84cc69f4d7-sn28q |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6a778-predictor-84cc69f4d7-sn28q |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6a778-predictor-ff6c4454b-ftnlq |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6a778-predictor-ff6c4454b-ftnlq |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1974" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-6a778-predictor-ff6c4454b-ftnlq |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6a778-predictor-84cc69f4d7-sn28q |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6a778-predictor-84cc69f4d7-sn28q |
Started |
Started container kserve-container | |
| (x8) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-0591a-predictor-78848d555b-bpb6k |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.25:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-0591a-predictor-78848d555b-bpb6k |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.25:8643/healthz": dial tcp 10.134.0.25:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-0591a-587c6c6dd5-mlq7d |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-6a778-predictor-ff6c4454b-ftnlq |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.29:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-6a778-predictor-84cc69f4d7-sn28q |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.30:8080: connect: connection refused |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-969ee-predictor-7bffb9f7df |
SuccessfulCreate |
Created pod: error-404-isvc-969ee-predictor-7bffb9f7df-jdmch | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d406-predictor-9dcd77c94-qkb6v |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d406-predictor-9dcd77c94-qkb6v |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d406-predictor-c94cb4b67-9qvp9 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d406-predictor-c94cb4b67-9qvp9 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-969ee-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-969ee-predictor-84b4498f4d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-969ee-predictor-84b4498f4d |
SuccessfulCreate |
Created pod: success-200-isvc-969ee-predictor-84b4498f4d-sfpj9 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-9d406-6b5656b658-2hfxw |
Killing |
Stopping container sequence-graph-9d406 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-969ee-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-969ee-predictor-7bffb9f7df from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-969ee-predictor-84b4498f4d-sfpj9 |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-969ee-predictor-84b4498f4d-sfpj9 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1974" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-969ee-predictor-7bffb9f7df-jdmch |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-969ee-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-969ee-predictor-84b4498f4d-sfpj9 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-969ee-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-969ee-predictor-7bffb9f7df-jdmch |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-969ee-predictor-7bffb9f7df-jdmch |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-969ee-predictor-7bffb9f7df-jdmch |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-969ee-predictor-7bffb9f7df-jdmch |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-969ee-predictor-84b4498f4d-sfpj9 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d406-predictor-c94cb4b67-9qvp9 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.28:8643/healthz": dial tcp 10.134.0.28:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-969ee-predictor-84b4498f4d-sfpj9 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-969ee-predictor-84b4498f4d-sfpj9 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-969ee-predictor-7bffb9f7df-jdmch |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-969ee-predictor-7bffb9f7df-jdmch |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1974" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-969ee-predictor-7bffb9f7df-jdmch |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-969ee-predictor-84b4498f4d-sfpj9 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-969ee-predictor-84b4498f4d-sfpj9 |
Created |
Created container: kube-rbac-proxy | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-9d406-predictor-c94cb4b67-9qvp9 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.28:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d406-predictor-9dcd77c94-qkb6v |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.27:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9d406-predictor-9dcd77c94-qkb6v |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.27:8643/healthz": dial tcp 10.134.0.27:8643: connect: connection refused | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6a778-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6a778-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6a778-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6a778-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6a778 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6a778 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6a778 |
InferenceServiceReady |
InferenceService [success-200-isvc-6a778] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6a778 |
InferenceServiceReady |
InferenceService [error-404-isvc-6a778] is Ready | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-969ee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-969ee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6a778-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-6a778-54754f5494 |
SuccessfulCreate |
Created pod: splitter-graph-6a778-54754f5494-z6lzx | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6a778-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6a778-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-6a778 |
InferenceGraphReady |
InferenceGraph [splitter-graph-6a778] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-6a778 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-6a778-54754f5494 from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6a778-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
multus |
splitter-graph-6a778-54754f5494-z6lzx |
AddedInterface |
Add eth0 [10.132.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-6a778-54754f5494-z6lzx |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a9a6602e4ff6d231668f86dd27b8a0b42e39ad3e4d5853d739607bad79c35374" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-6a778-54754f5494-z6lzx |
Started |
Started container splitter-graph-6a778 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-6a778-54754f5494-z6lzx |
Created |
Created container: splitter-graph-6a778 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-9d406-6b5656b658-2hfxw |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6a778-predictor-84cc69f4d7-sn28q |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-1f299-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-1f299-predictor-5f5c5bc97d from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1f299 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-1f299": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-1f299-predictor-5f5c5bc97d |
SuccessfulCreate |
Created pod: success-200-isvc-1f299-predictor-5f5c5bc97d-gfzpj | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6a778-predictor-84cc69f4d7-sn28q |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1f299 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-1f299": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-1f299": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6a778-predictor-ff6c4454b-ftnlq |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6a778-predictor-ff6c4454b-ftnlq |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-6a778-54754f5494-z6lzx |
Killing |
Stopping container splitter-graph-6a778 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-969ee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-969ee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f299-predictor-5f5c5bc97d-gfzpj |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-1f299-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-1f299-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-1f299-predictor-576964885f from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f299-predictor-576964885f-fklcx |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-1f299-predictor-serving-cert" not found |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-1f299-predictor-576964885f |
SuccessfulCreate |
Created pod: error-404-isvc-1f299-predictor-576964885f-fklcx | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f299-predictor-5f5c5bc97d-gfzpj |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f299-predictor-5f5c5bc97d-gfzpj |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6a778-predictor-ff6c4454b-ftnlq |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.29:8643/healthz": dial tcp 10.134.0.29:8643: connect: connection refused | |
kserve-ci-e2e-test |
multus |
success-200-isvc-1f299-predictor-5f5c5bc97d-gfzpj |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f299-predictor-5f5c5bc97d-gfzpj |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1974" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f299-predictor-5f5c5bc97d-gfzpj |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f299-predictor-5f5c5bc97d-gfzpj |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f299-predictor-5f5c5bc97d-gfzpj |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6a778-predictor-84cc69f4d7-sn28q |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.30:8643/healthz": dial tcp 10.134.0.30:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f299-predictor-576964885f-fklcx |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f299-predictor-576964885f-fklcx |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f299-predictor-576964885f-fklcx |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f299-predictor-576964885f-fklcx |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-1f299-predictor-576964885f-fklcx |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f299-predictor-576964885f-fklcx |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f299-predictor-576964885f-fklcx |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1974" already present on machine | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-969ee-predictor-7bffb9f7df-jdmch |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.32:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-969ee-predictor-84b4498f4d-sfpj9 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.31:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1f299-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1f299-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-969ee |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-969ee |
InferenceServiceReady |
InferenceService [error-404-isvc-969ee] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-969ee |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-969ee |
InferenceServiceReady |
InferenceService [success-200-isvc-969ee] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-6a778-54754f5494-z6lzx |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-969ee-6dc8cf5c6c |
SuccessfulCreate |
Created pod: switch-graph-969ee-6dc8cf5c6c-t4wgz | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-969ee |
InferenceGraphReady |
InferenceGraph [switch-graph-969ee] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-969ee |
ScalingReplicaSet |
Scaled up replica set switch-graph-969ee-6dc8cf5c6c from 0 to 1 | |
kserve-ci-e2e-test |
multus |
switch-graph-969ee-6dc8cf5c6c-t4wgz |
AddedInterface |
Add eth0 [10.132.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-969ee-6dc8cf5c6c-t4wgz |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-969ee-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
switch-graph-969ee-6dc8cf5c6c-t4wgz |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a9a6602e4ff6d231668f86dd27b8a0b42e39ad3e4d5853d739607bad79c35374" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-969ee-6dc8cf5c6c-t4wgz |
Started |
Started container switch-graph-969ee | |
kserve-ci-e2e-test |
kubelet |
switch-graph-969ee-6dc8cf5c6c-t4wgz |
Created |
Created container: switch-graph-969ee | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f299-predictor-576964885f-fklcx |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.34:8080: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-969ee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-969ee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-969ee-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-969ee-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1f299-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1f299-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f299-predictor-5f5c5bc97d-gfzpj |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.33:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1f299 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-1f299 |
InferenceServiceReady |
InferenceService [error-404-isvc-1f299] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1f299 |
InferenceServiceReady |
InferenceService [success-200-isvc-1f299] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-1f299 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-969ee |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-969ee |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
splitter-graph-1f299-85d87f69dc-7z9ns |
AddedInterface |
Add eth0 [10.132.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-1f299-85d87f69dc |
SuccessfulCreate |
Created pod: splitter-graph-1f299-85d87f69dc-7z9ns | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-1f299 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-1f299-85d87f69dc from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-1f299-85d87f69dc-7z9ns |
Started |
Started container splitter-graph-1f299 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-1f299-85d87f69dc-7z9ns |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:a9a6602e4ff6d231668f86dd27b8a0b42e39ad3e4d5853d739607bad79c35374" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-1f299-85d87f69dc-7z9ns |
Created |
Created container: splitter-graph-1f299 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-1f299 |
InferenceGraphReady |
InferenceGraph [splitter-graph-1f299] is Ready | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1f299-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-1f299-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1f299-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-1f299-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-1f299 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-1f299 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f299-predictor-576964885f-fklcx |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f299-predictor-576964885f-fklcx |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.34:8643/healthz": dial tcp 10.134.0.34:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-1f299-85d87f69dc-7z9ns |
Killing |
Stopping container splitter-graph-1f299 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-1f299-predictor-576964885f-fklcx |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f299-predictor-5f5c5bc97d-gfzpj |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-1f299-predictor-5f5c5bc97d-gfzpj |
Killing |
Stopping container kube-rbac-proxy | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-1f299-85d87f69dc-7z9ns |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
switch-graph-969ee-6dc8cf5c6c-t4wgz |
Killing |
Stopping container switch-graph-969ee | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-969ee-predictor-7bffb9f7df-jdmch |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-969ee-predictor-7bffb9f7df-jdmch |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-969ee-predictor-84b4498f4d-sfpj9 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-969ee-predictor-84b4498f4d-sfpj9 |
Killing |
Stopping container kserve-container | |
| (x5) | kserve-ci-e2e-test |
kubelet |
switch-graph-969ee-6dc8cf5c6c-t4wgz |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |