| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
ensemble-graph-3e647-56d7ff6db-8dvvb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-3e647-56d7ff6db-8dvvb to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-678784f46b-c6nfj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-678784f46b-c6nfj to ip-10-0-135-103.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-35687-79cdffcd67-wpm88 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-35687-79cdffcd67-wpm88 to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-9ee57-67b68b489d-bvwfw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-9ee57-67b68b489d-bvwfw to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-12313-predictor-857dcf8cc4-46rl6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-12313-predictor-857dcf8cc4-46rl6 to ip-10-0-135-103.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-339a4-predictor-58f8586498-9r8dr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-339a4-predictor-58f8586498-9r8dr to ip-10-0-135-103.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-72c4b-7c78954875-qkckb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-72c4b-7c78954875-qkckb to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-08c99-84bc9f87db-h8b2d |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-08c99-84bc9f87db-h8b2d to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-866798f95b-9dhqz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-866798f95b-9dhqz to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-db114-predictor-586c7dfd-52v5d |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-db114-predictor-586c7dfd-52v5d to ip-10-0-135-103.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-3e647-predictor-9899bf78c-4dxp6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-3e647-predictor-9899bf78c-4dxp6 to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-9ee57-predictor-767dfdd744-jlp7p |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-9ee57-predictor-767dfdd744-jlp7p to ip-10-0-135-103.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-72c4b-predictor-549bf86d85-lbvpt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-72c4b-predictor-549bf86d85-lbvpt to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-db114-85585bdbb4-6kg6t |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-db114-85585bdbb4-6kg6t to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-339a4-predictor-7cdc89ff49-ncgln |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-339a4-predictor-7cdc89ff49-ncgln to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-9ee57-predictor-d974ddf95-6jxwb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-9ee57-predictor-d974ddf95-6jxwb to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-766ab-predictor-76978cfc8f-lfgfl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-766ab-predictor-76978cfc8f-lfgfl to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-889c1-predictor-746ccd4c5b-pjzvp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-889c1-predictor-746ccd4c5b-pjzvp to ip-10-0-135-103.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-669d8d6456-tzb6t |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-669d8d6456-tzb6t to ip-10-0-130-213.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-889c1-858b68998c-h8jts |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-889c1-858b68998c-h8jts to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-766ab-predictor-69d568958b-r85bq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-766ab-predictor-69d568958b-r85bq to ip-10-0-135-103.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-72c4b-predictor-6f6fcbb-zg7jb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-72c4b-predictor-6f6fcbb-zg7jb to ip-10-0-135-103.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-766ab-98578b9d8-6bwk6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-766ab-98578b9d8-6bwk6 to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-08c99-predictor-559bfc6b95-vpb62 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-08c99-predictor-559bfc6b95-vpb62 to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-35687-predictor-d8849b54c-bcggv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-35687-predictor-d8849b54c-bcggv to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-3e647-predictor-55bfd66d8d-pj8fl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-3e647-predictor-55bfd66d8d-pj8fl to ip-10-0-135-103.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-12313-76b55b9df6-96qlq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-12313-76b55b9df6-96qlq to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-339a4-68f7b7cdb-6xr4s |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-339a4-68f7b7cdb-6xr4s to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-35687-predictor-6d599c8c48-68thq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-35687-predictor-6d599c8c48-68thq to ip-10-0-135-103.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-889c1-predictor-b649dc755-pwsvf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-889c1-predictor-b649dc755-pwsvf to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-54c99bfc7d-sxdzl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-54c99bfc7d-sxdzl to ip-10-0-135-103.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-12313-predictor-7746bc869-vlbsc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-12313-predictor-7746bc869-vlbsc to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-db114-predictor-7d7bc84957-tkjp8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-db114-predictor-7d7bc84957-tkjp8 to ip-10-0-139-18.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-08c99-predictor-cc5d7f476-czxk9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-08c99-predictor-cc5d7f476-czxk9 to ip-10-0-135-103.ec2.internal | ||
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-889c1-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-889c1-predictor-b649dc755 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-678784f46b |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-678784f46b-c6nfj | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-889c1-predictor-746ccd4c5b |
SuccessfulCreate |
Created pod: success-200-isvc-889c1-predictor-746ccd4c5b-pjzvp | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-889c1-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-889c1-predictor-746ccd4c5b from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-889c1 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-889c1": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-889c1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-889c1 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-889c1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-678784f46b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-889c1-predictor-b649dc755 |
SuccessfulCreate |
Created pod: error-404-isvc-889c1-predictor-b649dc755-pwsvf | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-889c1-predictor-b649dc755-pwsvf |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-889c1-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-889c1-predictor-746ccd4c5b-pjzvp |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-669d8d6456 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-669d8d6456-tzb6t | |
kserve-ci-e2e-test |
multus |
success-200-isvc-889c1-predictor-746ccd4c5b-pjzvp |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-tzb6t |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:30bffa55f5e3e0e2f6d023c0f84846c206091122d724f5a0e810b4fb957dd389" | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-669d8d6456-tzb6t |
AddedInterface |
Add eth0 [10.133.0.17/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-678784f46b-c6nfj |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-54c99bfc7d from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-c6nfj |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:30bffa55f5e3e0e2f6d023c0f84846c206091122d724f5a0e810b4fb957dd389" | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-54c99bfc7d |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-54c99bfc7d-sxdzl | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-669d8d6456 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
error-404-isvc-889c1-predictor-b649dc755-pwsvf |
AddedInterface |
Add eth0 [10.132.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-889c1-predictor-b649dc755-pwsvf |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-54c99bfc7d-sxdzl |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-sxdzl |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:30bffa55f5e3e0e2f6d023c0f84846c206091122d724f5a0e810b4fb957dd389" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-tzb6t |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:30bffa55f5e3e0e2f6d023c0f84846c206091122d724f5a0e810b4fb957dd389" in 3.285s (3.285s including waiting). Image size: 303109559 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-tzb6t |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-tzb6t |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-c6nfj |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:30bffa55f5e3e0e2f6d023c0f84846c206091122d724f5a0e810b4fb957dd389" in 4.617s (4.617s including waiting). Image size: 303109559 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-sxdzl |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-c6nfj |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-c6nfj |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-sxdzl |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-sxdzl |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:30bffa55f5e3e0e2f6d023c0f84846c206091122d724f5a0e810b4fb957dd389" in 2.801s (2.801s including waiting). Image size: 303109559 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-tzb6t |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-sxdzl |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1532" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-c6nfj |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1532" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-889c1-predictor-746ccd4c5b-pjzvp |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-889c1-predictor-b649dc755-pwsvf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-889c1-predictor-746ccd4c5b-pjzvp |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-889c1-predictor-746ccd4c5b-pjzvp |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" in 12.11s (12.11s including waiting). Image size: 1335713395 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-889c1-predictor-746ccd4c5b-pjzvp |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-889c1-predictor-b649dc755-pwsvf |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-889c1-predictor-b649dc755-pwsvf |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" in 11.127s (11.127s including waiting). Image size: 1334702699 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-889c1-predictor-b649dc755-pwsvf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-889c1-predictor-b649dc755-pwsvf |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.281s (2.281s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-889c1-predictor-b649dc755-pwsvf |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-889c1-predictor-b649dc755-pwsvf |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-889c1-predictor-746ccd4c5b-pjzvp |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-889c1-predictor-746ccd4c5b-pjzvp |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-889c1-predictor-746ccd4c5b-pjzvp |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 3.031s (3.031s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-sxdzl |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-c6nfj |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-sxdzl |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1532" in 9.53s (9.53s including waiting). Image size: 1560933302 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-c6nfj |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-1532" in 9.546s (9.546s including waiting). Image size: 1560933302 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-sxdzl |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-sxdzl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-c6nfj |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-c6nfj |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-c6nfj |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-c6nfj |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-sxdzl |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-sxdzl |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-tzb6t |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-tzb6t |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-tzb6t |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 17.762s (17.762s including waiting). Image size: 1306319098 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-tzb6t |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-tzb6t |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.143s (2.143s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-tzb6t |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-tzb6t |
Started |
Started container kube-rbac-proxy | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-889c1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-889c1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-889c1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-889c1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-889c1 |
InferenceServiceReady |
InferenceService [success-200-isvc-889c1] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-889c1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-889c1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-889c1 |
InferenceServiceReady |
InferenceService [error-404-isvc-889c1] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-889c1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-c6nfj |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.33:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-889c1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-sxdzl |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.34:8080: connect: connection refused |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-889c1 |
UpdateFailed |
Failed to update status for InferenceGraph "switch-graph-889c1": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-889c1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-889c1-858b68998c |
SuccessfulCreate |
Created pod: switch-graph-889c1-858b68998c-h8jts | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-889c1 |
ScalingReplicaSet |
Scaled up replica set switch-graph-889c1-858b68998c from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-889c1 |
InferenceGraphReady |
InferenceGraph [switch-graph-889c1] is Ready | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-889c1 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-889c1": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
multus |
switch-graph-889c1-858b68998c-h8jts |
AddedInterface |
Add eth0 [10.132.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-889c1-858b68998c-h8jts |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:367463b1d3262f4416182663b2344c09f7ccedc3764563fd3d0aee32ec772aae" | |
kserve-ci-e2e-test |
kubelet |
switch-graph-889c1-858b68998c-h8jts |
Created |
Created container: switch-graph-889c1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-889c1-858b68998c-h8jts |
Started |
Started container switch-graph-889c1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-889c1-858b68998c-h8jts |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:367463b1d3262f4416182663b2344c09f7ccedc3764563fd3d0aee32ec772aae" in 2.324s (2.324s including waiting). Image size: 217997404 bytes. | |
| (x8) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-tzb6t |
Unhealthy |
Readiness probe failed: dial tcp 10.133.0.17:8080: connect: connection refused |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-889c1-predictor-746ccd4c5b-pjzvp |
Killing |
Stopping container kube-rbac-proxy | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-889c1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-339a4-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-339a4-predictor-58f8586498 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-889c1-858b68998c-h8jts |
Killing |
Stopping container switch-graph-889c1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-339a4 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-339a4": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-339a4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-339a4 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-339a4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-339a4-predictor-58f8586498 |
SuccessfulCreate |
Created pod: success-200-isvc-339a4-predictor-58f8586498-9r8dr | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-889c1-predictor-b649dc755-pwsvf |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-889c1-predictor-746ccd4c5b-pjzvp |
Killing |
Stopping container kserve-container | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-889c1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-889c1-predictor-b649dc755-pwsvf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-339a4 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-339a4": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-339a4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-339a4-predictor-58f8586498-9r8dr |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-339a4-predictor-7cdc89ff49 |
SuccessfulCreate |
Created pod: error-404-isvc-339a4-predictor-7cdc89ff49-ncgln | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-339a4 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-339a4": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-339a4-predictor-7cdc89ff49-ncgln |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-339a4-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-339a4-predictor-58f8586498-9r8dr |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-339a4-predictor-58f8586498-9r8dr |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-339a4-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-339a4-predictor-7cdc89ff49 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-339a4-predictor-58f8586498-9r8dr |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-339a4-predictor-58f8586498-9r8dr |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-339a4-predictor-58f8586498-9r8dr |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-339a4-predictor-58f8586498-9r8dr |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-339a4-predictor-7cdc89ff49-ncgln |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-339a4-predictor-7cdc89ff49-ncgln |
AddedInterface |
Add eth0 [10.132.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-339a4-predictor-7cdc89ff49-ncgln |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-339a4-predictor-7cdc89ff49-ncgln |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-339a4-predictor-7cdc89ff49-ncgln |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-339a4-predictor-7cdc89ff49-ncgln |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-339a4-predictor-7cdc89ff49-ncgln |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-889c1-predictor-b649dc755-pwsvf |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.27:8643/healthz": dial tcp 10.132.0.27:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-889c1-predictor-b649dc755-pwsvf |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.27:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-889c1-predictor-746ccd4c5b-pjzvp |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.32:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-889c1-predictor-746ccd4c5b-pjzvp |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.32:8643/healthz": dial tcp 10.134.0.32:8643: connect: connection refused | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-339a4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-339a4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-866798f95b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-866798f95b |
SuccessfulCreate |
Created pod: model-chainer-866798f95b-9dhqz | |
kserve-ci-e2e-test |
kubelet |
model-chainer-866798f95b-9dhqz |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "model-chainer-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
model-chainer-866798f95b-9dhqz |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-866798f95b-9dhqz |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-866798f95b-9dhqz |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:367463b1d3262f4416182663b2344c09f7ccedc3764563fd3d0aee32ec772aae" already present on machine | |
kserve-ci-e2e-test |
multus |
model-chainer-866798f95b-9dhqz |
AddedInterface |
Add eth0 [10.132.0.30/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-889c1-858b68998c-h8jts |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-tzb6t |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.17:8643/healthz": dial tcp 10.133.0.17:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-sxdzl |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
model-chainer-866798f95b-9dhqz |
Killing |
Stopping container model-chainer | |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-sxdzl |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-tzb6t |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-669d8d6456-tzb6t |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-08c99-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-08c99-predictor-cc5d7f476 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-08c99-predictor-cc5d7f476 |
SuccessfulCreate |
Created pod: success-200-isvc-08c99-predictor-cc5d7f476-czxk9 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-08c99-predictor-cc5d7f476-czxk9 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-08c99-predictor-559bfc6b95-vpb62 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-08c99-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-c6nfj |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-08c99-predictor-cc5d7f476-czxk9 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-08c99-predictor-559bfc6b95 |
SuccessfulCreate |
Created pod: error-404-isvc-08c99-predictor-559bfc6b95-vpb62 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-08c99-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-08c99-predictor-559bfc6b95 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-08c99-predictor-cc5d7f476-czxk9 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-339a4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
success-200-isvc-08c99-predictor-cc5d7f476-czxk9 |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-08c99 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-08c99": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-08c99": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-08c99 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-08c99": the object has been modified; please apply your changes to the latest version and try again | |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-08c99-predictor-cc5d7f476-czxk9 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-08c99-predictor-cc5d7f476-czxk9 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-08c99-predictor-cc5d7f476-czxk9 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-c6nfj |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.33:8643/healthz": dial tcp 10.134.0.33:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-678784f46b-c6nfj |
Killing |
Stopping container kube-rbac-proxy | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-339a4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
error-404-isvc-08c99-predictor-559bfc6b95-vpb62 |
AddedInterface |
Add eth0 [10.132.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-08c99-predictor-559bfc6b95-vpb62 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-54c99bfc7d-sxdzl |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.34:8643/healthz": dial tcp 10.134.0.34:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-08c99-predictor-559bfc6b95-vpb62 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-08c99-predictor-559bfc6b95-vpb62 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-08c99-predictor-559bfc6b95-vpb62 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-08c99-predictor-559bfc6b95-vpb62 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-08c99-predictor-559bfc6b95-vpb62 |
Started |
Started container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-339a4-predictor-7cdc89ff49-ncgln |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.29:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-08c99-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-08c99-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-339a4 |
InferenceServiceReady |
InferenceService [success-200-isvc-339a4] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-339a4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-339a4 |
InferenceServiceReady |
InferenceService [error-404-isvc-339a4] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-339a4 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-866798f95b-9dhqz |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-339a4 |
InferenceGraphReady |
InferenceGraph [switch-graph-339a4] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-339a4 |
ScalingReplicaSet |
Scaled up replica set switch-graph-339a4-68f7b7cdb from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-339a4-68f7b7cdb |
SuccessfulCreate |
Created pod: switch-graph-339a4-68f7b7cdb-6xr4s | |
kserve-ci-e2e-test |
kubelet |
switch-graph-339a4-68f7b7cdb-6xr4s |
Started |
Started container switch-graph-339a4 | |
kserve-ci-e2e-test |
multus |
switch-graph-339a4-68f7b7cdb-6xr4s |
AddedInterface |
Add eth0 [10.132.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-339a4-68f7b7cdb-6xr4s |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:367463b1d3262f4416182663b2344c09f7ccedc3764563fd3d0aee32ec772aae" already present on machine | |
kserve-ci-e2e-test |
kubelet |
switch-graph-339a4-68f7b7cdb-6xr4s |
Created |
Created container: switch-graph-339a4 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-08c99-predictor-559bfc6b95-vpb62 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.31:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-339a4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-339a4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-08c99-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-08c99-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-339a4-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-339a4-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-08c99 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-08c99 |
InferenceServiceReady |
InferenceService [success-200-isvc-08c99] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-08c99 |
InferenceServiceReady |
InferenceService [error-404-isvc-08c99] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-08c99 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-08c99 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-08c99-84bc9f87db from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-08c99-84bc9f87db |
SuccessfulCreate |
Created pod: sequence-graph-08c99-84bc9f87db-h8b2d | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-339a4 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-08c99-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-08c99-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-08c99 |
InferenceGraphReady |
InferenceGraph [sequence-graph-08c99] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-08c99-84bc9f87db-h8b2d |
Started |
Started container sequence-graph-08c99 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-08c99-84bc9f87db-h8b2d |
Created |
Created container: sequence-graph-08c99 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-08c99-84bc9f87db-h8b2d |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:367463b1d3262f4416182663b2344c09f7ccedc3764563fd3d0aee32ec772aae" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-08c99-84bc9f87db-h8b2d |
AddedInterface |
Add eth0 [10.132.0.33/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-339a4 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-08c99-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-08c99 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-08c99-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-08c99 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-08c99 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-08c99 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
switch-graph-339a4-68f7b7cdb-6xr4s |
Killing |
Stopping container switch-graph-339a4 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-db114 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-db114": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-db114-predictor-7d7bc84957 |
SuccessfulCreate |
Created pod: error-404-isvc-db114-predictor-7d7bc84957-tkjp8 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-db114 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-db114": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-db114": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-db114-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-db114-predictor-7d7bc84957 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-db114 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-db114": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-db114": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-db114 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-db114": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-db114-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-db114-predictor-586c7dfd from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-db114-predictor-586c7dfd |
SuccessfulCreate |
Created pod: success-200-isvc-db114-predictor-586c7dfd-52v5d | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-339a4-predictor-58f8586498-9r8dr |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-339a4-predictor-7cdc89ff49-ncgln |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-339a4-predictor-7cdc89ff49-ncgln |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-339a4-predictor-58f8586498-9r8dr |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-db114-predictor-7d7bc84957-tkjp8 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-db114-predictor-7d7bc84957-tkjp8 |
AddedInterface |
Add eth0 [10.132.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
success-200-isvc-db114-predictor-586c7dfd-52v5d |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-db114-predictor-586c7dfd-52v5d |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-db114-predictor-586c7dfd-52v5d |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-db114-predictor-586c7dfd-52v5d |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-db114-predictor-586c7dfd-52v5d |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-db114-predictor-586c7dfd-52v5d |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-db114-predictor-586c7dfd-52v5d |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-db114-predictor-7d7bc84957-tkjp8 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-db114-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-db114-predictor-7d7bc84957-tkjp8 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-db114-predictor-7d7bc84957-tkjp8 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-db114-predictor-7d7bc84957-tkjp8 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-db114-predictor-7d7bc84957-tkjp8 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-db114-predictor-7d7bc84957-tkjp8 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-339a4-predictor-58f8586498-9r8dr |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.35:8643/healthz": dial tcp 10.134.0.35:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-339a4-predictor-58f8586498-9r8dr |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.35:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-339a4-68f7b7cdb-6xr4s |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-db114-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-08c99-predictor-cc5d7f476-czxk9 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-08c99-predictor-cc5d7f476-czxk9 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-08c99-predictor-559bfc6b95-vpb62 |
Killing |
Stopping container kserve-container | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-db114-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-db114-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-db114-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
sequence-graph-08c99-84bc9f87db-h8b2d |
Killing |
Stopping container sequence-graph-08c99 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-9ee57-predictor-767dfdd744 |
SuccessfulCreate |
Created pod: success-200-isvc-9ee57-predictor-767dfdd744-jlp7p | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9ee57 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-9ee57": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9ee57 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-9ee57": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-9ee57": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-9ee57-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-9ee57-predictor-767dfdd744 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-08c99-predictor-559bfc6b95-vpb62 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-9ee57-predictor-767dfdd744-jlp7p |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9ee57-predictor-767dfdd744-jlp7p |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9ee57-predictor-767dfdd744-jlp7p |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9ee57 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-9ee57": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9ee57 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-9ee57": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-9ee57": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9ee57-predictor-767dfdd744-jlp7p |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9ee57-predictor-767dfdd744-jlp7p |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9ee57-predictor-767dfdd744-jlp7p |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-9ee57-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-9ee57-predictor-d974ddf95 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-9ee57-predictor-d974ddf95 |
SuccessfulCreate |
Created pod: error-404-isvc-9ee57-predictor-d974ddf95-6jxwb | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9ee57-predictor-767dfdd744-jlp7p |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9ee57-predictor-d974ddf95-6jxwb |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-9ee57-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9ee57-predictor-d974ddf95-6jxwb |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9ee57-predictor-d974ddf95-6jxwb |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9ee57-predictor-d974ddf95-6jxwb |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9ee57-predictor-d974ddf95-6jxwb |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9ee57-predictor-d974ddf95-6jxwb |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-9ee57-predictor-d974ddf95-6jxwb |
AddedInterface |
Add eth0 [10.132.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9ee57-predictor-d974ddf95-6jxwb |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-08c99-predictor-cc5d7f476-czxk9 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.36:8643/healthz": dial tcp 10.134.0.36:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-08c99-predictor-cc5d7f476-czxk9 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.36:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-db114-predictor-586c7dfd-52v5d |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.37:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-db114 |
InferenceServiceReady |
InferenceService [success-200-isvc-db114] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-db114 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-db114-predictor-7d7bc84957-tkjp8 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.34:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-08c99-84bc9f87db-h8b2d |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-db114 |
InferenceServiceReady |
InferenceService [error-404-isvc-db114] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-db114 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-db114 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-db114-85585bdbb4 from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9ee57-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-db114-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-db114-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-db114-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-db114-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9ee57-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-db114-85585bdbb4 |
SuccessfulCreate |
Created pod: ensemble-graph-db114-85585bdbb4-6kg6t | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9ee57-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-db114-85585bdbb4-6kg6t |
Started |
Started container ensemble-graph-db114 | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-db114 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-db114] is Ready | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-db114-85585bdbb4-6kg6t |
Created |
Created container: ensemble-graph-db114 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-db114-85585bdbb4-6kg6t |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:367463b1d3262f4416182663b2344c09f7ccedc3764563fd3d0aee32ec772aae" already present on machine | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9ee57-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
ensemble-graph-db114-85585bdbb4-6kg6t |
AddedInterface |
Add eth0 [10.132.0.36/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-9ee57-predictor-767dfdd744-jlp7p |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.38:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-9ee57-predictor-d974ddf95-6jxwb |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.35:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e647-predictor-55bfd66d8d-pj8fl |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-3e647-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e647-predictor-9899bf78c-4dxp6 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e647-predictor-9899bf78c-4dxp6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e647-predictor-9899bf78c-4dxp6 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-3e647-predictor-9899bf78c-4dxp6 |
AddedInterface |
Add eth0 [10.132.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e647-predictor-9899bf78c-4dxp6 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e647-predictor-9899bf78c-4dxp6 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e647-predictor-9899bf78c-4dxp6 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-3e647-predictor-9899bf78c |
SuccessfulCreate |
Created pod: error-404-isvc-3e647-predictor-9899bf78c-4dxp6 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-3e647-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-3e647-predictor-9899bf78c from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3e647 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-3e647": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-3e647": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3e647 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-3e647": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3e647 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-3e647": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3e647 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-3e647": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-3e647": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-3e647-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-3e647-predictor-55bfd66d8d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-3e647-predictor-55bfd66d8d |
SuccessfulCreate |
Created pod: success-200-isvc-3e647-predictor-55bfd66d8d-pj8fl | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-db114-predictor-7d7bc84957-tkjp8 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-db114-predictor-7d7bc84957-tkjp8 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-db114-85585bdbb4-6kg6t |
Killing |
Stopping container ensemble-graph-db114 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-db114-predictor-586c7dfd-52v5d |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-db114-predictor-586c7dfd-52v5d |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e647-predictor-55bfd66d8d-pj8fl |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e647-predictor-55bfd66d8d-pj8fl |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-3e647-predictor-55bfd66d8d-pj8fl |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e647-predictor-55bfd66d8d-pj8fl |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-db114-predictor-586c7dfd-52v5d |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.37:8643/healthz": dial tcp 10.134.0.37:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e647-predictor-55bfd66d8d-pj8fl |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e647-predictor-55bfd66d8d-pj8fl |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e647-predictor-55bfd66d8d-pj8fl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-db114-predictor-7d7bc84957-tkjp8 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.34:8643/healthz": dial tcp 10.132.0.34:8643: connect: connection refused | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9ee57 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-9ee57 |
InferenceServiceReady |
InferenceService [success-200-isvc-9ee57] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9ee57 |
InferenceServiceReady |
InferenceService [error-404-isvc-9ee57] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-9ee57 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9ee57-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-9ee57-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-9ee57 |
InferenceGraphReady |
InferenceGraph [sequence-graph-9ee57] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-9ee57 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-9ee57-67b68b489d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-9ee57-67b68b489d |
SuccessfulCreate |
Created pod: sequence-graph-9ee57-67b68b489d-bvwfw | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-9ee57-67b68b489d-bvwfw |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-9ee57-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
sequence-graph-9ee57-67b68b489d-bvwfw |
AddedInterface |
Add eth0 [10.132.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-9ee57-67b68b489d-bvwfw |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:367463b1d3262f4416182663b2344c09f7ccedc3764563fd3d0aee32ec772aae" already present on machine | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9ee57-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-9ee57-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
sequence-graph-9ee57-67b68b489d-bvwfw |
Started |
Started container sequence-graph-9ee57 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-9ee57-67b68b489d-bvwfw |
Created |
Created container: sequence-graph-9ee57 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-db114-85585bdbb4-6kg6t |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9ee57-predictor-767dfdd744-jlp7p |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-72c4b-predictor-549bf86d85-lbvpt |
AddedInterface |
Add eth0 [10.132.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-72c4b-predictor-549bf86d85-lbvpt |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-72c4b-predictor-549bf86d85 |
SuccessfulCreate |
Created pod: error-404-isvc-72c4b-predictor-549bf86d85-lbvpt | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-72c4b |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-72c4b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-72c4b |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-72c4b": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-72c4b": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-72c4b-predictor-549bf86d85-lbvpt |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-72c4b-predictor-549bf86d85-lbvpt |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-72c4b-predictor-549bf86d85-lbvpt |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-72c4b-predictor-6f6fcbb |
SuccessfulCreate |
Created pod: success-200-isvc-72c4b-predictor-6f6fcbb-zg7jb | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-72c4b-predictor-549bf86d85-lbvpt |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-72c4b-predictor-549bf86d85-lbvpt |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-72c4b-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-72c4b-predictor-6f6fcbb from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9ee57-predictor-767dfdd744-jlp7p |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-72c4b-predictor-6f6fcbb-zg7jb |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-72c4b-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9ee57-predictor-d974ddf95-6jxwb |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-9ee57-predictor-d974ddf95-6jxwb |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-9ee57-67b68b489d-bvwfw |
Killing |
Stopping container sequence-graph-9ee57 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-72c4b-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-72c4b-predictor-549bf86d85 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-72c4b-predictor-6f6fcbb-zg7jb |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-72c4b-predictor-6f6fcbb-zg7jb |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-72c4b-predictor-6f6fcbb-zg7jb |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-72c4b-predictor-6f6fcbb-zg7jb |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-72c4b-predictor-6f6fcbb-zg7jb |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-72c4b-predictor-6f6fcbb-zg7jb |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-72c4b-predictor-6f6fcbb-zg7jb |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-9ee57-predictor-767dfdd744-jlp7p |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.38:8643/healthz": dial tcp 10.134.0.38:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e647-predictor-55bfd66d8d-pj8fl |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.39:8080: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3e647-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3e647-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3e647 |
InferenceServiceReady |
InferenceService [success-200-isvc-3e647] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-3e647 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-9ee57-67b68b489d-bvwfw |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3e647 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-3e647 |
InferenceServiceReady |
InferenceService [error-404-isvc-3e647] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3e647-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-3e647-56d7ff6db |
SuccessfulCreate |
Created pod: ensemble-graph-3e647-56d7ff6db-8dvvb | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-3e647-56d7ff6db-8dvvb |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-3e647-serving-cert" not found | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3e647-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-72c4b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-72c4b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-3e647 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-3e647] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-3e647 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-3e647-56d7ff6db from 0 to 1 | |
kserve-ci-e2e-test |
multus |
ensemble-graph-3e647-56d7ff6db-8dvvb |
AddedInterface |
Add eth0 [10.132.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-3e647-56d7ff6db-8dvvb |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:367463b1d3262f4416182663b2344c09f7ccedc3764563fd3d0aee32ec772aae" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-3e647-56d7ff6db-8dvvb |
Created |
Created container: ensemble-graph-3e647 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-3e647-56d7ff6db-8dvvb |
Started |
Started container ensemble-graph-3e647 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3e647-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-3e647-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-72c4b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-72c4b |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-72c4b |
InferenceServiceReady |
InferenceService [success-200-isvc-72c4b] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-72c4b |
InferenceServiceReady |
InferenceService [error-404-isvc-72c4b] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-72c4b-7c78954875-qkckb |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:367463b1d3262f4416182663b2344c09f7ccedc3764563fd3d0aee32ec772aae" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-72c4b |
ScalingReplicaSet |
Scaled up replica set sequence-graph-72c4b-7c78954875 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-72c4b-7c78954875-qkckb |
Created |
Created container: sequence-graph-72c4b | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-72c4b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-72c4b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
sequence-graph-72c4b-7c78954875-qkckb |
AddedInterface |
Add eth0 [10.132.0.41/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-3e647 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-3e647 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3e647-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-3e647-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-72c4b-7c78954875 |
SuccessfulCreate |
Created pod: sequence-graph-72c4b-7c78954875-qkckb | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-72c4b |
InferenceGraphReady |
InferenceGraph [sequence-graph-72c4b] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-72c4b-7c78954875-qkckb |
Started |
Started container sequence-graph-72c4b | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-72c4b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-72c4b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-72c4b |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-72c4b-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-72c4b |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-72c4b-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-72c4b |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-72c4b |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-3e647-56d7ff6db-8dvvb |
Killing |
Stopping container ensemble-graph-3e647 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-35687 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-35687": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e647-predictor-55bfd66d8d-pj8fl |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e647-predictor-9899bf78c-4dxp6 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-35687-predictor-6d599c8c48-68thq |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e647-predictor-9899bf78c-4dxp6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-35687-predictor-6d599c8c48-68thq |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-35687 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-35687": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-35687 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-35687": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-35687": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-35687-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-35687-predictor-d8849b54c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-35687-predictor-d8849b54c |
SuccessfulCreate |
Created pod: error-404-isvc-35687-predictor-d8849b54c-bcggv | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-35687-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-35687-predictor-6d599c8c48 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-35687-predictor-6d599c8c48 |
SuccessfulCreate |
Created pod: success-200-isvc-35687-predictor-6d599c8c48-68thq | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-35687-predictor-6d599c8c48-68thq |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-35687-predictor-6d599c8c48-68thq |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-3e647-predictor-55bfd66d8d-pj8fl |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-35687 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-35687": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-35687": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-35687-predictor-6d599c8c48-68thq |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-35687-predictor-6d599c8c48-68thq |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-35687-predictor-6d599c8c48-68thq |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-35687-predictor-d8849b54c-bcggv |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-35687-predictor-d8849b54c-bcggv |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-35687-predictor-d8849b54c-bcggv |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-35687-predictor-d8849b54c-bcggv |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-35687-predictor-d8849b54c-bcggv |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-35687-predictor-d8849b54c-bcggv |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-35687-predictor-d8849b54c-bcggv |
AddedInterface |
Add eth0 [10.132.0.42/23] from ovn-kubernetes | |
| (x8) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e647-predictor-9899bf78c-4dxp6 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.37:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-3e647-predictor-9899bf78c-4dxp6 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.37:8643/healthz": dial tcp 10.132.0.37:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-3e647-56d7ff6db-8dvvb |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
sequence-graph-72c4b-7c78954875-qkckb |
Killing |
Stopping container sequence-graph-72c4b | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-72c4b-predictor-6f6fcbb-zg7jb |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-12313-predictor-7746bc869-vlbsc |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-12313-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-12313-predictor-7746bc869 |
SuccessfulCreate |
Created pod: error-404-isvc-12313-predictor-7746bc869-vlbsc | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-12313-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-12313-predictor-7746bc869 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-12313 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-12313": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-12313": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-12313 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-12313": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-72c4b-predictor-6f6fcbb-zg7jb |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-12313-predictor-857dcf8cc4-46rl6 |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-12313-predictor-857dcf8cc4-46rl6 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-12313-predictor-857dcf8cc4-46rl6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-12313-predictor-857dcf8cc4-46rl6 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-12313-predictor-857dcf8cc4-46rl6 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-35687-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-35687-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-12313-predictor-857dcf8cc4-46rl6 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-35687-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-35687-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-12313-predictor-857dcf8cc4-46rl6 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-12313-predictor-857dcf8cc4 |
SuccessfulCreate |
Created pod: success-200-isvc-12313-predictor-857dcf8cc4-46rl6 | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-12313-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-12313-predictor-857dcf8cc4 from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-12313 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-12313": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-12313": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-12313 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-12313": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-72c4b-predictor-549bf86d85-lbvpt |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-72c4b-predictor-549bf86d85-lbvpt |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-12313-predictor-7746bc869-vlbsc |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-12313-predictor-7746bc869-vlbsc |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-12313-predictor-7746bc869-vlbsc |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-12313-predictor-7746bc869-vlbsc |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-12313-predictor-7746bc869-vlbsc |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-12313-predictor-7746bc869-vlbsc |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-12313-predictor-7746bc869-vlbsc |
AddedInterface |
Add eth0 [10.132.0.43/23] from ovn-kubernetes | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-72c4b-predictor-6f6fcbb-zg7jb |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.40:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-72c4b-predictor-6f6fcbb-zg7jb |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.40:8643/healthz": dial tcp 10.134.0.40:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-72c4b-predictor-549bf86d85-lbvpt |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.39:8643/healthz": dial tcp 10.132.0.39:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-72c4b-predictor-549bf86d85-lbvpt |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.39:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-35687-predictor-d8849b54c-bcggv |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.42:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-35687-predictor-6d599c8c48-68thq |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.41:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-12313-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-12313-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-35687 |
InferenceServiceReady |
InferenceService [error-404-isvc-35687] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-35687 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-35687 |
InferenceServiceReady |
InferenceService [success-200-isvc-35687] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-35687 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-72c4b-7c78954875-qkckb |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-12313-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-35687-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-35687 |
InferenceGraphReady |
InferenceGraph [splitter-graph-35687] is Ready | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-35687-79cdffcd67-wpm88 |
Started |
Started container splitter-graph-35687 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-35687-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-35687-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
splitter-graph-35687-79cdffcd67-wpm88 |
Created |
Created container: splitter-graph-35687 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-35687-79cdffcd67-wpm88 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:367463b1d3262f4416182663b2344c09f7ccedc3764563fd3d0aee32ec772aae" already present on machine | |
kserve-ci-e2e-test |
multus |
splitter-graph-35687-79cdffcd67-wpm88 |
AddedInterface |
Add eth0 [10.132.0.44/23] from ovn-kubernetes | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-35687-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-35687-79cdffcd67 |
SuccessfulCreate |
Created pod: splitter-graph-35687-79cdffcd67-wpm88 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-12313-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-35687 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-35687-79cdffcd67 from 0 to 1 | |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-12313-predictor-857dcf8cc4-46rl6 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.42:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-12313-predictor-7746bc869-vlbsc |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.43:8080: connect: connection refused |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-766ab-predictor-69d568958b |
SuccessfulCreate |
Created pod: success-200-isvc-766ab-predictor-69d568958b-r85bq | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-766ab |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-766ab": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-35687-predictor-d8849b54c-bcggv |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-35687-predictor-6d599c8c48-68thq |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-766ab-predictor-69d568958b-r85bq |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-766ab-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-35687-79cdffcd67-wpm88 |
Killing |
Stopping container splitter-graph-35687 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-766ab |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-766ab": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-766ab |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-766ab": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-766ab": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-35687-predictor-d8849b54c-bcggv |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-766ab-predictor-76978cfc8f-lfgfl |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-766ab-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-766ab-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-766ab-predictor-69d568958b from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-766ab |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-766ab": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-766ab": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-766ab-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-766ab-predictor-76978cfc8f from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-766ab-predictor-76978cfc8f |
SuccessfulCreate |
Created pod: error-404-isvc-766ab-predictor-76978cfc8f-lfgfl | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-35687-predictor-6d599c8c48-68thq |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-766ab-predictor-69d568958b-r85bq |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-766ab-predictor-76978cfc8f-lfgfl |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-766ab-predictor-76978cfc8f-lfgfl |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-766ab-predictor-76978cfc8f-lfgfl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-766ab-predictor-76978cfc8f-lfgfl |
AddedInterface |
Add eth0 [10.132.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-766ab-predictor-69d568958b-r85bq |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-766ab-predictor-69d568958b-r85bq |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-766ab-predictor-69d568958b-r85bq |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-766ab-predictor-76978cfc8f-lfgfl |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-766ab-predictor-76978cfc8f-lfgfl |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-766ab-predictor-76978cfc8f-lfgfl |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-766ab-predictor-69d568958b-r85bq |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-766ab-predictor-69d568958b-r85bq |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-1532" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-766ab-predictor-69d568958b-r85bq |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-35687-predictor-d8849b54c-bcggv |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.42:8643/healthz": dial tcp 10.132.0.42:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-35687-predictor-6d599c8c48-68thq |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.41:8643/healthz": dial tcp 10.134.0.41:8643: connect: connection refused | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-12313 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-12313 |
InferenceServiceReady |
InferenceService [success-200-isvc-12313] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-12313 |
InferenceServiceReady |
InferenceService [error-404-isvc-12313] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-12313 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-12313-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-12313-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-12313 |
InferenceGraphReady |
InferenceGraph [switch-graph-12313] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-12313 |
ScalingReplicaSet |
Scaled up replica set switch-graph-12313-76b55b9df6 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-12313-76b55b9df6 |
SuccessfulCreate |
Created pod: switch-graph-12313-76b55b9df6-96qlq | |
kserve-ci-e2e-test |
kubelet |
switch-graph-12313-76b55b9df6-96qlq |
Started |
Started container switch-graph-12313 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-12313-76b55b9df6-96qlq |
Created |
Created container: switch-graph-12313 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-12313-76b55b9df6-96qlq |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:367463b1d3262f4416182663b2344c09f7ccedc3764563fd3d0aee32ec772aae" already present on machine | |
kserve-ci-e2e-test |
multus |
switch-graph-12313-76b55b9df6-96qlq |
AddedInterface |
Add eth0 [10.132.0.46/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-12313-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-12313-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-35687-79cdffcd67-wpm88 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x6) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-766ab-predictor-69d568958b-r85bq |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.43:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-766ab-predictor-76978cfc8f-lfgfl |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.45:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-766ab-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-766ab-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-766ab-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-766ab-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-766ab |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-766ab |
InferenceServiceReady |
InferenceService [error-404-isvc-766ab] is Ready | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-766ab |
InferenceServiceReady |
InferenceService [success-200-isvc-766ab] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-766ab |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-12313 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-12313 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
splitter-graph-766ab-98578b9d8-6bwk6 |
AddedInterface |
Add eth0 [10.132.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-766ab-98578b9d8-6bwk6 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:367463b1d3262f4416182663b2344c09f7ccedc3764563fd3d0aee32ec772aae" already present on machine | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-766ab-98578b9d8-6bwk6 |
Created |
Created container: splitter-graph-766ab | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-766ab-98578b9d8-6bwk6 |
Started |
Started container splitter-graph-766ab | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-766ab-98578b9d8 |
SuccessfulCreate |
Created pod: splitter-graph-766ab-98578b9d8-6bwk6 | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-766ab |
ScalingReplicaSet |
Scaled up replica set splitter-graph-766ab-98578b9d8 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-766ab |
InferenceGraphReady |
InferenceGraph [splitter-graph-766ab] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-766ab-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-766ab-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-766ab-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-766ab-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-766ab |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-766ab |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-766ab |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-766ab |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-766ab-predictor-76978cfc8f-lfgfl |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-766ab-98578b9d8-6bwk6 |
Killing |
Stopping container splitter-graph-766ab | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-766ab-predictor-69d568958b-r85bq |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-766ab-predictor-69d568958b-r85bq |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-766ab-predictor-76978cfc8f-lfgfl |
Killing |
Stopping container kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-766ab-98578b9d8-6bwk6 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-12313-predictor-7746bc869-vlbsc |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-12313-predictor-857dcf8cc4-46rl6 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
switch-graph-12313-76b55b9df6-96qlq |
Killing |
Stopping container switch-graph-12313 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-12313-predictor-7746bc869-vlbsc |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-12313-predictor-857dcf8cc4-46rl6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-12313-predictor-7746bc869-vlbsc |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.43:8643/healthz": dial tcp 10.132.0.43:8643: connect: connection refused | |
| (x5) | kserve-ci-e2e-test |
kubelet |
switch-graph-12313-76b55b9df6-96qlq |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |