| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
error-404-isvc-7c9ed-predictor-c4c8dc488-hxjcl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-7c9ed-predictor-c4c8dc488-hxjcl to ip-10-0-143-79.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-6304f-predictor-68f6bc4694-98blq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-6304f-predictor-68f6bc4694-98blq to ip-10-0-143-79.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-8aa04-785cbdc5c8-rrcvw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-8aa04-785cbdc5c8-rrcvw to ip-10-0-128-224.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-de495-predictor-7fb5ffb98b-ztgqk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-de495-predictor-7fb5ffb98b-ztgqk to ip-10-0-143-79.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-7c9ed-75c5c964bc-f49kw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-7c9ed-75c5c964bc-f49kw to ip-10-0-128-224.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-191f9-predictor-6f8b8449b5-shdc6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-191f9-predictor-6f8b8449b5-shdc6 to ip-10-0-135-110.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-8aa04-predictor-b58b89b85-5tmrg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-8aa04-predictor-b58b89b85-5tmrg to ip-10-0-135-110.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-191f9-58b7f9f45-q6mtt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-191f9-58b7f9f45-q6mtt to ip-10-0-128-224.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-bb388-predictor-6d44f64874-nwx7t |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-bb388-predictor-6d44f64874-nwx7t to ip-10-0-143-79.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-de495-predictor-6b9d94d467-z9z4x |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-de495-predictor-6b9d94d467-z9z4x to ip-10-0-135-110.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-bb388-5b7597b4b8-nsmq4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-bb388-5b7597b4b8-nsmq4 to ip-10-0-128-224.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-de495-69977d94b8-6jnmn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-de495-69977d94b8-6jnmn to ip-10-0-128-224.ec2.internal | ||
kserve-ci-e2e-test |
splitter-graph-b3de6-586d65fc7b-lczd2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/splitter-graph-b3de6-586d65fc7b-lczd2 to ip-10-0-128-224.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-8aa04-predictor-84fd66b648-4gjpf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-8aa04-predictor-84fd66b648-4gjpf to ip-10-0-143-79.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-b3de6-predictor-789679b4dd-5cfbf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-b3de6-predictor-789679b4dd-5cfbf to ip-10-0-143-79.ec2.internal | ||
kserve-ci-e2e-test |
model-chainer-7bcc66cdd8-fd944 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/model-chainer-7bcc66cdd8-fd944 to ip-10-0-128-224.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-1-predictor-66bf4f5cc4-lj7dl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-66bf4f5cc4-lj7dl to ip-10-0-135-110.ec2.internal | ||
kserve-ci-e2e-test |
switch-graph-a2696-7758d57596-5hcnh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/switch-graph-a2696-7758d57596-5hcnh to ip-10-0-128-224.ec2.internal | ||
kserve-ci-e2e-test |
isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk to ip-10-0-135-110.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-bb388-predictor-7fcb976d9f-p9fmf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-bb388-predictor-7fcb976d9f-p9fmf to ip-10-0-135-110.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-b3de6-predictor-5f84b875fc-wwp5q |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-b3de6-predictor-5f84b875fc-wwp5q to ip-10-0-135-110.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-a2696-predictor-6d48d4c789-h4v26 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-a2696-predictor-6d48d4c789-h4v26 to ip-10-0-135-110.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-8d780-predictor-577499d7ff-2nw5r |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-8d780-predictor-577499d7ff-2nw5r to ip-10-0-135-110.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-a2696-predictor-548b77d64-8zrh5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-a2696-predictor-548b77d64-8zrh5 to ip-10-0-143-79.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-191f9-predictor-86c89bb448-hmcl7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-191f9-predictor-86c89bb448-hmcl7 to ip-10-0-143-79.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-8d780-567975d654-5cz79 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-8d780-567975d654-5cz79 to ip-10-0-128-224.ec2.internal | ||
kserve-ci-e2e-test |
isvc-xgboost-graph-predictor-555fc69d56-jp7sd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-jp7sd to ip-10-0-135-110.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-6304f-predictor-9c8948987-8lbnb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-6304f-predictor-9c8948987-8lbnb to ip-10-0-135-110.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-8d780-predictor-7c7b685fcd-6l974 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-8d780-predictor-7c7b685fcd-6l974 to ip-10-0-143-79.ec2.internal | ||
kserve-ci-e2e-test |
ensemble-graph-6304f-66c85585fd-jtg67 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/ensemble-graph-6304f-66c85585fd-jtg67 to ip-10-0-128-224.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-630d7-predictor-76777f589-z5cbj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-630d7-predictor-76777f589-z5cbj to ip-10-0-135-110.ec2.internal | ||
kserve-ci-e2e-test |
success-200-isvc-7c9ed-predictor-7fbffd8ccc-xzt2f |
Scheduled |
Successfully assigned kserve-ci-e2e-test/success-200-isvc-7c9ed-predictor-7fbffd8ccc-xzt2f to ip-10-0-135-110.ec2.internal | ||
kserve-ci-e2e-test |
error-404-isvc-630d7-predictor-7bc45d9448-6gblb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/error-404-isvc-630d7-predictor-7bc45d9448-6gblb to ip-10-0-143-79.ec2.internal | ||
kserve-ci-e2e-test |
sequence-graph-630d7-56cf9d7d54-gs9ts |
Scheduled |
Successfully assigned kserve-ci-e2e-test/sequence-graph-630d7-56cf9d7d54-gs9ts to ip-10-0-128-224.ec2.internal | ||
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-191f9-predictor-6f8b8449b5 |
SuccessfulCreate |
Created pod: success-200-isvc-191f9-predictor-6f8b8449b5-shdc6 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-1-predictor-66bf4f5cc4 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-1-predictor-66bf4f5cc4-lj7dl | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-1-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-1-predictor-66bf4f5cc4 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
isvc-sklearn-graph-2-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-sklearn-graph-2-predictor-b7ccc5f99 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-191f9-predictor-86c89bb448 |
SuccessfulCreate |
Created pod: error-404-isvc-191f9-predictor-86c89bb448-hmcl7 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-191f9-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-191f9-predictor-86c89bb448 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-sklearn-graph-2-predictor-b7ccc5f99 |
SuccessfulCreate |
Created pod: isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk | |
kserve-ci-e2e-test |
deployment-controller |
isvc-xgboost-graph-predictor |
ScalingReplicaSet |
Scaled up replica set isvc-xgboost-graph-predictor-555fc69d56 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
isvc-xgboost-graph-predictor-555fc69d56 |
SuccessfulCreate |
Created pod: isvc-xgboost-graph-predictor-555fc69d56-jp7sd | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-191f9-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-191f9-predictor-6f8b8449b5 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-66bf4f5cc4-lj7dl |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-sklearn-graph-2-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-66bf4f5cc4-lj7dl |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-66bf4f5cc4-lj7dl |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:2cbd0ba61f740962b2bad1a0e55e41574489d7afdb86fa314f3953b8c8af773e" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-191f9-predictor-6f8b8449b5-shdc6 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-191f9-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-1-predictor-66bf4f5cc4-lj7dl |
AddedInterface |
Add eth0 [10.134.0.24/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-jp7sd |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "isvc-xgboost-graph-predictor-serving-cert" not found |
kserve-ci-e2e-test |
multus |
isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:2cbd0ba61f740962b2bad1a0e55e41574489d7afdb86fa314f3953b8c8af773e" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-191f9-predictor-6f8b8449b5-shdc6 |
AddedInterface |
Add eth0 [10.134.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-191f9-predictor-6f8b8449b5-shdc6 |
Pulling |
Pulling image "quay.io/opendatahub/success-200-isvc:odh-pr-2013" | |
kserve-ci-e2e-test |
multus |
error-404-isvc-191f9-predictor-86c89bb448-hmcl7 |
AddedInterface |
Add eth0 [10.132.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-191f9-predictor-86c89bb448-hmcl7 |
Pulling |
Pulling image "quay.io/opendatahub/error-404-isvc:odh-pr-2013" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-jp7sd |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:2cbd0ba61f740962b2bad1a0e55e41574489d7afdb86fa314f3953b8c8af773e" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-jp7sd |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
isvc-xgboost-graph-predictor-555fc69d56-jp7sd |
AddedInterface |
Add eth0 [10.134.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-jp7sd |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-2013" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-66bf4f5cc4-lj7dl |
Pulling |
Pulling image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-2013" | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-jp7sd |
Pulling |
Pulling image "kserve/xgbserver:latest" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-191f9-predictor-86c89bb448-hmcl7 |
Pulled |
Successfully pulled image "quay.io/opendatahub/error-404-isvc:odh-pr-2013" in 11.38s (11.38s including waiting). Image size: 1384134226 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-191f9-predictor-86c89bb448-hmcl7 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-191f9-predictor-86c89bb448-hmcl7 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-191f9-predictor-86c89bb448-hmcl7 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-191f9-predictor-86c89bb448-hmcl7 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-191f9-predictor-86c89bb448-hmcl7 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 2.139s (2.139s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-191f9-predictor-86c89bb448-hmcl7 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-191f9-predictor-6f8b8449b5-shdc6 |
Pulled |
Successfully pulled image "quay.io/opendatahub/success-200-isvc:odh-pr-2013" in 16.533s (16.533s including waiting). Image size: 1386037849 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-66bf4f5cc4-lj7dl |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-2013" in 11.117s (11.117s including waiting). Image size: 1607081368 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-66bf4f5cc4-lj7dl |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-191f9-predictor-6f8b8449b5-shdc6 |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-191f9-predictor-6f8b8449b5-shdc6 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-191f9-predictor-6f8b8449b5-shdc6 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-66bf4f5cc4-lj7dl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-66bf4f5cc4-lj7dl |
Pulling |
Pulling image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk |
Pulled |
Successfully pulled image "quay.io/opendatahub/sklearn-serving-runtime:odh-pr-2013" in 11.109s (11.109s including waiting). Image size: 1607081368 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 4.78s (4.78s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-191f9-predictor-6f8b8449b5-shdc6 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 4.731s (4.731s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-66bf4f5cc4-lj7dl |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" in 4.784s (4.784s including waiting). Image size: 211946088 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-66bf4f5cc4-lj7dl |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-66bf4f5cc4-lj7dl |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-191f9-predictor-6f8b8449b5-shdc6 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-191f9-predictor-6f8b8449b5-shdc6 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-jp7sd |
Pulled |
Successfully pulled image "kserve/xgbserver:latest" in 29.029s (29.029s including waiting). Image size: 1436472580 bytes. | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-jp7sd |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-jp7sd |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-jp7sd |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-jp7sd |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-jp7sd |
Created |
Created container: kserve-container | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-191f9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-191f9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-191f9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-191f9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-191f9 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-191f9 |
InferenceServiceReady |
InferenceService [error-404-isvc-191f9] is Ready | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-191f9-predictor-6f8b8449b5-shdc6 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.25:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-191f9 |
InferenceServiceReady |
InferenceService [success-200-isvc-191f9] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-191f9 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-191f9 |
InferenceGraphReady |
InferenceGraph [switch-graph-191f9] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-191f9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-191f9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-191f9-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
switch-graph-191f9-58b7f9f45-q6mtt |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-191f9-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-191f9-58b7f9f45 |
SuccessfulCreate |
Created pod: switch-graph-191f9-58b7f9f45-q6mtt | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-191f9 |
UpdateFailed |
Failed to update status for InferenceGraph "switch-graph-191f9": Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-191f9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-191f9 |
ScalingReplicaSet |
Scaled up replica set switch-graph-191f9-58b7f9f45 from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-191f9-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-191f9 |
InternalError |
fails to update InferenceGraph status: Operation cannot be fulfilled on inferencegraphs.serving.kserve.io "switch-graph-191f9": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
switch-graph-191f9-58b7f9f45-q6mtt |
Pulling |
Pulling image "quay.io/opendatahub/kserve-router@sha256:9ee58bd289ecb7aa4010c311b867cae9a40a42edc53d096a1f0354150db5c48e" | |
kserve-ci-e2e-test |
multus |
switch-graph-191f9-58b7f9f45-q6mtt |
AddedInterface |
Add eth0 [10.133.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
switch-graph-191f9-58b7f9f45-q6mtt |
Started |
Started container switch-graph-191f9 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-191f9-58b7f9f45-q6mtt |
Created |
Created container: switch-graph-191f9 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-191f9-58b7f9f45-q6mtt |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-router@sha256:9ee58bd289ecb7aa4010c311b867cae9a40a42edc53d096a1f0354150db5c48e" in 2.366s (2.366s including waiting). Image size: 211751521 bytes. | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-8aa04-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-8aa04-predictor-84fd66b648 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-191f9-58b7f9f45-q6mtt |
Killing |
Stopping container switch-graph-191f9 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-191f9-predictor-6f8b8449b5-shdc6 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-8aa04-predictor-84fd66b648 |
SuccessfulCreate |
Created pod: error-404-isvc-8aa04-predictor-84fd66b648-4gjpf | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-191f9-predictor-86c89bb448-hmcl7 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-8aa04-predictor-b58b89b85 |
SuccessfulCreate |
Created pod: success-200-isvc-8aa04-predictor-b58b89b85-5tmrg | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-8aa04-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-8aa04-predictor-b58b89b85 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-191f9-predictor-86c89bb448-hmcl7 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-191f9-predictor-6f8b8449b5-shdc6 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8aa04-predictor-b58b89b85-5tmrg |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8aa04-predictor-b58b89b85-5tmrg |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-191f9-predictor-86c89bb448-hmcl7 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.25:8643/healthz": dial tcp 10.132.0.25:8643: connect: connection refused | |
kserve-ci-e2e-test |
multus |
error-404-isvc-8aa04-predictor-84fd66b648-4gjpf |
AddedInterface |
Add eth0 [10.132.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8aa04-predictor-84fd66b648-4gjpf |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-2013" already present on machine | |
| (x8) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-191f9-predictor-86c89bb448-hmcl7 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.25:8080: connect: connection refused |
kserve-ci-e2e-test |
multus |
success-200-isvc-8aa04-predictor-b58b89b85-5tmrg |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8aa04-predictor-b58b89b85-5tmrg |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-2013" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8aa04-predictor-b58b89b85-5tmrg |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8aa04-predictor-84fd66b648-4gjpf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8aa04-predictor-b58b89b85-5tmrg |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8aa04-predictor-84fd66b648-4gjpf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8aa04-predictor-b58b89b85-5tmrg |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8aa04-predictor-84fd66b648-4gjpf |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8aa04-predictor-84fd66b648-4gjpf |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8aa04-predictor-84fd66b648-4gjpf |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-191f9-predictor-6f8b8449b5-shdc6 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.25:8643/healthz": dial tcp 10.134.0.25:8643: connect: connection refused | |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-1] is Ready | |
| (x9) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-1 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
InferenceServiceReady |
InferenceService [isvc-sklearn-graph-2] is Ready | |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-sklearn-graph-2 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x10) | kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
isvc-xgboost-graph |
InferenceServiceReady |
InferenceService [isvc-xgboost-graph] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-191f9-58b7f9f45-q6mtt |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
multus |
model-chainer-7bcc66cdd8-fd944 |
AddedInterface |
Add eth0 [10.133.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
InferenceGraphController |
model-chainer |
InferenceGraphReady |
InferenceGraph [model-chainer] is Ready | |
kserve-ci-e2e-test |
kubelet |
model-chainer-7bcc66cdd8-fd944 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:9ee58bd289ecb7aa4010c311b867cae9a40a42edc53d096a1f0354150db5c48e" already present on machine | |
kserve-ci-e2e-test |
kubelet |
model-chainer-7bcc66cdd8-fd944 |
Created |
Created container: model-chainer | |
kserve-ci-e2e-test |
kubelet |
model-chainer-7bcc66cdd8-fd944 |
Started |
Started container model-chainer | |
kserve-ci-e2e-test |
replicaset-controller |
model-chainer-7bcc66cdd8 |
SuccessfulCreate |
Created pod: model-chainer-7bcc66cdd8-fd944 | |
kserve-ci-e2e-test |
deployment-controller |
model-chainer |
ScalingReplicaSet |
Scaled up replica set model-chainer-7bcc66cdd8 from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8aa04-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8aa04-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8aa04-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8aa04-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-2-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-sklearn-graph-1-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
isvc-xgboost-graph-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
model-chainer-7bcc66cdd8-fd944 |
Killing |
Stopping container model-chainer | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-jp7sd |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-66bf4f5cc4-lj7dl |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-66bf4f5cc4-lj7dl |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-jp7sd |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d780-predictor-577499d7ff-2nw5r |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d780-predictor-577499d7ff-2nw5r |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-8d780-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-8d780-predictor-7c7b685fcd from 0 to 1 | |
| (x12) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.27:8080: connect: connection refused |
kserve-ci-e2e-test |
multus |
success-200-isvc-8d780-predictor-577499d7ff-2nw5r |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-8d780-predictor-7c7b685fcd |
SuccessfulCreate |
Created pod: error-404-isvc-8d780-predictor-7c7b685fcd-6l974 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d780-predictor-7c7b685fcd-6l974 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d780-predictor-7c7b685fcd-6l974 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d780-predictor-7c7b685fcd-6l974 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d780-predictor-7c7b685fcd-6l974 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d780-predictor-7c7b685fcd-6l974 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d780-predictor-7c7b685fcd-6l974 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-2013" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-8d780-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-8d780-predictor-577499d7ff from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-8d780-predictor-577499d7ff |
SuccessfulCreate |
Created pod: success-200-isvc-8d780-predictor-577499d7ff-2nw5r | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d780-predictor-577499d7ff-2nw5r |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d780-predictor-577499d7ff-2nw5r |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-2013" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-8d780-predictor-7c7b685fcd-6l974 |
AddedInterface |
Add eth0 [10.132.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d780-predictor-577499d7ff-2nw5r |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d780-predictor-577499d7ff-2nw5r |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-2-predictor-b7ccc5f99-hx7fk |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.27:8643/healthz": dial tcp 10.134.0.27:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-66bf4f5cc4-lj7dl |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.24:8643/healthz": dial tcp 10.134.0.24:8643: connect: connection refused | |
| (x11) | kserve-ci-e2e-test |
kubelet |
isvc-sklearn-graph-1-predictor-66bf4f5cc4-lj7dl |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.24:8080: connect: connection refused |
| (x10) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-jp7sd |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.26:8080: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
kubelet |
isvc-xgboost-graph-predictor-555fc69d56-jp7sd |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.26:8643/healthz": dial tcp 10.134.0.26:8643: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8aa04 |
InferenceServiceReady |
InferenceService [error-404-isvc-8aa04] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8aa04 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8aa04 |
InferenceServiceReady |
InferenceService [success-200-isvc-8aa04] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8aa04 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
model-chainer-7bcc66cdd8-fd944 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-8aa04 |
ScalingReplicaSet |
Scaled up replica set switch-graph-8aa04-785cbdc5c8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-8aa04-785cbdc5c8-rrcvw |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-8aa04-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-8aa04-785cbdc5c8 |
SuccessfulCreate |
Created pod: switch-graph-8aa04-785cbdc5c8-rrcvw | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-8aa04 |
InferenceGraphReady |
InferenceGraph [switch-graph-8aa04] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-8aa04-785cbdc5c8-rrcvw |
Created |
Created container: switch-graph-8aa04 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8d780-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
switch-graph-8aa04-785cbdc5c8-rrcvw |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:9ee58bd289ecb7aa4010c311b867cae9a40a42edc53d096a1f0354150db5c48e" already present on machine | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8d780-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8d780-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
switch-graph-8aa04-785cbdc5c8-rrcvw |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8d780-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
switch-graph-8aa04-785cbdc5c8-rrcvw |
Started |
Started container switch-graph-8aa04 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8aa04-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8aa04-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8aa04-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8aa04-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8d780 |
InferenceServiceReady |
InferenceService [error-404-isvc-8d780] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-8d780 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8d780 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-8d780 |
InferenceServiceReady |
InferenceService [success-200-isvc-8d780] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-8aa04 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-8aa04 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-8d780 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-8d780-567975d654 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
sequence-graph-8d780-567975d654-5cz79 |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8d780-567975d654-5cz79 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:9ee58bd289ecb7aa4010c311b867cae9a40a42edc53d096a1f0354150db5c48e" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8d780-567975d654-5cz79 |
Created |
Created container: sequence-graph-8d780 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8d780-567975d654-5cz79 |
Started |
Started container sequence-graph-8d780 | |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-8d780-567975d654 |
SuccessfulCreate |
Created pod: sequence-graph-8d780-567975d654-5cz79 | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-8d780 |
InferenceGraphReady |
InferenceGraph [sequence-graph-8d780] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8d780-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8d780-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-8d780-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-8d780-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-8d780 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-8d780 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-8d780 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-8d780 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8aa04-predictor-b58b89b85-5tmrg |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-6304f-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-6304f-predictor-9c8948987 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8aa04-predictor-b58b89b85-5tmrg |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8aa04-predictor-84fd66b648-4gjpf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8aa04-predictor-84fd66b648-4gjpf |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
switch-graph-8aa04-785cbdc5c8-rrcvw |
Killing |
Stopping container switch-graph-8aa04 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-6304f-predictor-68f6bc4694 |
SuccessfulCreate |
Created pod: error-404-isvc-6304f-predictor-68f6bc4694-98blq | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-6304f-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-6304f-predictor-68f6bc4694 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-6304f-predictor-9c8948987 |
SuccessfulCreate |
Created pod: success-200-isvc-6304f-predictor-9c8948987-8lbnb | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6304f-predictor-68f6bc4694-98blq |
Started |
Started container kserve-container | |
| (x2) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-6304f-predictor-9c8948987-8lbnb |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "success-200-isvc-6304f-predictor-serving-cert" not found |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6304f-predictor-68f6bc4694-98blq |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6304f-predictor-68f6bc4694-98blq |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6304f-predictor-68f6bc4694-98blq |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
error-404-isvc-6304f-predictor-68f6bc4694-98blq |
AddedInterface |
Add eth0 [10.132.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6304f-predictor-68f6bc4694-98blq |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-2013" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6304f-predictor-68f6bc4694-98blq |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-6304f-predictor-9c8948987-8lbnb |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6304f-predictor-9c8948987-8lbnb |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8aa04-predictor-b58b89b85-5tmrg |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.28:8643/healthz": dial tcp 10.134.0.28:8643: connect: connection refused | |
| (x8) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-8aa04-predictor-b58b89b85-5tmrg |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.28:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6304f-predictor-9c8948987-8lbnb |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-8aa04-predictor-84fd66b648-4gjpf |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.26:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8aa04-predictor-84fd66b648-4gjpf |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.26:8643/healthz": dial tcp 10.132.0.26:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6304f-predictor-9c8948987-8lbnb |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6304f-predictor-9c8948987-8lbnb |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6304f-predictor-9c8948987-8lbnb |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-2013" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6304f-predictor-9c8948987-8lbnb |
Created |
Created container: kserve-container | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-8aa04-785cbdc5c8-rrcvw |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6304f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6304f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6304f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6304f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-6304f-predictor-68f6bc4694-98blq |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.28:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7c9ed |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-7c9ed": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-7c9ed-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-7c9ed-predictor-c4c8dc488 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-7c9ed-predictor-c4c8dc488 |
SuccessfulCreate |
Created pod: error-404-isvc-7c9ed-predictor-c4c8dc488-hxjcl | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d780-predictor-7c7b685fcd-6l974 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d780-predictor-7c7b685fcd-6l974 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d780-predictor-577499d7ff-2nw5r |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-7c9ed-predictor-7fbffd8ccc |
SuccessfulCreate |
Created pod: success-200-isvc-7c9ed-predictor-7fbffd8ccc-xzt2f | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d780-predictor-577499d7ff-2nw5r |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7c9ed |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-7c9ed": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-7c9ed": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-7c9ed-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-7c9ed-predictor-7fbffd8ccc from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7c9ed |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-7c9ed": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-7c9ed": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7c9ed |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-7c9ed": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-8d780-567975d654-5cz79 |
Killing |
Stopping container sequence-graph-8d780 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7c9ed-predictor-7fbffd8ccc-xzt2f |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7c9ed-predictor-7fbffd8ccc-xzt2f |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7c9ed-predictor-7fbffd8ccc-xzt2f |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7c9ed-predictor-c4c8dc488-hxjcl |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-7c9ed-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7c9ed-predictor-7fbffd8ccc-xzt2f |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7c9ed-predictor-7fbffd8ccc-xzt2f |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-2013" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-7c9ed-predictor-7fbffd8ccc-xzt2f |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7c9ed-predictor-7fbffd8ccc-xzt2f |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7c9ed-predictor-c4c8dc488-hxjcl |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7c9ed-predictor-c4c8dc488-hxjcl |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d780-predictor-7c7b685fcd-6l974 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.27:8643/healthz": dial tcp 10.132.0.27:8643: connect: connection refused | |
kserve-ci-e2e-test |
multus |
error-404-isvc-7c9ed-predictor-c4c8dc488-hxjcl |
AddedInterface |
Add eth0 [10.132.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7c9ed-predictor-c4c8dc488-hxjcl |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-2013" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7c9ed-predictor-c4c8dc488-hxjcl |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7c9ed-predictor-c4c8dc488-hxjcl |
Created |
Created container: kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-8d780-predictor-7c7b685fcd-6l974 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.27:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7c9ed-predictor-c4c8dc488-hxjcl |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d780-predictor-577499d7ff-2nw5r |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.29:8643/healthz": dial tcp 10.134.0.29:8643: connect: connection refused | |
| (x8) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-8d780-predictor-577499d7ff-2nw5r |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.29:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6304f |
InferenceServiceReady |
InferenceService [error-404-isvc-6304f] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-6304f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-6304f-predictor-9c8948987-8lbnb |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.30:8080: connect: connection refused |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7c9ed-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7c9ed-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6304f |
InferenceServiceReady |
InferenceService [success-200-isvc-6304f] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6304f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-6304f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-6304f |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-8d780-567975d654-5cz79 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-6304f-66c85585fd-jtg67 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-6304f-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-6304f |
InferenceGraphReady |
InferenceGraph [ensemble-graph-6304f] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-6304f |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-6304f-66c85585fd from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-6304f-66c85585fd |
SuccessfulCreate |
Created pod: ensemble-graph-6304f-66c85585fd-jtg67 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-6304f-66c85585fd-jtg67 |
Created |
Created container: ensemble-graph-6304f | |
kserve-ci-e2e-test |
multus |
ensemble-graph-6304f-66c85585fd-jtg67 |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-6304f-66c85585fd-jtg67 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:9ee58bd289ecb7aa4010c311b867cae9a40a42edc53d096a1f0354150db5c48e" already present on machine | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-6304f-66c85585fd-jtg67 |
Started |
Started container ensemble-graph-6304f | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6304f-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-6304f-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-de495 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-de495": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6304f-predictor-68f6bc4694-98blq |
Killing |
Stopping container kube-rbac-proxy | |
| (x6) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-7c9ed-predictor-c4c8dc488-hxjcl |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.29:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de495-predictor-7fb5ffb98b-ztgqk |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-de495-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-de495-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-de495-predictor-7fb5ffb98b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6304f-predictor-68f6bc4694-98blq |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-de495 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-de495": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-de495": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-de495-predictor-6b9d94d467 |
SuccessfulCreate |
Created pod: success-200-isvc-de495-predictor-6b9d94d467-z9z4x | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6304f-predictor-9c8948987-8lbnb |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-6304f-66c85585fd-jtg67 |
Killing |
Stopping container ensemble-graph-6304f | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6304f-predictor-9c8948987-8lbnb |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-de495 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-de495": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-de495 |
UpdateFailed |
Failed to update status for InferenceService "error-404-isvc-de495": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "error-404-isvc-de495": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-de495-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-de495-predictor-6b9d94d467 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-de495-predictor-7fb5ffb98b |
SuccessfulCreate |
Created pod: error-404-isvc-de495-predictor-7fb5ffb98b-ztgqk | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-6304f-predictor-68f6bc4694-98blq |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.28:8643/healthz": dial tcp 10.132.0.28:8643: connect: connection refused | |
kserve-ci-e2e-test |
multus |
error-404-isvc-de495-predictor-7fb5ffb98b-ztgqk |
AddedInterface |
Add eth0 [10.132.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de495-predictor-7fb5ffb98b-ztgqk |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de495-predictor-7fb5ffb98b-ztgqk |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
multus |
success-200-isvc-de495-predictor-6b9d94d467-z9z4x |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de495-predictor-7fb5ffb98b-ztgqk |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de495-predictor-7fb5ffb98b-ztgqk |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de495-predictor-6b9d94d467-z9z4x |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-2013" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de495-predictor-6b9d94d467-z9z4x |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de495-predictor-6b9d94d467-z9z4x |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de495-predictor-7fb5ffb98b-ztgqk |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-2013" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de495-predictor-7fb5ffb98b-ztgqk |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de495-predictor-6b9d94d467-z9z4x |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de495-predictor-6b9d94d467-z9z4x |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de495-predictor-6b9d94d467-z9z4x |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-6304f-predictor-9c8948987-8lbnb |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.30:8643/healthz": dial tcp 10.134.0.30:8643: connect: connection refused | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7c9ed-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7c9ed-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-7c9ed-predictor-7fbffd8ccc-xzt2f |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.31:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7c9ed |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-7c9ed |
InferenceServiceReady |
InferenceService [error-404-isvc-7c9ed] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7c9ed |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-7c9ed |
InferenceServiceReady |
InferenceService [success-200-isvc-7c9ed] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-6304f-66c85585fd-jtg67 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-7c9ed |
InferenceGraphReady |
InferenceGraph [sequence-graph-7c9ed] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-de495-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-de495-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-de495-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-7c9ed-75c5c964bc |
SuccessfulCreate |
Created pod: sequence-graph-7c9ed-75c5c964bc-f49kw | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-7c9ed |
ScalingReplicaSet |
Scaled up replica set sequence-graph-7c9ed-75c5c964bc from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-de495-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
multus |
sequence-graph-7c9ed-75c5c964bc-f49kw |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-7c9ed-75c5c964bc-f49kw |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:9ee58bd289ecb7aa4010c311b867cae9a40a42edc53d096a1f0354150db5c48e" already present on machine | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-7c9ed-75c5c964bc-f49kw |
Created |
Created container: sequence-graph-7c9ed | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-7c9ed-75c5c964bc-f49kw |
Started |
Started container sequence-graph-7c9ed | |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7c9ed-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7c9ed-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-7c9ed-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-7c9ed-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
sequence-graph-7c9ed-75c5c964bc-f49kw |
Killing |
Stopping container sequence-graph-7c9ed | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-630d7-predictor-76777f589 |
SuccessfulCreate |
Created pod: success-200-isvc-630d7-predictor-76777f589-z5cbj | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7c9ed-predictor-7fbffd8ccc-xzt2f |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-630d7-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-630d7-predictor-76777f589 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7c9ed-predictor-7fbffd8ccc-xzt2f |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-630d7-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-630d7-predictor-7bc45d9448 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7c9ed-predictor-c4c8dc488-hxjcl |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-7c9ed-predictor-c4c8dc488-hxjcl |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-630d7-predictor-76777f589-z5cbj |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
success-200-isvc-630d7-predictor-76777f589-z5cbj |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-630d7-predictor-76777f589-z5cbj |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-2013" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-630d7-predictor-76777f589-z5cbj |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-630d7-predictor-7bc45d9448-6gblb |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-630d7-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-630d7-predictor-76777f589-z5cbj |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-630d7-predictor-76777f589-z5cbj |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-630d7-predictor-76777f589-z5cbj |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-630d7-predictor-7bc45d9448 |
SuccessfulCreate |
Created pod: error-404-isvc-630d7-predictor-7bc45d9448-6gblb | |
kserve-ci-e2e-test |
multus |
error-404-isvc-630d7-predictor-7bc45d9448-6gblb |
AddedInterface |
Add eth0 [10.132.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-630d7-predictor-7bc45d9448-6gblb |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-2013" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-630d7-predictor-7bc45d9448-6gblb |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-630d7-predictor-7bc45d9448-6gblb |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-630d7-predictor-7bc45d9448-6gblb |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-630d7-predictor-7bc45d9448-6gblb |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-630d7-predictor-7bc45d9448-6gblb |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-7c9ed-predictor-7fbffd8ccc-xzt2f |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.31:8643/healthz": dial tcp 10.134.0.31:8643: connect: connection refused | |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-de495 |
InferenceServiceReady |
InferenceService [error-404-isvc-de495] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-de495 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-de495 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-de495 |
InferenceServiceReady |
InferenceService [success-200-isvc-de495] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-7c9ed-75c5c964bc-f49kw |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
replicaset-controller |
ensemble-graph-de495-69977d94b8 |
SuccessfulCreate |
Created pod: ensemble-graph-de495-69977d94b8-6jnmn | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-de495-69977d94b8-6jnmn |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "ensemble-graph-de495-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
ensemble-graph-de495 |
InferenceGraphReady |
InferenceGraph [ensemble-graph-de495] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
ensemble-graph-de495 |
ScalingReplicaSet |
Scaled up replica set ensemble-graph-de495-69977d94b8 from 0 to 1 | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-630d7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-630d7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-de495-69977d94b8-6jnmn |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:9ee58bd289ecb7aa4010c311b867cae9a40a42edc53d096a1f0354150db5c48e" already present on machine | |
kserve-ci-e2e-test |
multus |
ensemble-graph-de495-69977d94b8-6jnmn |
AddedInterface |
Add eth0 [10.133.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-de495-69977d94b8-6jnmn |
Started |
Started container ensemble-graph-de495 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-de495-69977d94b8-6jnmn |
Created |
Created container: ensemble-graph-de495 | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-de495-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-de495-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-630d7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-630d7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-630d7 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-630d7 |
InferenceServiceReady |
InferenceService [error-404-isvc-630d7] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-630d7 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-630d7 |
InferenceServiceReady |
InferenceService [success-200-isvc-630d7] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-de495 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
ensemble-graph-de495 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-630d7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-630d7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-de495-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x5) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-de495-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
sequence-graph-630d7-56cf9d7d54 |
SuccessfulCreate |
Created pod: sequence-graph-630d7-56cf9d7d54-gs9ts | |
kserve-ci-e2e-test |
deployment-controller |
sequence-graph-630d7 |
ScalingReplicaSet |
Scaled up replica set sequence-graph-630d7-56cf9d7d54 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-630d7-56cf9d7d54-gs9ts |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "sequence-graph-630d7-serving-cert" not found | |
kserve-ci-e2e-test |
InferenceGraphController |
sequence-graph-630d7 |
InferenceGraphReady |
InferenceGraph [sequence-graph-630d7] is Ready | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-630d7-56cf9d7d54-gs9ts |
Created |
Created container: sequence-graph-630d7 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-630d7-56cf9d7d54-gs9ts |
Started |
Started container sequence-graph-630d7 | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-630d7-56cf9d7d54-gs9ts |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:9ee58bd289ecb7aa4010c311b867cae9a40a42edc53d096a1f0354150db5c48e" already present on machine | |
kserve-ci-e2e-test |
multus |
sequence-graph-630d7-56cf9d7d54-gs9ts |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-630d7-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-630d7-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-630d7 |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
sequence-graph-630d7 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-b3de6-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-b3de6-predictor-5f84b875fc from 0 to 1 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b3de6 |
UpdateFailed |
Failed to update status for InferenceService "success-200-isvc-b3de6": Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-b3de6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de495-predictor-6b9d94d467-z9z4x |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de495-predictor-6b9d94d467-z9z4x |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-b3de6-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-b3de6-predictor-789679b4dd from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
ensemble-graph-de495-69977d94b8-6jnmn |
Killing |
Stopping container ensemble-graph-de495 | |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b3de6 |
InternalError |
fails to update InferenceService status: Operation cannot be fulfilled on inferenceservices.serving.kserve.io "success-200-isvc-b3de6": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-b3de6-predictor-789679b4dd |
SuccessfulCreate |
Created pod: error-404-isvc-b3de6-predictor-789679b4dd-5cfbf | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-b3de6-predictor-5f84b875fc |
SuccessfulCreate |
Created pod: success-200-isvc-b3de6-predictor-5f84b875fc-wwp5q | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de495-predictor-7fb5ffb98b-ztgqk |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de495-predictor-7fb5ffb98b-ztgqk |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b3de6-predictor-789679b4dd-5cfbf |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b3de6-predictor-789679b4dd-5cfbf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
multus |
error-404-isvc-b3de6-predictor-789679b4dd-5cfbf |
AddedInterface |
Add eth0 [10.132.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b3de6-predictor-5f84b875fc-wwp5q |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b3de6-predictor-789679b4dd-5cfbf |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b3de6-predictor-789679b4dd-5cfbf |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-2013" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b3de6-predictor-5f84b875fc-wwp5q |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b3de6-predictor-5f84b875fc-wwp5q |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b3de6-predictor-5f84b875fc-wwp5q |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b3de6-predictor-5f84b875fc-wwp5q |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b3de6-predictor-789679b4dd-5cfbf |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b3de6-predictor-5f84b875fc-wwp5q |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-2013" already present on machine | |
kserve-ci-e2e-test |
multus |
success-200-isvc-b3de6-predictor-5f84b875fc-wwp5q |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b3de6-predictor-789679b4dd-5cfbf |
Created |
Created container: kserve-container | |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-de495-predictor-7fb5ffb98b-ztgqk |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.30:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-de495-predictor-7fb5ffb98b-ztgqk |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.30:8643/healthz": dial tcp 10.132.0.30:8643: connect: connection refused | |
| (x8) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-de495-predictor-6b9d94d467-z9z4x |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.32:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-de495-predictor-6b9d94d467-z9z4x |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.32:8643/healthz": dial tcp 10.134.0.32:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
ensemble-graph-de495-69977d94b8-6jnmn |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b3de6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b3de6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b3de6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b3de6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-630d7-predictor-7bc45d9448-6gblb |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-630d7-predictor-76777f589-z5cbj |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-630d7-predictor-76777f589-z5cbj |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
sequence-graph-630d7-56cf9d7d54-gs9ts |
Killing |
Stopping container sequence-graph-630d7 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-630d7-predictor-7bc45d9448-6gblb |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a2696-predictor-6d48d4c789-h4v26 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a2696-predictor-6d48d4c789-h4v26 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-a2696-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-a2696-predictor-6d48d4c789 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-a2696-predictor-6d48d4c789 |
SuccessfulCreate |
Created pod: success-200-isvc-a2696-predictor-6d48d4c789-h4v26 | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-a2696-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-a2696-predictor-548b77d64 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a2696-predictor-6d48d4c789-h4v26 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-a2696-predictor-548b77d64 |
SuccessfulCreate |
Created pod: error-404-isvc-a2696-predictor-548b77d64-8zrh5 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-a2696-predictor-6d48d4c789-h4v26 |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a2696-predictor-6d48d4c789-h4v26 |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-2013" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a2696-predictor-6d48d4c789-h4v26 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a2696-predictor-6d48d4c789-h4v26 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a2696-predictor-548b77d64-8zrh5 |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-a2696-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a2696-predictor-548b77d64-8zrh5 |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a2696-predictor-548b77d64-8zrh5 |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a2696-predictor-548b77d64-8zrh5 |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a2696-predictor-548b77d64-8zrh5 |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a2696-predictor-548b77d64-8zrh5 |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a2696-predictor-548b77d64-8zrh5 |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-2013" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-a2696-predictor-548b77d64-8zrh5 |
AddedInterface |
Add eth0 [10.132.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-630d7-predictor-76777f589-z5cbj |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.33:8643/healthz": dial tcp 10.134.0.33:8643: connect: connection refused | |
| (x8) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-630d7-predictor-76777f589-z5cbj |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.33:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-630d7-predictor-7bc45d9448-6gblb |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.31:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-630d7-predictor-7bc45d9448-6gblb |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.31:8643/healthz": dial tcp 10.132.0.31:8643: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-b3de6-predictor-5f84b875fc-wwp5q |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.34:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-b3de6-predictor-789679b4dd-5cfbf |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.32:8080: connect: connection refused |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b3de6 |
InferenceServiceReady |
InferenceService [success-200-isvc-b3de6] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-b3de6 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b3de6 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-b3de6 |
InferenceServiceReady |
InferenceService [error-404-isvc-b3de6] is Ready | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-b3de6 |
InferenceGraphReady |
InferenceGraph [splitter-graph-b3de6] is Ready | |
| (x6) | kserve-ci-e2e-test |
kubelet |
sequence-graph-630d7-56cf9d7d54-gs9ts |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-b3de6 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-b3de6-586d65fc7b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-b3de6-586d65fc7b |
SuccessfulCreate |
Created pod: splitter-graph-b3de6-586d65fc7b-lczd2 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-b3de6-586d65fc7b-lczd2 |
Created |
Created container: splitter-graph-b3de6 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-b3de6-586d65fc7b-lczd2 |
Started |
Started container splitter-graph-b3de6 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-b3de6-586d65fc7b-lczd2 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:9ee58bd289ecb7aa4010c311b867cae9a40a42edc53d096a1f0354150db5c48e" already present on machine | |
kserve-ci-e2e-test |
multus |
splitter-graph-b3de6-586d65fc7b-lczd2 |
AddedInterface |
Add eth0 [10.133.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a2696-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a2696-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a2696-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a2696-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b3de6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-b3de6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b3de6-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-b3de6-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b3de6-predictor-789679b4dd-5cfbf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-b3de6-586d65fc7b-lczd2 |
Killing |
Stopping container splitter-graph-b3de6 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b3de6-predictor-5f84b875fc-wwp5q |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b3de6-predictor-5f84b875fc-wwp5q |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
deployment-controller |
success-200-isvc-bb388-predictor |
ScalingReplicaSet |
Scaled up replica set success-200-isvc-bb388-predictor-7fcb976d9f from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b3de6-predictor-789679b4dd-5cfbf |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
success-200-isvc-bb388-predictor-7fcb976d9f |
SuccessfulCreate |
Created pod: success-200-isvc-bb388-predictor-7fcb976d9f-p9fmf | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bb388-predictor-7fcb976d9f-p9fmf |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bb388-predictor-7fcb976d9f-p9fmf |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bb388-predictor-7fcb976d9f-p9fmf |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bb388-predictor-7fcb976d9f-p9fmf |
Started |
Started container kube-rbac-proxy | |
kserve-ci-e2e-test |
deployment-controller |
error-404-isvc-bb388-predictor |
ScalingReplicaSet |
Scaled up replica set error-404-isvc-bb388-predictor-6d44f64874 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
success-200-isvc-bb388-predictor-7fcb976d9f-p9fmf |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-b3de6-predictor-5f84b875fc-wwp5q |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.34:8643/healthz": dial tcp 10.134.0.34:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bb388-predictor-6d44f64874-nwx7t |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "error-404-isvc-bb388-predictor-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
error-404-isvc-bb388-predictor-6d44f64874 |
SuccessfulCreate |
Created pod: error-404-isvc-bb388-predictor-6d44f64874-nwx7t | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bb388-predictor-7fcb976d9f-p9fmf |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bb388-predictor-7fcb976d9f-p9fmf |
Pulled |
Container image "quay.io/opendatahub/success-200-isvc:odh-pr-2013" already present on machine | |
kserve-ci-e2e-test |
multus |
error-404-isvc-bb388-predictor-6d44f64874-nwx7t |
AddedInterface |
Add eth0 [10.132.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bb388-predictor-6d44f64874-nwx7t |
Created |
Created container: kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bb388-predictor-6d44f64874-nwx7t |
Pulled |
Container image "quay.io/opendatahub/odh-kube-auth-proxy@sha256:dcb09fbabd8811f0956ef612a0c9ddd5236804b9bd6548a0647d2b531c9d01b3" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bb388-predictor-6d44f64874-nwx7t |
Started |
Started container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bb388-predictor-6d44f64874-nwx7t |
Created |
Created container: kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bb388-predictor-6d44f64874-nwx7t |
Pulled |
Container image "quay.io/opendatahub/error-404-isvc:odh-pr-2013" already present on machine | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-b3de6-predictor-789679b4dd-5cfbf |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.32:8643/healthz": dial tcp 10.132.0.32:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bb388-predictor-6d44f64874-nwx7t |
Started |
Started container kube-rbac-proxy | |
| (x7) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-a2696-predictor-6d48d4c789-h4v26 |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.35:8080: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-a2696-predictor-548b77d64-8zrh5 |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.33:8080: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a2696 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-a2696 |
InferenceServiceReady |
InferenceService [success-200-isvc-a2696] is Ready | |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a2696 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-a2696 |
InferenceServiceReady |
InferenceService [error-404-isvc-a2696] is Ready | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a2696-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-a2696-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-b3de6-586d65fc7b-lczd2 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
switch-graph-a2696-7758d57596-5hcnh |
FailedMount |
MountVolume.SetUp failed for volume "proxy-tls" : secret "switch-graph-a2696-serving-cert" not found | |
kserve-ci-e2e-test |
replicaset-controller |
switch-graph-a2696-7758d57596 |
SuccessfulCreate |
Created pod: switch-graph-a2696-7758d57596-5hcnh | |
kserve-ci-e2e-test |
deployment-controller |
switch-graph-a2696 |
ScalingReplicaSet |
Scaled up replica set switch-graph-a2696-7758d57596 from 0 to 1 | |
kserve-ci-e2e-test |
InferenceGraphController |
switch-graph-a2696 |
InferenceGraphReady |
InferenceGraph [switch-graph-a2696] is Ready | |
kserve-ci-e2e-test |
kubelet |
switch-graph-a2696-7758d57596-5hcnh |
Started |
Started container switch-graph-a2696 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-a2696-7758d57596-5hcnh |
Created |
Created container: switch-graph-a2696 | |
kserve-ci-e2e-test |
kubelet |
switch-graph-a2696-7758d57596-5hcnh |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:9ee58bd289ecb7aa4010c311b867cae9a40a42edc53d096a1f0354150db5c48e" already present on machine | |
kserve-ci-e2e-test |
multus |
switch-graph-a2696-7758d57596-5hcnh |
AddedInterface |
Add eth0 [10.133.0.35/23] from ovn-kubernetes | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a2696-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-a2696-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-bb388-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-bb388-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-bb388-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-bb388-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-bb388 |
InferenceServiceReady |
InferenceService [success-200-isvc-bb388] is Ready | |
| (x5) | kserve-ci-e2e-test |
v1beta1Controllers |
success-200-isvc-bb388 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
| (x6) | kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-bb388 |
VirtualServiceCRDNotFound |
Istio VirtualService CRD not present; VirtualService reconciliation skipped. If you do not use Istio, set ingress.disableIstioVirtualHost=true. |
kserve-ci-e2e-test |
v1beta1Controllers |
error-404-isvc-bb388 |
InferenceServiceReady |
InferenceService [error-404-isvc-bb388] is Ready | |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-a2696 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
switch-graph-a2696 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
splitter-graph-bb388-5b7597b4b8-nsmq4 |
Started |
Started container splitter-graph-bb388 | |
kserve-ci-e2e-test |
deployment-controller |
splitter-graph-bb388 |
ScalingReplicaSet |
Scaled up replica set splitter-graph-bb388-5b7597b4b8 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
splitter-graph-bb388-5b7597b4b8-nsmq4 |
AddedInterface |
Add eth0 [10.133.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
InferenceGraphController |
splitter-graph-bb388 |
InferenceGraphReady |
InferenceGraph [splitter-graph-bb388] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
splitter-graph-bb388-5b7597b4b8 |
SuccessfulCreate |
Created pod: splitter-graph-bb388-5b7597b4b8-nsmq4 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-bb388-5b7597b4b8-nsmq4 |
Created |
Created container: splitter-graph-bb388 | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-bb388-5b7597b4b8-nsmq4 |
Pulled |
Container image "quay.io/opendatahub/kserve-router@sha256:9ee58bd289ecb7aa4010c311b867cae9a40a42edc53d096a1f0354150db5c48e" already present on machine | |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-bb388-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x3) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
success-200-isvc-bb388-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-bb388-predictor |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x4) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
error-404-isvc-bb388-predictor |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-bb388 |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | kserve-ci-e2e-test |
horizontal-pod-autoscaler |
splitter-graph-bb388 |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bb388-predictor-7fcb976d9f-p9fmf |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bb388-predictor-6d44f64874-nwx7t |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
splitter-graph-bb388-5b7597b4b8-nsmq4 |
Killing |
Stopping container splitter-graph-bb388 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bb388-predictor-7fcb976d9f-p9fmf |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bb388-predictor-6d44f64874-nwx7t |
Killing |
Stopping container kube-rbac-proxy | |
| (x8) | kserve-ci-e2e-test |
kubelet |
success-200-isvc-bb388-predictor-7fcb976d9f-p9fmf |
Unhealthy |
Readiness probe failed: dial tcp 10.134.0.36:8080: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-bb388-predictor-7fcb976d9f-p9fmf |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.36:8643/healthz": dial tcp 10.134.0.36:8643: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-bb388-predictor-6d44f64874-nwx7t |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.34:8643/healthz": dial tcp 10.132.0.34:8643: connect: connection refused | |
| (x8) | kserve-ci-e2e-test |
kubelet |
error-404-isvc-bb388-predictor-6d44f64874-nwx7t |
Unhealthy |
Readiness probe failed: dial tcp 10.132.0.34:8080: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
splitter-graph-bb388-5b7597b4b8-nsmq4 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a2696-predictor-548b77d64-8zrh5 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
error-404-isvc-a2696-predictor-548b77d64-8zrh5 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a2696-predictor-6d48d4c789-h4v26 |
Killing |
Stopping container kserve-container | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a2696-predictor-6d48d4c789-h4v26 |
Killing |
Stopping container kube-rbac-proxy | |
kserve-ci-e2e-test |
kubelet |
switch-graph-a2696-7758d57596-5hcnh |
Killing |
Stopping container switch-graph-a2696 | |
kserve-ci-e2e-test |
kubelet |
success-200-isvc-a2696-predictor-6d48d4c789-h4v26 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.35:8643/healthz": dial tcp 10.134.0.35:8643: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
kubelet |
switch-graph-a2696-7758d57596-5hcnh |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 |