| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
scheduler-custom-template-test-kserve-router-scheduler-5676f2xn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-5676f2xn to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-5c5cfcf776-hcvbc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-hcvbc to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-configmap-ref-test-kserve-744bf59fbd-jjwd6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-jjwd6 to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79lbjf7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79lbjf7 to ip-10-0-132-101.ec2.internal | ||
kuadrant-system |
authorino-7c77957575-kl894 |
Scheduled |
Successfully assigned kuadrant-system/authorino-7c77957575-kl894 to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-799f46c59b-m74kj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-m74kj to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-799f46c59b-gb7nq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-gb7nq to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4t4h8n |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4t4h8n to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-59675c7fb47xmlr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-59675c7fb47xmlr to ip-10-0-132-101.ec2.internal | ||
kuadrant-system |
limitador-operator-controller-manager-6f9f468797-4wdtd |
Scheduled |
Successfully assigned kuadrant-system/limitador-operator-controller-manager-6f9f468797-4wdtd to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5x74ql |
Scheduled |
Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5x74ql to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
tls-verification-test-kserve-router-scheduler-54fcb44dcb-ndbt4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-54fcb44dcb-ndbt4 to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-799f46c59b-5qb88 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-5qb88 to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
tls-verification-test-kserve-66dc875567-8hbzr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/tls-verification-test-kserve-66dc875567-8hbzr to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmlb4m |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmlb4m to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddmqw6d |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddmqw6d to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-54c47cdfc7-tzh7s |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-tzh7s to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-hrrbz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-hrrbz to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4s4vv7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4s4vv7 to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879rt4nb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879rt4nb to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schecfc4v |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schecfc4v to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-64d79dc96c-48v84 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-64d79dc96c-48v84 to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-54c47cdfc7-dlzm4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-dlzm4 to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheqsdc8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheqsdc8 to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-sche6dkc9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-sche6dkc9 to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche7vr9r |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche7vr9r to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-54c47cdfc7-6cn2l |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-6cn2l to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche8zhmt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche8zhmt to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-799f46c59b-qt5dn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-qt5dn to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche5n224 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche5n224 to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-router-scheduler-76bbb8774d-f4vbf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-76bbb8774d-f4vbf to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scherhlm7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scherhlm7 to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheqp7r4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheqp7r4 to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schefbf7j |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schefbf7j to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schejtb4k |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schejtb4k to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-2-openshift-default-54c789bdc6-qlsdv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-qlsdv to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-2-openshift-default-684dc9b4b9-bt7g2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-bt7g2 to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
auth-enabled-test-kserve-6cb4578865-5g826 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-enabled-test-kserve-6cb4578865-5g826 to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherh7zf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherh7zf to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche8glrw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche8glrw to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche6gbft |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche6gbft to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-c76db9948-pzbnj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-c76db9948-pzbnj to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schekjmqd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schekjmqd to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
lora-multiple-adapters-test-kserve-764b5b74d7-v48lv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-764b5b74d7-v48lv to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-router-scheduler-76bbb8774d-889t7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-76bbb8774d-889t7 to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-78ddd7447-8kcjs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-78ddd7447-8kcjs to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
auth-disabled-test-kserve-5596879d7-gch2p |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-disabled-test-kserve-5596879d7-gch2p to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
lora-single-adapter-test-kserve-6f56f99c66-k5b57 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/lora-single-adapter-test-kserve-6f56f99c66-k5b57 to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-5ddf85c88c-s4577 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5ddf85c88c-s4577 to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4dtv7h |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4dtv7h to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
auth-enabled-test-kserve-router-scheduler-579c77b84f-6p4wk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-579c77b84f-6p4wk to ip-10-0-132-101.ec2.internal | ||
kuadrant-system |
limitador-limitador-ff68ff5cb-tffrc |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-ff68ff5cb-tffrc to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-f99ccccc7-wlb6c |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-f99ccccc7-wlb6c to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dk7qh9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dk7qh9 to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
e2e-pvc-model-download-cbftb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/e2e-pvc-model-download-cbftb to ip-10-0-141-229.ec2.internal | ||
kuadrant-system |
authorino-8df697c9f-rs5dk |
Scheduled |
Successfully assigned kuadrant-system/authorino-8df697c9f-rs5dk to ip-10-0-132-101.ec2.internal | ||
kuadrant-system |
limitador-limitador-69574b596d-z5gcf |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-69574b596d-z5gcf to ip-10-0-137-109.ec2.internal | ||
kuadrant-system |
kuadrant-operator-controller-manager-bb7ddb7d7-f5bhj |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-f5bhj to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-6dgs5wq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-6dgs5wq to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
prestop-hook-test-kserve-router-scheduler-66cbfd5b6d-g9qrx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-66cbfd5b6d-g9qrx to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
prestop-hook-test-kserve-7f76488d87-7g5z8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-7f76488d87-7g5z8 to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-78ddd7447-7jzbj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-78ddd7447-7jzbj to ip-10-0-132-101.ec2.internal | ||
kuadrant-system |
authorino-b6c89bb85-47dnz |
Scheduled |
Successfully assigned kuadrant-system/authorino-b6c89bb85-47dnz to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-threshold-migration-test-kserve-router-sched4tk44 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-sched4tk44 to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5c6bfv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5c6bfv to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-9k996 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-9k996 to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-test-kserve-router-scheduler-7c89bfcfqz6fc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-7c89bfcfqz6fc to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
prestop-hook-test-kserve-7f76488d87-zl2xg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-7f76488d87-zl2xg to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-pd-migration-test-kserve-router-scheduler-59hpg5t |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-59hpg5t to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-cf8ht |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-cf8ht to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-pd-migration-test-kserve-5c87756974-tnfnw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-tnfnw to ip-10-0-141-229.ec2.internal | ||
kuadrant-system |
authorino-operator-6d85f6564-shqc4 |
Scheduled |
Successfully assigned kuadrant-system/authorino-operator-6d85f6564-shqc4 to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-inline-config-test-kserve-router-scheduler-d9ddfb42pr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddfb42pr to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-inline-config-test-kserve-7c6c58cc96-94kmg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-94kmg to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dhjphp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dhjphp to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d5wm7r |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d5wm7r to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
auth-disabled-test-kserve-router-scheduler-58d5d5d4b6-ghg8n |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-disabled-test-kserve-router-scheduler-58d5d5d4b6-ghg8n to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bp4xnl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bp4xnl to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
auth-invalid-token-test-kserve-666bbbb8df-6gg4b |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-invalid-token-test-kserve-666bbbb8df-6gg4b to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-custom-template-test-kserve-5bc7bd6864-6w9zw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-6w9zw to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-test-kserve-66c886969f-7v7hs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-66c886969f-7v7hs to ip-10-0-132-101.ec2.internal | ||
openshift-ingress |
istiod-openshift-gateway-94bb8fbfd-ngnzl |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngnzl to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-router-scheduler-c7d44ckr2j |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-c7d44ckr2j to ip-10-0-141-229.ec2.internal | ||
openshift-ingress |
openshift-ai-inference-openshift-default-866675cbb8-c9ndl |
Scheduled |
Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-866675cbb8-c9ndl to ip-10-0-137-109.ec2.internal | ||
kuadrant-system |
kuadrant-console-plugin-85fd4b8b9d-g9hbm |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-g9hbm to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-5fdcf4bcfd-jcdfk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-5fdcf4bcfd-jcdfk to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-prefill-69db96b599-2qzbg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-69db96b599-2qzbg to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-4wbfv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-4wbfv to ip-10-0-141-229.ec2.internal | ||
openshift-ingress |
router-default-996f5cb75-q2sjq |
Scheduled |
Successfully assigned openshift-ingress/router-default-996f5cb75-q2sjq to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
auth-invalid-token-test-kserve-router-scheduler-c9c75d5f5-9gfqz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-invalid-token-test-kserve-router-scheduler-c9c75d5f5-9gfqz to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-prefill-84bd675bc9-kzc4r |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-84bd675bc9-kzc4r to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-5ddf85c88c-xxw4z |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5ddf85c88c-xxw4z to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-ffb76d85c-n2jtf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-ffb76d85c-n2jtf to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-6f67d5cf8b-522cc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-6f67d5cf8b-522cc to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-configmap-ref-test-kserve-router-scheduler-68f87jplvb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87jplvb to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-router-scheduler-b78dc9c7fwr2tx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-b78dc9c7fwr2tx to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-test-kserve-cd8b578dc-h8cml |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-cd8b578dc-h8cml to ip-10-0-132-101.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-72gxs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-72gxs to ip-10-0-132-101.ec2.internal | ||
kuadrant-system |
dns-operator-controller-manager-65b49595d7-2qhqj |
Scheduled |
Successfully assigned kuadrant-system/dns-operator-controller-manager-65b49595d7-2qhqj to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-test-kserve-router-scheduler-8579f4fd54-skhz2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-8579f4fd54-skhz2 to ip-10-0-141-229.ec2.internal | ||
kserve-ci-e2e-test |
rolling-upgrade-test-kserve-54bc76f55b-vqrcx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-vqrcx to ip-10-0-137-109.ec2.internal | ||
kserve-ci-e2e-test |
rolling-upgrade-test-kserve-859df57bcb-q5g2s |
Scheduled |
Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-q5g2s to ip-10-0-137-109.ec2.internal | ||
openshift-ingress |
deployment-controller |
router-default |
ScalingReplicaSet |
Scaled up replica set router-default-996f5cb75 from 0 to 1 | |
| (x9) | openshift-ingress |
replicaset-controller |
router-default-996f5cb75 |
FailedCreate |
Error creating: pods "router-default-996f5cb75-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
openshift-ingress |
service-controller |
router-default |
UnAvailableLoadBalancer |
There are no available nodes for LoadBalancer | |
openshift-ingress |
service-controller |
router-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
service-controller |
router-default |
EnsuredLoadBalancer |
Ensured load balancer | |
| (x17) | openshift-ingress |
replicaset-controller |
router-default-996f5cb75 |
FailedCreate |
Error creating: pods "router-default-996f5cb75-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
| (x3) | openshift-ingress |
service-controller |
router-default |
UpdatedLoadBalancer |
Updated load balancer with new hosts |
openshift-ingress |
replicaset-controller |
router-default-996f5cb75 |
SuccessfulCreate |
Created pod: router-default-996f5cb75-q2sjq | |
| (x5) | openshift-ingress |
kubelet |
router-default-996f5cb75-q2sjq |
FailedMount |
MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found |
| (x6) | openshift-ingress |
kubelet |
router-default-996f5cb75-q2sjq |
FailedMount |
MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt |
openshift-ingress |
kubelet |
router-default-996f5cb75-q2sjq |
Pulled |
Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d6df0cb6282bc5ba571a8de322fe598afdf22e817f5a7dc92db3274dbdb9a1" already present on machine | |
openshift-ingress |
kubelet |
router-default-996f5cb75-q2sjq |
Started |
Started container router | |
openshift-ingress |
kubelet |
router-default-996f5cb75-q2sjq |
Created |
Created container: router | |
openshift-ingress |
multus |
router-default-996f5cb75-q2sjq |
AddedInterface |
Add eth0 [10.132.0.16/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-94bb8fbfd from 0 to 1 | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-94bb8fbfd |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-94bb8fbfd-ngnzl | |
openshift-ingress |
multus |
istiod-openshift-gateway-94bb8fbfd-ngnzl |
AddedInterface |
Add eth0 [10.133.0.26/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-ngnzl |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-ngnzl |
Started |
Started container discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-ngnzl |
Created |
Created container: discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-ngnzl |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" in 2.791s (2.791s including waiting). Image size: 181034515 bytes. | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-ngnzl |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-ngnzl |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
gateway_labeler_controller |
openshift-ai-inference |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway openshift-ai-inference | |
openshift-ingress |
deployment-controller |
openshift-ai-inference-openshift-default |
ScalingReplicaSet |
Scaled up replica set openshift-ai-inference-openshift-default-866675cbb8 from 0 to 1 | |
openshift-ingress |
multus |
openshift-ai-inference-openshift-default-866675cbb8-c9ndl |
AddedInterface |
Add eth0 [10.133.0.27/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-c9ndl |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" | |
openshift-ingress |
replicaset-controller |
openshift-ai-inference-openshift-default-866675cbb8 |
SuccessfulCreate |
Created pod: openshift-ai-inference-openshift-default-866675cbb8-c9ndl | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-c9ndl |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 4.644s (4.644s including waiting). Image size: 181251556 bytes. | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
replicaset-controller |
limitador-operator-controller-manager-6f9f468797 |
SuccessfulCreate |
Created pod: limitador-operator-controller-manager-6f9f468797-4wdtd | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
InstallWaiting |
installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
deployment-controller |
limitador-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set limitador-operator-controller-manager-6f9f468797 from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-4wdtd |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:183bad2a6f5872aea38f54ad507f7e005d6facb02b18769e0407c82799f96a3e" | |
kuadrant-system |
multus |
limitador-operator-controller-manager-6f9f468797-4wdtd |
AddedInterface |
Add eth0 [10.133.0.32/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-4wdtd |
Started |
Started container manager | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-4wdtd |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-4wdtd |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:183bad2a6f5872aea38f54ad507f7e005d6facb02b18769e0407c82799f96a3e" in 2.246s (2.246s including waiting). Image size: 178538972 bytes. | |
kuadrant-system |
limitador-operator-controller-manager-6f9f468797-4wdtd_0ecf30fd-9f7e-4e53-b656-1ae12a634b5b |
3745a16e.kuadrant.io |
LeaderElection |
limitador-operator-controller-manager-6f9f468797-4wdtd_0ecf30fd-9f7e-4e53-b656-1ae12a634b5b became leader | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
InstallWaiting |
installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
deployment-controller |
kuadrant-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set kuadrant-operator-controller-manager-bb7ddb7d7 from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
replicaset-controller |
kuadrant-operator-controller-manager-bb7ddb7d7 |
SuccessfulCreate |
Created pod: kuadrant-operator-controller-manager-bb7ddb7d7-f5bhj | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-f5bhj |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:0b77e4a874b620095a0300877aea53e78559a601ce62b194537ed21c2743bbf3" | |
kuadrant-system |
multus |
kuadrant-operator-controller-manager-bb7ddb7d7-f5bhj |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
kuadrant-system |
replicaset-controller |
dns-operator-controller-manager-65b49595d7 |
SuccessfulCreate |
Created pod: dns-operator-controller-manager-65b49595d7-2qhqj | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
deployment-controller |
dns-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set dns-operator-controller-manager-65b49595d7 from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-2qhqj |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ba46f54446ecd3ed1a3d877dcbb7359ff8f2d918827f3411a5cb0781915a65d5" | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
InstallWaiting |
installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
multus |
dns-operator-controller-manager-65b49595d7-2qhqj |
AddedInterface |
Add eth0 [10.132.0.29/23] from ovn-kubernetes | |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
InstallWaiting |
installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability. | |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kuadrant-system |
replicaset-controller |
authorino-operator-6d85f6564 |
SuccessfulCreate |
Created pod: authorino-operator-6d85f6564-shqc4 | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
deployment-controller |
authorino-operator |
ScalingReplicaSet |
Scaled up replica set authorino-operator-6d85f6564 from 0 to 1 | |
kuadrant-system |
dns-operator-controller-manager-65b49595d7-2qhqj_0b947367-b04b-4e09-819a-6b5904d0ee5b |
a3f98d6c.kuadrant.io |
LeaderElection |
dns-operator-controller-manager-65b49595d7-2qhqj_0b947367-b04b-4e09-819a-6b5904d0ee5b became leader | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-2qhqj |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ba46f54446ecd3ed1a3d877dcbb7359ff8f2d918827f3411a5cb0781915a65d5" in 3.036s (3.036s including waiting). Image size: 190472853 bytes. | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-2qhqj |
Started |
Started container manager | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-shqc4 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:b2cc2c0f0729dad98f970830816e300c0b961ba42491f362295512d886384687" | |
kuadrant-system |
multus |
authorino-operator-6d85f6564-shqc4 |
AddedInterface |
Add eth0 [10.132.0.30/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-2qhqj |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-f5bhj |
Started |
Started container manager | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-f5bhj |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-f5bhj |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:0b77e4a874b620095a0300877aea53e78559a601ce62b194537ed21c2743bbf3" in 7.482s (7.482s including waiting). Image size: 425661757 bytes. | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-shqc4 |
Started |
Started container manager | |
kuadrant-system |
kuadrant-operator-controller-manager-bb7ddb7d7-f5bhj_a56769fa-c47e-4370-a2d2-9cb62ea03556 |
f139389e.kuadrant.io |
LeaderElection |
kuadrant-operator-controller-manager-bb7ddb7d7-f5bhj_a56769fa-c47e-4370-a2d2-9cb62ea03556 became leader | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-shqc4 |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-shqc4 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:b2cc2c0f0729dad98f970830816e300c0b961ba42491f362295512d886384687" in 3.312s (3.312s including waiting). Image size: 168639631 bytes. | |
kuadrant-system |
authorino-operator-6d85f6564-shqc4_31aef271-cda2-43da-903d-6d76195a8732 |
aac3a15d.authorino.kuadrant.io |
LeaderElection |
authorino-operator-6d85f6564-shqc4_31aef271-cda2-43da-903d-6d76195a8732 became leader | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
deployment-controller |
kuadrant-console-plugin |
ScalingReplicaSet |
Scaled up replica set kuadrant-console-plugin-85fd4b8b9d from 0 to 1 | |
kuadrant-system |
replicaset-controller |
kuadrant-console-plugin-85fd4b8b9d |
SuccessfulCreate |
Created pod: kuadrant-console-plugin-85fd4b8b9d-g9hbm | |
kuadrant-system |
multus |
kuadrant-console-plugin-85fd4b8b9d-g9hbm |
AddedInterface |
Add eth0 [10.134.0.26/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-g9hbm |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:6e69f41d3d70b0afa7691a5d2400065d3bcdec2ea82830cf2992b8e69ba06e2a" | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-g9hbm |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:6e69f41d3d70b0afa7691a5d2400065d3bcdec2ea82830cf2992b8e69ba06e2a" in 6.219s (6.219s including waiting). Image size: 342502139 bytes. | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-g9hbm |
Created |
Created container: kuadrant-console-plugin | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-g9hbm |
Started |
Started container kuadrant-console-plugin | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
multus |
limitador-limitador-ff68ff5cb-tffrc |
AddedInterface |
Add eth0 [10.132.0.31/23] from ovn-kubernetes | |
kuadrant-system |
replicaset-controller |
limitador-limitador-69574b596d |
SuccessfulCreate |
Created pod: limitador-limitador-69574b596d-z5gcf | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-69574b596d from 0 to 1 | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-ff68ff5cb from 0 to 1 | |
kuadrant-system |
replicaset-controller |
limitador-limitador-ff68ff5cb |
SuccessfulCreate |
Created pod: limitador-limitador-ff68ff5cb-tffrc | |
kuadrant-system |
multus |
limitador-limitador-69574b596d-z5gcf |
AddedInterface |
Add eth0 [10.133.0.34/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-8df697c9f from 0 to 1 | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-47dnz |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" | |
kuadrant-system |
multus |
authorino-b6c89bb85-47dnz |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-z5gcf |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" | |
kuadrant-system |
replicaset-controller |
authorino-b6c89bb85 |
SuccessfulCreate |
Created pod: authorino-b6c89bb85-47dnz | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-tffrc |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-b6c89bb85 from 0 to 1 | |
kuadrant-system |
replicaset-controller |
authorino-8df697c9f |
SuccessfulCreate |
Created pod: authorino-8df697c9f-rs5dk | |
kuadrant-system |
multus |
authorino-8df697c9f-rs5dk |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-8df697c9f-rs5dk |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" | |
kuadrant-system |
replicaset-controller |
authorino-b6c89bb85 |
SuccessfulDelete |
Deleted pod: authorino-b6c89bb85-47dnz | |
kuadrant-system |
kubelet |
authorino-8df697c9f-rs5dk |
Started |
Started container authorino | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-b6c89bb85 from 1 to 0 | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-47dnz |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-47dnz |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" in 2.821s (2.821s including waiting). Image size: 202706732 bytes. | |
kuadrant-system |
kubelet |
authorino-8df697c9f-rs5dk |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" in 2.5s (2.5s including waiting). Image size: 202706732 bytes. | |
kuadrant-system |
kubelet |
authorino-8df697c9f-rs5dk |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-47dnz |
Started |
Started container authorino | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-tffrc |
Started |
Started container limitador | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-z5gcf |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" in 3.864s (3.864s including waiting). Image size: 250499765 bytes. | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-z5gcf |
Started |
Started container limitador | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-tffrc |
Created |
Created container: limitador | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-tffrc |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" in 4.699s (4.699s including waiting). Image size: 250499765 bytes. | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-z5gcf |
Created |
Created container: limitador | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-47dnz |
Killing |
Stopping container authorino | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled down replica set limitador-limitador-ff68ff5cb from 1 to 0 | |
kuadrant-system |
replicaset-controller |
limitador-limitador-ff68ff5cb |
SuccessfulDelete |
Deleted pod: limitador-limitador-ff68ff5cb-tffrc | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-tffrc |
Killing |
Stopping container limitador | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-7c77957575 from 0 to 1 | |
kuadrant-system |
multus |
authorino-7c77957575-kl894 |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-7c77957575-kl894 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" | |
kuadrant-system |
replicaset-controller |
authorino-7c77957575 |
SuccessfulCreate |
Created pod: authorino-7c77957575-kl894 | |
kuadrant-system |
kubelet |
authorino-7c77957575-kl894 |
Started |
Started container authorino | |
kuadrant-system |
kubelet |
authorino-7c77957575-kl894 |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-7c77957575-kl894 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" in 638ms (638ms including waiting). Image size: 202706732 bytes. | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-8df697c9f from 1 to 0 | |
kuadrant-system |
kubelet |
authorino-8df697c9f-rs5dk |
Killing |
Stopping container authorino | |
kuadrant-system |
replicaset-controller |
authorino-8df697c9f |
SuccessfulDelete |
Deleted pod: authorino-8df697c9f-rs5dk | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-799f46c59b-5qb88 | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-54c47cdfc7-dlzm4 | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-dlzm4 |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-5qb88 |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-799f46c59b-5qb88 |
AddedInterface |
Add eth0 [10.133.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-5qb88 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-5qb88 |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-54c47cdfc7-dlzm4 |
AddedInterface |
Add eth0 [10.132.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-dlzm4 |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 2.856s (2.856s including waiting). Image size: 181251556 bytes. | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-dlzm4 |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-dlzm4 |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-5qb88 |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-799f46c59b-5qb88 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.Secret kserve-ci-e2e-test/gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-route | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5x74ql |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
kserve-ci-e2e-test |
multus |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5x74ql |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5 |
SuccessfulCreate |
Created pod: gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5x74ql | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc | |
kserve-ci-e2e-test |
deployment-controller |
gw-section-name-router-with-gat-2f0a622e-kserve |
ScalingReplicaSet |
Scaled up replica set gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5x74ql |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5x74ql |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5x74ql |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 985ms (985ms including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-799f46c59b-m74kj |
AddedInterface |
Add eth0 [10.133.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-799f46c59b-m74kj | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-54c47cdfc7-dlzm4 | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-dlzm4 |
Killing |
Stopping container istio-proxy | |
| (x14) | kserve-ci-e2e-test |
OpenDataHubModelController |
precise-prefix-cache-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy precise-prefix-cache-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "precise-prefix-cache-test-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-dlzm4 |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.35:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-5ddf85c88c-xxw4z |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465ff |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-5ddf85c88c |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-5ddf85c88c-s4577 | |
kserve-ci-e2e-test |
deployment-controller |
precise-prefix-cache-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set precise-prefix-cache-test-kserve-router-scheduler-5f5d4465ff from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
precise-prefix-cache-test-kserve |
ScalingReplicaSet |
Scaled up replica set precise-prefix-cache-test-kserve-5ddf85c88c from 0 to 2 | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-5ddf85c88c |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-5ddf85c88c-xxw4z | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/precise-prefix-cache-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Role kserve-ci-e2e-test/precise-prefix-cache-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/precise-prefix-cache-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-epp-service | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-5ddf85c88c-xxw4z |
AddedInterface |
Add eth0 [10.132.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-5ddf85c88c-s4577 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-5ddf85c88c-s4577 |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-5ddf85c88c-xxw4z |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg |
AddedInterface |
Add eth0 [10.132.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-5ddf85c88c-xxw4z |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" in 1.428s (1.428s including waiting). Image size: 75073927 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1" | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-5ddf85c88c-s4577 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5x74ql |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-5ddf85c88c-s4577 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" in 3.519s (3.519s including waiting). Image size: 301879731 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-5ddf85c88c-s4577 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-5ddf85c88c-xxw4z |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-m74kj |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-5ddf85c88c-xxw4z |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.159s (1.159s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-5ddf85c88c-xxw4z |
Created |
Created container: main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-m74kj |
Created |
Created container: istio-proxy |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-5ddf85c88c-xxw4z |
Started |
Started container main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-m74kj |
Started |
Started container istio-proxy |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-5ddf85c88c-s4577 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-5ddf85c88c-s4577 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-5ddf85c88c-s4577 |
Started |
Started container main | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-c9ndl |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.27:15021/healthz/ready": read tcp 10.133.0.2:37894->10.133.0.27:15021: read: connection reset by peer | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-c9ndl |
ProbeError |
Readiness probe error: Get "http://10.133.0.27:15021/healthz/ready": read tcp 10.133.0.2:37894->10.133.0.27:15021: read: connection reset by peer body: | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc | |
kserve-ci-e2e-test |
deployment-controller |
gw-section-name-router-with-gat-f1d92d0f-kserve |
ScalingReplicaSet |
Scaled up replica set gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.Secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b |
SuccessfulCreate |
Created pod: gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bp4xnl | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-route | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bp4xnl |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
kserve-ci-e2e-test |
multus |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bp4xnl |
AddedInterface |
Add eth0 [10.133.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bp4xnl |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bp4xnl |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bp4xnl |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.263s (1.263s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-54c47cdfc7-6cn2l |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-6cn2l |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-54c47cdfc7-6cn2l | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-6cn2l |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 5.359s (5.359s including waiting). Image size: 181251556 bytes. | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-m74kj |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1" in 31.24s (31.24s including waiting). Image size: 2989890188 bytes. | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-799f46c59b-m74kj | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
| (x2) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg |
Created |
Created container: main |
| (x2) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg |
Started |
Started container main |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/precise-prefix-cache-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg |
Unhealthy |
Startup probe failed: Get "http://10.132.0.37:8082/healthz": dial tcp 10.132.0.37:8082: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bp4xnl |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/auth-enabled-test-epp-sa | |
kserve-ci-e2e-test |
replicaset-controller |
auth-enabled-test-kserve-6cb4578865 |
SuccessfulCreate |
Created pod: auth-enabled-test-kserve-6cb4578865-5g826 | |
kserve-ci-e2e-test |
deployment-controller |
auth-enabled-test-kserve |
ScalingReplicaSet |
Scaled up replica set auth-enabled-test-kserve-6cb4578865 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Secret kserve-ci-e2e-test/auth-enabled-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-enabled-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-enabled-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-enabled-test-epp-auth-rb | |
kserve-ci-e2e-test |
multus |
auth-enabled-test-kserve-router-scheduler-579c77b84f-6p4wk |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-579c77b84f-6p4wk |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-579c77b84f-6p4wk |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-enabled-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-579c77b84f-6p4wk |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/auth-enabled-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Role kserve-ci-e2e-test/auth-enabled-test-epp-role | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-6cb4578865-5g826 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-6cb4578865-5g826 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-6cb4578865-5g826 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
auth-enabled-test-kserve-router-scheduler-579c77b84f |
SuccessfulCreate |
Created pod: auth-enabled-test-kserve-router-scheduler-579c77b84f-6p4wk | |
kserve-ci-e2e-test |
deployment-controller |
auth-enabled-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set auth-enabled-test-kserve-router-scheduler-579c77b84f from 0 to 1 | |
kserve-ci-e2e-test |
multus |
auth-enabled-test-kserve-6cb4578865-5g826 |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-579c77b84f-6p4wk |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-579c77b84f-6p4wk |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-579c77b84f-6p4wk |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-579c77b84f-6p4wk |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" in 1.376s (1.376s including waiting). Image size: 75073927 bytes. | |
| (x2) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg |
Unhealthy |
Liveness probe failed: timeout: failed to connect service "10.132.0.37:9003" within 1s: context deadline exceeded |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-6cb4578865-5g826 |
Pulling |
Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/auth-enabled-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/auth-enabled-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-enabled-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
LLMInferenceServiceReady |
LLMInferenceService [precise-prefix-cache-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5f5d4465g6nfg |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-5ddf85c88c-s4577 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-5ddf85c88c-xxw4z |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-5ddf85c88c-xxw4z |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.36:8000/health": dial tcp 10.132.0.36:8000: connect: connection refused | |
| (x5) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-5ddf85c88c-s4577 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.32:8000/health": dial tcp 10.134.0.32:8000: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-6cb4578865-5g826 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-5ddf85c88c-s4577 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.32:8000/health": context deadline exceeded | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-6cb4578865-5g826 |
Pulled |
Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" in 41.592s (41.592s including waiting). Image size: 3531177328 bytes. | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-6cb4578865-5g826 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879rt4nb |
Started |
Started container main | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879 |
SuccessfulCreate |
Created pod: llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879rt4nb | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler-5dd88bfbb7 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-router-managed-test-llm-e45d1f79 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-e45d1f79-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-e45d1f79-kserve-route" not found |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler-5dd88bfbb7 |
SuccessfulCreate |
Created pod: llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scherhlm7 | |
kserve-ci-e2e-test |
multus |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scherhlm7 |
AddedInterface |
Add eth0 [10.132.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879rt4nb |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-router-managed-test-llm-e45d1f79-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scherhlm7 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scherhlm7 |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scherhlm7 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-sa | |
kserve-ci-e2e-test |
multus |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879rt4nb |
AddedInterface |
Add eth0 [10.133.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879rt4nb |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testef4d2875be14b30dc1561ed84d0d4bde-llmisvc-rout | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-router-managed-test-llm-e45d1f79] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scherhlm7 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879rt4nb |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scherhlm7 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testef4d2875be14b30dc1561ed84d0d4bde-llmisvc-rout | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879rt4nb |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.38:8000/health": dial tcp 10.133.0.38:8000: connect: connection refused | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-router-managed-test-llm-5b1e8f15-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-service | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler-749449dbc8 |
SuccessfulCreate |
Created pod: llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schekjmqd | |
kserve-ci-e2e-test |
deployment-controller |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler-749449dbc8 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schekjmqd |
AddedInterface |
Add eth0 [10.132.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schekjmqd |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schekjmqd |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schekjmqd |
Started |
Started container main | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4 |
SuccessfulCreate |
Created pod: llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4s4vv7 | |
kserve-ci-e2e-test |
multus |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4s4vv7 |
AddedInterface |
Add eth0 [10.133.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4s4vv7 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4s4vv7 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4s4vv7 |
Started |
Started container main | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-router-managed-test-llm-5b1e8f15 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-5b1e8f15-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-5b1e8f15-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test7f54e84970003a6e7372bdbcb574f7ed-llmisvc-rout | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-shadow-svc |
| (x11) | kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-6cb4578865-5g826 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.34:8000/health": dial tcp 10.134.0.34:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-router-managed-test-llm-5b1e8f15] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
LLMInferenceServiceReady |
LLMInferenceService [auth-enabled-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-579c77b84f-6p4wk |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-6cb4578865-5g826 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-enabled-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-579c77b84f-6p4wk |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-6cb4578865-5g826 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.34:8000/health": dial tcp 10.134.0.34:8000: connect: connection refused | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddmqw6d |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd |
SuccessfulCreate |
Created pod: llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddmqw6d | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testb7025ca4d8a6f8f5b2fd08b5581d2678-llmisvc-mode | |
kserve-ci-e2e-test |
multus |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddmqw6d |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler-6d86bd4d9d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler-6d86bd4d9d |
SuccessfulCreate |
Created pod: llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherh7zf | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddmqw6d |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddmqw6d |
Started |
Started container main | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherh7zf |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherh7zf |
AddedInterface |
Add eth0 [10.132.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherh7zf |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherh7zf |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-invalid-token-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/auth-invalid-token-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Role kserve-ci-e2e-test/auth-invalid-token-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-invalid-token-test-epp-auth-rb | |
kserve-ci-e2e-test |
deployment-controller |
auth-invalid-token-test-kserve |
ScalingReplicaSet |
Scaled up replica set auth-invalid-token-test-kserve-666bbbb8df from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/auth-invalid-token-test-epp-sa | |
kserve-ci-e2e-test |
deployment-controller |
auth-invalid-token-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set auth-invalid-token-test-kserve-router-scheduler-c9c75d5f5 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
auth-invalid-token-test-kserve-router-scheduler-c9c75d5f5 |
SuccessfulCreate |
Created pod: auth-invalid-token-test-kserve-router-scheduler-c9c75d5f5-9gfqz | |
kserve-ci-e2e-test |
replicaset-controller |
auth-invalid-token-test-kserve-666bbbb8df |
SuccessfulCreate |
Created pod: auth-invalid-token-test-kserve-666bbbb8df-6gg4b | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-invalid-token-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-invalid-token-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Secret kserve-ci-e2e-test/auth-invalid-token-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-invalid-token-test-kserve | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-666bbbb8df-6gg4b |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-c9c75d5f5-9gfqz |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-c9c75d5f5-9gfqz |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-c9c75d5f5-9gfqz |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
multus |
auth-invalid-token-test-kserve-router-scheduler-c9c75d5f5-9gfqz |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-666bbbb8df-6gg4b |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-666bbbb8df-6gg4b |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
multus |
auth-invalid-token-test-kserve-666bbbb8df-6gg4b |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-c9c75d5f5-9gfqz |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-c9c75d5f5-9gfqz |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-c9c75d5f5-9gfqz |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-666bbbb8df-6gg4b |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-666bbbb8df-6gg4b |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-666bbbb8df-6gg4b |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/auth-invalid-token-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/auth-invalid-token-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-invalid-token-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-a50492e9] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherh7zf |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherh7zf |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testb7025ca4d8a6f8f5b2fd08b5581d2678-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddmqw6d |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schekjmqd |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schekjmqd |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test7f54e84970003a6e7372bdbcb574f7ed-llmisvc-rout | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4s4vv7 |
Killing |
Stopping container main | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-router-managed-test-llm-4b931143 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-4b931143-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-4b931143-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche6gbft |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-hrrbz |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche6gbft |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche6gbft |
AddedInterface |
Add eth0 [10.132.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-role | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-hrrbz |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-hrrbz |
AddedInterface |
Add eth0 [10.133.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler-68cc9685d6 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-rb | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler-68cc9685d6 |
SuccessfulCreate |
Created pod: llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche6gbft | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-hrrbz |
Started |
Started container main | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56 |
SuccessfulCreate |
Created pod: llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-hrrbz | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-service | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche6gbft |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test8ac8e3d2264ccb939eb021b0b835847c-llmisvc-rout | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-router-managed-test-llm-4b931143-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-route | |
| (x11) | kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-666bbbb8df-6gg4b |
Unhealthy |
Startup probe failed: Get "https://10.134.0.37:8000/health": dial tcp 10.134.0.37:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
LLMInferenceServiceReady |
LLMInferenceService [auth-invalid-token-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-666bbbb8df-6gg4b |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-c9c75d5f5-9gfqz |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-c9c75d5f5-9gfqz |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-invalid-token-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-router-managed-test-llm-4b931143] is Ready | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route" not found |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f |
SuccessfulCreate |
Created pod: llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmlb4m | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test76d7f532acb694e4a7bcef75d32cd8a1-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler-6fcb489785 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler-6fcb489785 |
SuccessfulCreate |
Created pod: llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheqsdc8 | |
kserve-ci-e2e-test |
multus |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmlb4m |
AddedInterface |
Add eth0 [10.132.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmlb4m |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmlb4m |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-service | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmlb4m |
Started |
Started container main | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs | |
kserve-ci-e2e-test |
multus |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheqsdc8 |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheqsdc8 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheqsdc8 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheqsdc8 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-666bbbb8df-6gg4b |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.37:8000/health": dial tcp 10.134.0.37:8000: connect: connection refused | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/auth-disabled-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Role kserve-ci-e2e-test/auth-disabled-test-epp-role | |
kserve-ci-e2e-test |
multus |
auth-disabled-test-kserve-5596879d7-gch2p |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-5596879d7-gch2p |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-disabled-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-disabled-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-disabled-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/auth-disabled-test-epp-sa | |
kserve-ci-e2e-test |
deployment-controller |
auth-disabled-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set auth-disabled-test-kserve-router-scheduler-58d5d5d4b6 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
auth-disabled-test-kserve |
ScalingReplicaSet |
Scaled up replica set auth-disabled-test-kserve-5596879d7 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-disabled-test-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
auth-disabled-test-kserve-router-scheduler-58d5d5d4b6 |
SuccessfulCreate |
Created pod: auth-disabled-test-kserve-router-scheduler-58d5d5d4b6-ghg8n | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
auth-disabled-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy auth-disabled-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/auth-disabled-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "auth-disabled-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-disabled-test-kserve | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-5596879d7-gch2p |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-5596879d7-gch2p |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
auth-disabled-test-kserve-5596879d7 |
SuccessfulCreate |
Created pod: auth-disabled-test-kserve-5596879d7-gch2p | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Secret kserve-ci-e2e-test/auth-disabled-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
multus |
auth-disabled-test-kserve-router-scheduler-58d5d5d4b6-ghg8n |
AddedInterface |
Add eth0 [10.132.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-58d5d5d4b6-ghg8n |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-58d5d5d4b6-ghg8n |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-58d5d5d4b6-ghg8n |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-58d5d5d4b6-ghg8n |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-58d5d5d4b6-ghg8n |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-58d5d5d4b6-ghg8n |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-5596879d7-gch2p |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-5596879d7-gch2p |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-5596879d7-gch2p |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/auth-disabled-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/auth-disabled-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-disabled-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-4f8c0978] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test76d7f532acb694e4a7bcef75d32cd8a1-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheqsdc8 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmlb4m |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheqsdc8 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmlb4m |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.42:8000/health": dial tcp 10.132.0.42:8000: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche6gbft |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-hrrbz |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche6gbft |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test8ac8e3d2264ccb939eb021b0b835847c-llmisvc-rout | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-c76db9948 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-7ca60146-kserve-c76db9948-pzbnj | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-7ca60146-kserve-c76db9948 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-sa | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheqp7r4 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler-6b6cf76b69 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheqp7r4 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheqp7r4 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheqp7r4 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheqp7r4 |
AddedInterface |
Add eth0 [10.132.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler-6b6cf76b69 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-c76db9948-pzbnj |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-c76db9948-pzbnj |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-c76db9948-pzbnj |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-service | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-c76db9948-pzbnj |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test5216bfd716f919dc046bc693ceb22e41-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheqp7r4 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheqp7r4 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheqp7r4 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-c76db9948-pzbnj |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-c76db9948-pzbnj |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-c76db9948-pzbnj |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-shadow-svc |
| (x12) | kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-5596879d7-gch2p |
Unhealthy |
Startup probe failed: Get "https://10.134.0.40:8000/health": dial tcp 10.134.0.40:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
LLMInferenceServiceReady |
LLMInferenceService [auth-disabled-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-58d5d5d4b6-ghg8n |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-5596879d7-gch2p |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-58d5d5d4b6-ghg8n |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-disabled-test-epp-auth-rb | |
| (x8) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-c76db9948-pzbnj |
Unhealthy |
Startup probe failed: Get "https://10.134.0.41:8000/health": dial tcp 10.134.0.41:8000: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-5596879d7-gch2p |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.40:8000/health": dial tcp 10.134.0.40:8000: connect: connection refused | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-with-7ca60146] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-799f46c59b-qt5dn | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-qt5dn |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-799f46c59b-qt5dn |
AddedInterface |
Add eth0 [10.133.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-qt5dn |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-qt5dn |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-799f46c59b-qt5dn | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-qt5dn |
Killing |
Stopping container istio-proxy | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4dtv7h | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4dtv7h |
Created |
Created container: main | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4dtv7h |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4dtv7h |
AddedInterface |
Add eth0 [10.133.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4dtv7h |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-6cn2l |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.33:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheqp7r4 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-c76db9948-pzbnj |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test5216bfd716f919dc046bc693ceb22e41-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheqp7r4 |
FailedPreStopHook |
PreStopHook failed | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-6cn2l |
Started |
Started container istio-proxy |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-6cn2l |
Created |
Created container: istio-proxy |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-e95b1dc1] is Ready | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-6cn2l |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
| (x5) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-6cn2l |
Unhealthy |
Startup probe failed: Get "http://10.134.0.33:15021/healthz/ready": dial tcp 10.134.0.33:15021: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-c76db9948-pzbnj |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.41:8000/health": context deadline exceeded | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-64d79dc96c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-64d79dc96c |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-64d79dc96c-48v84 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test05addb65ba05195619f26ef266e8fc04-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-role | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-64d79dc96c-48v84 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schecfc4v |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schecfc4v |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schecfc4v |
AddedInterface |
Add eth0 [10.132.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schecfc4v |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler-744988b868 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schecfc4v | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-rb | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler-744988b868 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-64d79dc96c-48v84 |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-64d79dc96c-48v84 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-64d79dc96c-48v84 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schecfc4v |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schecfc4v |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schecfc4v |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-64d79dc96c-48v84 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-64d79dc96c-48v84 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-64d79dc96c-48v84 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-shadow-svc |
| (x7) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-64d79dc96c-48v84 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.42:8000/health": dial tcp 10.134.0.42:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-with-ba4d693a] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-64d79dc96c-48v84 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test05addb65ba05195619f26ef266e8fc04-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schecfc4v |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schecfc4v |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-64d79dc96c-48v84 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.42:8000/health": dial tcp 10.134.0.42:8000: connect: connection refused | |
kserve-ci-e2e-test |
persistentvolume-controller |
e2e-pvc-model-storage |
ExternalProvisioning |
Waiting for a volume to be created either by the external provisioner 'ebs.csi.aws.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | |
kserve-ci-e2e-test |
ebs.csi.aws.com_aws-ebs-csi-driver-controller-7b479b9ffb-rt4p4_ce8fa656-5b30-482e-a8c2-6bc47f749428 |
e2e-pvc-model-storage |
Provisioning |
External provisioner is provisioning volume for claim "kserve-ci-e2e-test/e2e-pvc-model-storage" | |
kserve-ci-e2e-test |
persistentvolume-controller |
e2e-pvc-model-storage |
WaitForFirstConsumer |
waiting for first consumer to be created before binding | |
kserve-ci-e2e-test |
job-controller |
e2e-pvc-model-download |
SuccessfulCreate |
Created pod: e2e-pvc-model-download-cbftb | |
kserve-ci-e2e-test |
ebs.csi.aws.com_aws-ebs-csi-driver-controller-7b479b9ffb-rt4p4_ce8fa656-5b30-482e-a8c2-6bc47f749428 |
e2e-pvc-model-storage |
ProvisioningSucceeded |
Successfully provisioned volume pvc-72dabf56-560c-4abb-87d3-214aad97d3e0 | |
kserve-ci-e2e-test |
attachdetach-controller |
e2e-pvc-model-download-cbftb |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-72dabf56-560c-4abb-87d3-214aad97d3e0" | |
kserve-ci-e2e-test |
kubelet |
e2e-pvc-model-download-cbftb |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
e2e-pvc-model-download-cbftb |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
e2e-pvc-model-download-cbftb |
AddedInterface |
Add eth0 [10.132.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
e2e-pvc-model-download-cbftb |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
job-controller |
e2e-pvc-model-download |
Completed |
Job completed | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-pvc-router-manage-59b9d263 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-59b9d263-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-59b9d263-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv8bf079eb6eda4debfb4ef5bb7817824c-kserve-self-signed-certs | |
kserve-ci-e2e-test |
multus |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schefbf7j |
AddedInterface |
Add eth0 [10.132.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler-5f555d4d85 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-service | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schefbf7j |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-sa | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d |
SuccessfulCreate |
Created pod: llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dk7qh9 | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schefbf7j |
Created |
Created container: main | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-pvc-router-manage-59b9d263-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schefbf7j |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler-5f555d4d85 |
SuccessfulCreate |
Created pod: llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schefbf7j | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testc9569cf4801efc0ed27b2f25ffaee875-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-role | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dk7qh9 |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-72dabf56-560c-4abb-87d3-214aad97d3e0" | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schefbf7j |
FailedAttachVolume |
Multi-Attach error for volume "pvc-72dabf56-560c-4abb-87d3-214aad97d3e0" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dk7qh9 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dk7qh9 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dk7qh9 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dk7qh9 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dk7qh9 |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-shadow-svc |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv8bf079eb6eda4debfb4ef5bb7817824c-kserve-self-signed-certs |
| (x11) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dk7qh9 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.43:8000/health": dial tcp 10.134.0.43:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-pvc-router-manage-59b9d263] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schefbf7j |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dk7qh9 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testc9569cf4801efc0ed27b2f25ffaee875-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schefbf7j |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dk7qh9 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.43:8000/health": dial tcp 10.134.0.43:8000: connect: connection refused | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-pvc-router-manage-e8706282 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-e8706282-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-e8706282-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler-67b4bb9646 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-epp-sa | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c |
SuccessfulCreate |
Created pod: llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-72gxs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79497db4cc |
SuccessfulCreate |
Created pod: llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79lbjf7 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler-67b4bb9646 |
SuccessfulCreate |
Created pod: llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche8glrw | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testf5d060a5eb39a04e074b78907a1556a6-llmisvc-mode | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79497db4cc from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvb19f98874e050eec8ca94d49676113f0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche8glrw |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche8glrw |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche8glrw |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche8glrw |
AddedInterface |
Add eth0 [10.132.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche8glrw |
FailedAttachVolume |
Multi-Attach error for volume "pvc-72dabf56-560c-4abb-87d3-214aad97d3e0" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-72gxs, llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79lbjf7 | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79lbjf7 |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-72dabf56-560c-4abb-87d3-214aad97d3e0" | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-72gxs |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-72dabf56-560c-4abb-87d3-214aad97d3e0" | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-72gxs |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79lbjf7 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79lbjf7 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79lbjf7 |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79lbjf7 |
AddedInterface |
Add eth0 [10.134.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-72gxs |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-72gxs |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" in 741ms (741ms including waiting). Image size: 44914394 bytes. | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-72gxs |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-route | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-72gxs |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-72gxs |
Created |
Created container: llm-d-routing-sidecar | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-72gxs |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-72gxs |
Started |
Started container llm-d-routing-sidecar | |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvb19f98874e050eec8ca94d49676113f0-kserve-self-signed-certs |
| (x15) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79lbjf7 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.45:8000/health": dial tcp 10.134.0.45:8000: connect: connection refused |
| (x15) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-72gxs |
Unhealthy |
Startup probe failed: Get "https://10.134.0.44:8001/health": dial tcp 10.134.0.44:8001: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-pvc-router-manage-e8706282] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche8glrw |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-72gxs |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-72gxs |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79lbjf7 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testf5d060a5eb39a04e074b78907a1556a6-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche8glrw |
FailedPreStopHook |
PreStopHook failed | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-pvc-router-manage-2577e794 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-2577e794-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-2577e794-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-scc | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler-7dbcb75dbc |
SuccessfulCreate |
Created pod: llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-sche6dkc9 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
GroupsProgressing |
Replicas are progressing, with 0 groups ready of total 1 groups | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-workload-svc | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
GroupsProgressing |
Created leader statefulset llmisvc-model-pvc-router-manage-2577e794-kserve-mn | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
SuccessfulCreate |
create Pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 in StatefulSet llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 successful | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test37591b20e96e9663d45a730d03070f1e-llmisvc-mode | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
GroupsProgressing |
Created worker statefulset for leader pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler-7dbcb75dbc from 0 to 1 | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
SuccessfulCreate |
create Pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 in StatefulSet llmisvc-model-pvc-router-manage-2577e794-kserve-mn successful | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-rb | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
CreatingRevision |
Creating revision with key 686d468674 for a newly created LeaderWorkerSet | |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-sche6dkc9 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-sche6dkc9 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-sche6dkc9 |
Created |
Created container: main | |
kserve-ci-e2e-test |
multus |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-sche6dkc9 |
AddedInterface |
Add eth0 [10.132.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-sche6dkc9 |
FailedAttachVolume |
Multi-Attach error for volume "pvc-72dabf56-560c-4abb-87d3-214aad97d3e0" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1, llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-72dabf56-560c-4abb-87d3-214aad97d3e0" | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-72dabf56-560c-4abb-87d3-214aad97d3e0" | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-route | |
| (x8) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
AddedInterface |
Add eth0 [10.134.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
AddedInterface |
Add eth0 [10.134.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Started |
Started container main | |
| (x3) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs |
| (x13) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.46:8000/health": dial tcp 10.134.0.46:8000: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
AllGroupsReady |
All replicas are ready, with 1 groups ready of total 1 groups |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4dtv7h |
Killing |
Stopping container main | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-87882a8e |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route" not found |
kserve-ci-e2e-test |
replicaset-controller |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler-544b5f8d4c |
SuccessfulCreate |
Created pod: llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schejtb4k | |
kserve-ci-e2e-test |
deployment-controller |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler-544b5f8d4c from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test21fe6730fe484f3a92b1a16afe1bac8f-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-service | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-87882a8e-kserve-ffb76d85c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-ffb76d85c |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-87882a8e-kserve-ffb76d85c-n2jtf | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schejtb4k |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schejtb4k |
AddedInterface |
Add eth0 [10.132.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-ffb76d85c-n2jtf |
AddedInterface |
Add eth0 [10.134.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-ffb76d85c-n2jtf |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-ffb76d85c-n2jtf |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-ffb76d85c-n2jtf |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schejtb4k |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schejtb4k |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schejtb4k |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schejtb4k |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schejtb4k |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-pvc-router-manage-2577e794] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-ffb76d85c-n2jtf |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-ffb76d85c-n2jtf |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-ffb76d85c-n2jtf |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test37591b20e96e9663d45a730d03070f1e-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-sche6dkc9 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-sche6dkc9 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-lora-crit |
UpdateFailed |
Failed to update status for LLMInferenceService "conv-test-lora-crit": Operation cannot be fulfilled on llminferenceservices.serving.kserve.io "conv-test-lora-crit": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-round-trip |
UpdateFailed |
Failed to update status for LLMInferenceService "conv-test-round-trip": llminferenceservices.serving.kserve.io "conv-test-round-trip" not found | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-criticality |
UpdateFailed |
Failed to update status for LLMInferenceService "conv-test-criticality": llminferenceservices.serving.kserve.io "conv-test-criticality" not found | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-78ddd7447 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-router-scheduler-76bbb8774d |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-router-scheduler-76bbb8774d-889t7 | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-router-scheduler-76bbb8774d from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-78ddd7447-7jzbj |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Role kserve-ci-e2e-test/stop-feature-test-epp-role | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-78ddd7447-7jzbj |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-78ddd7447-7jzbj |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/stop-feature-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-stop-feature-test-epp-auth-rb | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-78ddd7447-7jzbj |
AddedInterface |
Add eth0 [10.134.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-78ddd7447 |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-78ddd7447-7jzbj | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-router-scheduler-76bbb8774d-889t7 |
AddedInterface |
Add eth0 [10.132.0.51/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-76bbb8774d-889t7 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-76bbb8774d-889t7 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-76bbb8774d-889t7 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-76bbb8774d-889t7 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-76bbb8774d-889t7 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-76bbb8774d-889t7 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-78ddd7447-7jzbj |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-78ddd7447-7jzbj |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-78ddd7447-7jzbj |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/stop-feature-test-kserve-shadow-svc |
| (x11) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-ffb76d85c-n2jtf |
Unhealthy |
Startup probe failed: Get "https://10.134.0.48:8000/health": dial tcp 10.134.0.48:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-87882a8e] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-ffb76d85c-n2jtf |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test21fe6730fe484f3a92b1a16afe1bac8f-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schejtb4k |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schejtb4k |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-ffb76d85c-n2jtf |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.48:8000/health": dial tcp 10.134.0.48:8000: connect: connection refused | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-test-kserve |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-test-kserve-66c886969f from 0 to 1 | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
custom-route-timeout-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-66c886969f-7v7hs |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7c89bfcfqz6fc |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-test-kserve-router-scheduler-7c89bfcfc4 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Role kserve-ci-e2e-test/custom-route-timeout-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-kserve-workload-svc | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-test-kserve-66c886969f-7v7hs |
AddedInterface |
Add eth0 [10.134.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-66c886969f-7v7hs |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-66c886969f-7v7hs |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-test-kserve-66c886969f |
SuccessfulCreate |
Created pod: custom-route-timeout-test-kserve-66c886969f-7v7hs | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-test-kserve-router-scheduler-7c89bfcfc4 |
SuccessfulCreate |
Created pod: custom-route-timeout-test-kserve-router-scheduler-7c89bfcfqz6fc | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-test-kserve-router-scheduler-7c89bfcfqz6fc |
AddedInterface |
Add eth0 [10.132.0.52/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7c89bfcfqz6fc |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7c89bfcfqz6fc |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7c89bfcfqz6fc |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7c89bfcfqz6fc |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7c89bfcfqz6fc |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-66c886969f-7v7hs |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-66c886969f-7v7hs |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-66c886969f-7v7hs |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-test-kserve-shadow-svc |
| (x11) | kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-78ddd7447-7jzbj |
Unhealthy |
Startup probe failed: Get "https://10.134.0.49:8000/health": dial tcp 10.134.0.49:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
LLMInferenceServiceReady |
LLMInferenceService [stop-feature-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-76bbb8774d-889t7 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-76bbb8774d-889t7 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.InferencePool kserve-ci-e2e-test/stop-feature-test-inference-pool | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
LLMInferenceServiceNotReady |
LLMInferenceService [stop-feature-test] is no longer Ready because of: GatewaysReady, HTTPRoutesReady, InferencePoolReady, MainWorkloadReady, PrefillWorkerWorkloadReady, PrefillWorkloadReady, RouterReady, SchedulerWorkloadReady, WorkerWorkloadReady, WorkloadsReady | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-78ddd7447-7jzbj |
Killing |
Stopping container main | |
| (x23) | kserve-ci-e2e-test |
OpenDataHubModelController |
stop-feature-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy stop-feature-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "stop-feature-test-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-78ddd7447-7jzbj |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.49:8000/health": dial tcp 10.134.0.49:8000: connect: connection refused | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-router-scheduler-76bbb8774d from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-78ddd7447 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-router-scheduler-76bbb8774d |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-router-scheduler-76bbb8774d-f4vbf | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-78ddd7447 |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-78ddd7447-8kcjs | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-78ddd7447-8kcjs |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-78ddd7447-8kcjs |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-76bbb8774d-f4vbf |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-76bbb8774d-f4vbf |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-76bbb8774d-f4vbf |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-router-scheduler-76bbb8774d-f4vbf |
AddedInterface |
Add eth0 [10.132.0.53/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-78ddd7447-8kcjs |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-78ddd7447-8kcjs |
AddedInterface |
Add eth0 [10.134.0.51/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-76bbb8774d-f4vbf |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-76bbb8774d-f4vbf |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-76bbb8774d-f4vbf |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-78ddd7447-8kcjs |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-78ddd7447-8kcjs |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-78ddd7447-8kcjs |
Started |
Started container main | |
| (x11) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-66c886969f-7v7hs |
Unhealthy |
Startup probe failed: Get "https://10.134.0.50:8000/health": dial tcp 10.134.0.50:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
LLMInferenceServiceReady |
LLMInferenceService [custom-route-timeout-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7c89bfcfqz6fc |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7c89bfcfqz6fc |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-66c886969f-7v7hs |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-799f46c59b-gb7nq | |
| (x4) | kserve-ci-e2e-test |
gateway_labeler_controller |
router-gateway-1 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway router-gateway-1 |
| (x4) | kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-1-openshift-default-799f46c59b from 0 to 1 |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-799f46c59b-gb7nq |
AddedInterface |
Add eth0 [10.133.0.43/23] from ovn-kubernetes | |
| (x3) | kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-1-openshift-default-54c47cdfc7 from 0 to 1 |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-54c47cdfc7-tzh7s | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-54c47cdfc7-6cn2l | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-6cn2l |
Killing |
Stopping container istio-proxy | |
| (x2) | kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled down replica set router-gateway-1-openshift-default-54c47cdfc7 from 1 to 0 |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-54c47cdfc7-tzh7s |
AddedInterface |
Add eth0 [10.133.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-test-kserve-cd8b578dc |
SuccessfulCreate |
Created pod: router-with-refs-test-kserve-cd8b578dc-h8cml | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-test-kserve |
ScalingReplicaSet |
Scaled up replica set router-with-refs-test-kserve-cd8b578dc from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Role kserve-ci-e2e-test/router-with-refs-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
multus |
router-with-refs-test-kserve-router-scheduler-8579f4fd54-skhz2 |
AddedInterface |
Add eth0 [10.132.0.54/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-test-epp-service | |
kserve-ci-e2e-test |
multus |
router-with-refs-test-kserve-cd8b578dc-h8cml |
AddedInterface |
Add eth0 [10.134.0.52/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-cd8b578dc-h8cml |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-test-kserve-router-scheduler-8579f4fd54 |
SuccessfulCreate |
Created pod: router-with-refs-test-kserve-router-scheduler-8579f4fd54-skhz2 | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set router-with-refs-test-kserve-router-scheduler-8579f4fd54 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-test-epp-rb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-cd8b578dc-h8cml |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-cd8b578dc-h8cml |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-8579f4fd54-skhz2 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-8579f4fd54-skhz2 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-8579f4fd54-skhz2 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
| (x5) | kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-8579f4fd54-skhz2 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-8579f4fd54-skhz2 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-8579f4fd54-skhz2 |
Started |
Started container main | |
| (x8) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-tzh7s |
Unhealthy |
Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-tzh7s |
Unhealthy |
Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": read tcp 10.133.0.2:35320->10.133.0.44:15021: read: connection reset by peer | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-tzh7s |
Created |
Created container: istio-proxy |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-gb7nq |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-gb7nq |
Started |
Started container istio-proxy |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-cd8b578dc-h8cml |
Started |
Started container main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-tzh7s |
Started |
Started container istio-proxy |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-gb7nq |
Created |
Created container: istio-proxy |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-tzh7s |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-cd8b578dc-h8cml |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-cd8b578dc-h8cml |
Created |
Created container: main | |
| (x5) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-gb7nq |
Unhealthy |
Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-tzh7s |
Unhealthy |
Startup probe failed: Get "http://10.133.0.44:15021/healthz/ready": dial tcp 10.133.0.44:15021: connect: connection refused |
| (x12) | kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-78ddd7447-8kcjs |
Unhealthy |
Startup probe failed: Get "https://10.134.0.51:8000/health": dial tcp 10.134.0.51:8000: connect: connection refused |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-799f46c59b-gb7nq | |
| (x4) | kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled down replica set router-gateway-1-openshift-default-799f46c59b from 1 to 0 |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-gb7nq |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-76bbb8774d-f4vbf |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-76bbb8774d-f4vbf |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-78ddd7447-8kcjs |
Killing |
Stopping container main | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
lora-single-adapter-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy lora-single-adapter-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/lora-single-adapter-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "lora-single-adapter-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/lora-single-adapter-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
lora-single-adapter-test-kserve |
ScalingReplicaSet |
Scaled up replica set lora-single-adapter-test-kserve-6f56f99c66 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.Secret kserve-ci-e2e-test/lora-single-adapter-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.Service kserve-ci-e2e-test/lora-single-adapter-test-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
lora-single-adapter-test-kserve-6f56f99c66 |
SuccessfulCreate |
Created pod: lora-single-adapter-test-kserve-6f56f99c66-k5b57 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/lora-single-adapter-test-kserve-route | |
kserve-ci-e2e-test |
multus |
lora-single-adapter-test-kserve-6f56f99c66-k5b57 |
AddedInterface |
Add eth0 [10.134.0.53/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/lora-single-adapter-test-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-6f56f99c66-k5b57 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-6f56f99c66-k5b57 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-6f56f99c66-k5b57 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-6f56f99c66-k5b57 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-6f56f99c66-k5b57 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-6f56f99c66-k5b57 |
Created |
Created container: main | |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/lora-single-adapter-test-kserve-self-signed-certs |
| (x11) | kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-cd8b578dc-h8cml |
Unhealthy |
Startup probe failed: Get "https://10.134.0.52:8000/health": dial tcp 10.134.0.52:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
LLMInferenceServiceReady |
LLMInferenceService [router-with-refs-test] is Ready | |
| (x8) | kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-6f56f99c66-k5b57 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.53:8000/health": dial tcp 10.134.0.53:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
LLMInferenceServiceReady |
LLMInferenceService [lora-single-adapter-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-6f56f99c66-k5b57 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-8579f4fd54-skhz2 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-8579f4fd54-skhz2 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-cd8b578dc-h8cml |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-6f56f99c66-k5b57 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.53:8000/health": context deadline exceeded | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
lora-multiple-adapters-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy lora-multiple-adapters-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "lora-multiple-adapters-test-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-cd8b578dc-h8cml |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.52:8000/health": dial tcp 10.134.0.52:8000: connect: connection refused | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.Service kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-764b5b74d7-v48lv |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
lora-multiple-adapters-test-kserve |
ScalingReplicaSet |
Scaled up replica set lora-multiple-adapters-test-kserve-764b5b74d7 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/lora-multiple-adapters-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.Secret kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
multus |
lora-multiple-adapters-test-kserve-764b5b74d7-v48lv |
AddedInterface |
Add eth0 [10.134.0.54/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-764b5b74d7-v48lv |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
lora-multiple-adapters-test-kserve-764b5b74d7 |
SuccessfulCreate |
Created pod: lora-multiple-adapters-test-kserve-764b5b74d7-v48lv | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-764b5b74d7-v48lv |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-764b5b74d7-v48lv |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-764b5b74d7-v48lv |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-764b5b74d7-v48lv |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-self-signed-certs | |
| (x14) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-50bc673d |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler-5dc8fbc745 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche5n224 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-epp-sa | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-6dgs5wq |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler-5dc8fbc745 |
SuccessfulCreate |
Created pod: llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche5n224 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-6d46f65b6 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-50bc673d-kserve-f99ccccc7 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-6dgs5wq |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-6dgs5wq |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-6dgs5wq |
AddedInterface |
Add eth0 [10.134.0.56/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve | |
kserve-ci-e2e-test |
multus |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche5n224 |
AddedInterface |
Add eth0 [10.132.0.55/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-f99ccccc7-wlb6c |
AddedInterface |
Add eth0 [10.134.0.55/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-f99ccccc7-wlb6c |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-f99ccccc7-wlb6c |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-f99ccccc7-wlb6c |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test00d7278d8a22c4e39146a6b0eb840f45-llmisvc-mode | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-6d46f65b6 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-6dgs5wq | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-f99ccccc7 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-50bc673d-kserve-f99ccccc7-wlb6c | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-f99ccccc7-wlb6c |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-f99ccccc7-wlb6c |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-f99ccccc7-wlb6c |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche5n224 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche5n224 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche5n224 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche5n224 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche5n224 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-f99ccccc7-wlb6c |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-f99ccccc7-wlb6c |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-f99ccccc7-wlb6c |
Started |
Started container main | |
| (x3) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-c9ndl |
Created |
Created container: istio-proxy |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-6dgs5wq |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-6dgs5wq |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-6dgs5wq |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
| (x2) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-c9ndl |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine |
| (x3) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-c9ndl |
Started |
Started container istio-proxy |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-shadow-svc |
| (x11) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-c9ndl |
ProbeError |
Startup probe error: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused body: |
| (x11) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-c9ndl |
Unhealthy |
Startup probe failed: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-c9ndl |
ProbeError |
Startup probe error: Get "http://10.133.0.27:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-c9ndl |
Unhealthy |
Startup probe failed: Get "http://10.133.0.27:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
| (x8) | kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-764b5b74d7-v48lv |
Unhealthy |
Startup probe failed: Get "https://10.134.0.54:8000/health": dial tcp 10.134.0.54:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
LLMInferenceServiceReady |
LLMInferenceService [lora-multiple-adapters-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-764b5b74d7-v48lv |
Killing |
Stopping container main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-764b5b74d7-v48lv |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.54:8000/health": dial tcp 10.134.0.54:8000: connect: connection refused |
kserve-ci-e2e-test |
replicaset-controller |
tls-verification-test-kserve-66dc875567 |
SuccessfulCreate |
Created pod: tls-verification-test-kserve-66dc875567-8hbzr | |
kserve-ci-e2e-test |
deployment-controller |
tls-verification-test-kserve |
ScalingReplicaSet |
Scaled up replica set tls-verification-test-kserve-66dc875567 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/tls-verification-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Service kserve-ci-e2e-test/tls-verification-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/tls-verification-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Secret kserve-ci-e2e-test/tls-verification-test-kserve-self-signed-certs | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
tls-verification-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy tls-verification-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/tls-verification-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "tls-verification-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/tls-verification-test-epp-rb | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-54fcb44dcb-ndbt4 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
tls-verification-test-kserve-router-scheduler-54fcb44dcb |
SuccessfulCreate |
Created pod: tls-verification-test-kserve-router-scheduler-54fcb44dcb-ndbt4 | |
kserve-ci-e2e-test |
multus |
tls-verification-test-kserve-66dc875567-8hbzr |
AddedInterface |
Add eth0 [10.134.0.57/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
tls-verification-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set tls-verification-test-kserve-router-scheduler-54fcb44dcb from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-66dc875567-8hbzr |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-66dc875567-8hbzr |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
multus |
tls-verification-test-kserve-router-scheduler-54fcb44dcb-ndbt4 |
AddedInterface |
Add eth0 [10.132.0.56/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-54fcb44dcb-ndbt4 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-54fcb44dcb-ndbt4 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-tls-verification-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Role kserve-ci-e2e-test/tls-verification-test-epp-role | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-66dc875567-8hbzr |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Service kserve-ci-e2e-test/tls-verification-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-54fcb44dcb-ndbt4 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-54fcb44dcb-ndbt4 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-54fcb44dcb-ndbt4 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-66dc875567-8hbzr |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-66dc875567-8hbzr |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-66dc875567-8hbzr |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/tls-verification-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/tls-verification-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/tls-verification-test-kserve-route | |
| (x17) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-6dgs5wq |
Unhealthy |
Startup probe failed: Get "https://10.134.0.56:8000/health": dial tcp 10.134.0.56:8000: connect: connection refused |
| (x17) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-f99ccccc7-wlb6c |
Unhealthy |
Startup probe failed: Get "https://10.134.0.55:8001/health": dial tcp 10.134.0.55:8001: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-50bc673d] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-6dgs5wq |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test00d7278d8a22c4e39146a6b0eb840f45-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche5n224 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche5n224 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-f99ccccc7-wlb6c |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-f99ccccc7-wlb6c |
Killing |
Stopping container llm-d-routing-sidecar | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
custom-route-timeout-pd-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-pd-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-pd-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-6f67d5cf8b from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-router-scheduler-c7d444b99 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-router-scheduler-c7d444b99 |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-router-scheduler-c7d44ckr2j | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-prefill-84bd675bc9 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-prefill-84bd675bc9 |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-prefill-84bd675bc9-kzc4r | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Role kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-6f67d5cf8b-522cc |
AddedInterface |
Add eth0 [10.134.0.58/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-84bd675bc9-kzc4r |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-prefill-84bd675bc9-kzc4r |
AddedInterface |
Add eth0 [10.134.0.59/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-6f67d5cf8b |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-6f67d5cf8b-522cc | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f67d5cf8b-522cc |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-84bd675bc9-kzc4r |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f67d5cf8b-522cc |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-router-scheduler-c7d44ckr2j |
AddedInterface |
Add eth0 [10.132.0.57/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-c7d44ckr2j |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-c7d44ckr2j |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-c7d44ckr2j |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-84bd675bc9-kzc4r |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f67d5cf8b-522cc |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f67d5cf8b-522cc |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f67d5cf8b-522cc |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f67d5cf8b-522cc |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-c7d44ckr2j |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-c7d44ckr2j |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-c7d44ckr2j |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f67d5cf8b-522cc |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f67d5cf8b-522cc |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f67d5cf8b-522cc |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-84bd675bc9-kzc4r |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-84bd675bc9-kzc4r |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-84bd675bc9-kzc4r |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route | |
| (x12) | kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-66dc875567-8hbzr |
Unhealthy |
Startup probe failed: Get "https://10.134.0.57:8000/health": dial tcp 10.134.0.57:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
LLMInferenceServiceReady |
LLMInferenceService [tls-verification-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-54fcb44dcb-ndbt4 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-66dc875567-8hbzr |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-tls-verification-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-54fcb44dcb-ndbt4 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-66dc875567-8hbzr |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.57:8000/health": context deadline exceeded | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-prestop-hook-test-epp-auth-rb | |
kserve-ci-e2e-test |
replicaset-controller |
prestop-hook-test-kserve-router-scheduler-66cbfd5b6d |
SuccessfulCreate |
Created pod: prestop-hook-test-kserve-router-scheduler-66cbfd5b6d-g9qrx | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/prestop-hook-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
multus |
prestop-hook-test-kserve-7f76488d87-7g5z8 |
AddedInterface |
Add eth0 [10.134.0.60/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-7f76488d87-7g5z8 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-7f76488d87-7g5z8 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-7f76488d87-7g5z8 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
prestop-hook-test-kserve-7f76488d87 |
SuccessfulCreate |
Created pod: prestop-hook-test-kserve-7f76488d87-7g5z8 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Service kserve-ci-e2e-test/prestop-hook-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-66cbfd5b6d-g9qrx |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
multus |
prestop-hook-test-kserve-router-scheduler-66cbfd5b6d-g9qrx |
AddedInterface |
Add eth0 [10.132.0.58/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/prestop-hook-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
prestop-hook-test-kserve |
ScalingReplicaSet |
Scaled up replica set prestop-hook-test-kserve-7f76488d87 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
prestop-hook-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set prestop-hook-test-kserve-router-scheduler-66cbfd5b6d from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Service kserve-ci-e2e-test/prestop-hook-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/prestop-hook-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Secret kserve-ci-e2e-test/prestop-hook-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Role kserve-ci-e2e-test/prestop-hook-test-epp-role | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-66cbfd5b6d-g9qrx |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-66cbfd5b6d-g9qrx |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-66cbfd5b6d-g9qrx |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-66cbfd5b6d-g9qrx |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-66cbfd5b6d-g9qrx |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-7f76488d87-7g5z8 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-7f76488d87-7g5z8 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-7f76488d87-7g5z8 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/prestop-hook-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/prestop-hook-test-kserve-shadow-svc |
| (x16) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-84bd675bc9-kzc4r |
Unhealthy |
Startup probe failed: Get "https://10.134.0.59:8000/health": dial tcp 10.134.0.59:8000: connect: connection refused |
| (x16) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f67d5cf8b-522cc |
Unhealthy |
Startup probe failed: Get "https://10.134.0.58:8001/health": dial tcp 10.134.0.58:8001: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
LLMInferenceServiceReady |
LLMInferenceService [custom-route-timeout-pd-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-84bd675bc9-kzc4r |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-c7d44ckr2j |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-c7d44ckr2j |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f67d5cf8b-522cc |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f67d5cf8b-522cc |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
gateway_labeler_controller |
router-gateway-2 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway router-gateway-2 | |
kserve-ci-e2e-test |
service-controller |
router-gateway-2-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-2-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-2-openshift-default-54c789bdc6 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
router-gateway-2-openshift-default-54c789bdc6-qlsdv |
AddedInterface |
Add eth0 [10.133.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-qlsdv |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-2-openshift-default-54c789bdc6 |
SuccessfulCreate |
Created pod: router-gateway-2-openshift-default-54c789bdc6-qlsdv | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-qlsdv |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-qlsdv |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
multus |
router-gateway-2-openshift-default-684dc9b4b9-bt7g2 |
AddedInterface |
Add eth0 [10.134.0.61/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-2-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-2-openshift-default-684dc9b4b9 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-2-openshift-default-684dc9b4b9 |
SuccessfulCreate |
Created pod: router-gateway-2-openshift-default-684dc9b4b9-bt7g2 | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-bt7g2 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-bt7g2 |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-bt7g2 |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
service-controller |
router-gateway-2-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
| (x13) | kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-7f76488d87-7g5z8 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.60:8000/health": dial tcp 10.134.0.60:8000: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-bt7g2 |
Unhealthy |
Startup probe failed: Get "http://10.134.0.61:15021/healthz/ready": dial tcp 10.134.0.61:15021: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-qlsdv |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-2-openshift-default-54c789bdc6 |
SuccessfulDelete |
Deleted pod: router-gateway-2-openshift-default-54c789bdc6-qlsdv | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-2-openshift-default |
ScalingReplicaSet |
Scaled down replica set router-gateway-2-openshift-default-54c789bdc6 from 1 to 0 | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-5fdcf4bcfd |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-5fdcf4bcfd-jcdfk | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-5fdcf4bcfd-jcdfk |
AddedInterface |
Add eth0 [10.134.0.62/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5fdcf4bcfd-jcdfk |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-pd-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-pd-test-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Role kserve-ci-e2e-test/router-with-refs-pd-test-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-5fdcf4bcfd from 0 to 1 | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-prefill-69db96b599-2qzbg |
AddedInterface |
Add eth0 [10.134.0.63/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-prefill-69db96b599 |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-prefill-69db96b599-2qzbg | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-prefill-69db96b599 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-b78dc9c7fwr2tx |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-69db96b599-2qzbg |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-b78dc9c7fwr2tx |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-b78dc9c7fwr2tx |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-router-scheduler-b78dc9c7fwr2tx |
AddedInterface |
Add eth0 [10.132.0.59/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-router-scheduler-b78dc9c7f |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-router-scheduler-b78dc9c7fwr2tx | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5fdcf4bcfd-jcdfk |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5fdcf4bcfd-jcdfk |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-69db96b599-2qzbg |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5fdcf4bcfd-jcdfk |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-69db96b599-2qzbg |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-router-scheduler-b78dc9c7f from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5fdcf4bcfd-jcdfk |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5fdcf4bcfd-jcdfk |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-b78dc9c7fwr2tx |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-b78dc9c7fwr2tx |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-b78dc9c7fwr2tx |
Created |
Created container: main | |
| (x9) | kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-pd-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
LLMInferenceServiceReady |
LLMInferenceService [prestop-hook-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-69db96b599-2qzbg |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5fdcf4bcfd-jcdfk |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-69db96b599-2qzbg |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5fdcf4bcfd-jcdfk |
Created |
Created container: main | |
kserve-ci-e2e-test |
replicaset-controller |
prestop-hook-test-kserve-7f76488d87 |
SuccessfulCreate |
Created pod: prestop-hook-test-kserve-7f76488d87-zl2xg | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5fdcf4bcfd-jcdfk |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-7f76488d87-7g5z8 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-69db96b599-2qzbg |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-7f76488d87-zl2xg |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
prestop-hook-test-kserve-7f76488d87-zl2xg |
AddedInterface |
Add eth0 [10.134.0.64/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-7f76488d87-zl2xg |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-7f76488d87-zl2xg |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-7f76488d87-zl2xg |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-7f76488d87-zl2xg |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-7f76488d87-zl2xg |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-7f76488d87-zl2xg |
Unhealthy |
Startup probe failed: Get "https://10.134.0.64:8000/health": dial tcp 10.134.0.64:8000: connect: connection refused | |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/prestop-hook-test-kserve-self-signed-certs |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
LLMInferenceServiceNotReady |
LLMInferenceService [prestop-hook-test] is no longer Ready because of: MainWorkloadReady, WorkloadsReady | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-7f76488d87-7g5z8 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.60:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-7f76488d87-zl2xg |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-66cbfd5b6d-g9qrx |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-prestop-hook-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-66cbfd5b6d-g9qrx |
Killing |
Stopping container main | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
rolling-upgrade-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy rolling-upgrade-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/rolling-upgrade-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "rolling-upgrade-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-rolling-upgrade-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/rolling-upgrade-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Service kserve-ci-e2e-test/rolling-upgrade-test-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
rolling-upgrade-test-kserve-54bc76f55b |
SuccessfulCreate |
Created pod: rolling-upgrade-test-kserve-54bc76f55b-vqrcx | |
kserve-ci-e2e-test |
deployment-controller |
rolling-upgrade-test-kserve |
ScalingReplicaSet |
Scaled up replica set rolling-upgrade-test-kserve-54bc76f55b from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-54bc76f55b-vqrcx |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-4wbfv |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/rolling-upgrade-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
multus |
rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-4wbfv |
AddedInterface |
Add eth0 [10.132.0.60/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-4wbfv |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Service kserve-ci-e2e-test/rolling-upgrade-test-epp-service | |
kserve-ci-e2e-test |
multus |
rolling-upgrade-test-kserve-54bc76f55b-vqrcx |
AddedInterface |
Add eth0 [10.133.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-54bc76f55b-vqrcx |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Role kserve-ci-e2e-test/rolling-upgrade-test-epp-role | |
kserve-ci-e2e-test |
replicaset-controller |
rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd |
SuccessfulCreate |
Created pod: rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-4wbfv | |
kserve-ci-e2e-test |
deployment-controller |
rolling-upgrade-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-4wbfv |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-54bc76f55b-vqrcx |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/rolling-upgrade-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/rolling-upgrade-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
LLMInferenceServiceReady |
LLMInferenceService [rolling-upgrade-test] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
rolling-upgrade-test-kserve-859df57bcb |
SuccessfulCreate |
Created pod: rolling-upgrade-test-kserve-859df57bcb-q5g2s | |
kserve-ci-e2e-test |
deployment-controller |
rolling-upgrade-test-kserve |
ScalingReplicaSet |
Scaled up replica set rolling-upgrade-test-kserve-859df57bcb from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Updated |
Updated v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-q5g2s |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-q5g2s |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
multus |
rolling-upgrade-test-kserve-859df57bcb-q5g2s |
AddedInterface |
Add eth0 [10.133.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-q5g2s |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-4wbfv |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-4wbfv |
Killing |
Stopping container main | |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-54bc76f55b-vqrcx |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-rolling-upgrade-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-q5g2s |
Killing |
Stopping container main | |
| (x6) | kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-q5g2s |
FailedMount |
MountVolume.SetUp failed for volume "tls-certs" : secret "rolling-upgrade-test-kserve-self-signed-certs" not found |
| (x16) | kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-69db96b599-2qzbg |
Unhealthy |
Startup probe failed: Get "https://10.134.0.63:8000/health": dial tcp 10.134.0.63:8000: connect: connection refused |
| (x16) | kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5fdcf4bcfd-jcdfk |
Unhealthy |
Startup probe failed: Get "https://10.134.0.62:8001/health": dial tcp 10.134.0.62:8001: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
LLMInferenceServiceReady |
LLMInferenceService [router-with-refs-pd-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5fdcf4bcfd-jcdfk |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-b78dc9c7fwr2tx |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-b78dc9c7fwr2tx |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5fdcf4bcfd-jcdfk |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-69db96b599-2qzbg |
Killing |
Stopping container main | |
| (x14) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-3c960099 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-3c960099-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-3c960099-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-route | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-59675c7fb4 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-3c960099-kserve-59675c7fb47xmlr | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-3c960099-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-3c960099-kserve-59675c7fb4 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvd10b93c8eba12f87c3a350a5cae2ee0c-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-59675c7fb47xmlr |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-59675c7fb47xmlr |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-59675c7fb47xmlr |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-59675c7fb47xmlr |
AddedInterface |
Add eth0 [10.134.0.65/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-59675c7fb47xmlr |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-59675c7fb47xmlr |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-59675c7fb47xmlr |
Created |
Created container: main | |
| (x14) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-configmap-ref-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-configmap-ref-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-configmap-ref-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvd10b93c8eba12f87c3a350a5cae2ee0c-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-workload-svc | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-configmap-ref-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-configmap-ref-test-kserve-744bf59fbd from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-configmap-ref-test-kserve-744bf59fbd |
SuccessfulCreate |
Created pod: scheduler-configmap-ref-test-kserve-744bf59fbd-jjwd6 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-jjwd6 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-68f87jplvb |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-jjwd6 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-68f87jplvb |
Created |
Created container: main | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-configmap-ref-test-kserve-router-scheduler-68f876cc5d |
SuccessfulCreate |
Created pod: scheduler-configmap-ref-test-kserve-router-scheduler-68f87jplvb | |
kserve-ci-e2e-test |
multus |
scheduler-configmap-ref-test-kserve-router-scheduler-68f87jplvb |
AddedInterface |
Add eth0 [10.132.0.61/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-68f87jplvb |
Started |
Started container main | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-configmap-ref-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-configmap-ref-test-kserve-router-scheduler-68f876cc5d from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-role | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-jjwd6 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
multus |
scheduler-configmap-ref-test-kserve-744bf59fbd-jjwd6 |
AddedInterface |
Add eth0 [10.133.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-68f87jplvb |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-configmap-ref-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-jjwd6 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-68f87jplvb |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-ha-replicas-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dbc4 from 0 to 2 | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-5c5cfcf776-hcvbc |
AddedInterface |
Add eth0 [10.133.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-workload-svc | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-ha-replicas-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-ha-replicas-test-kserve-5c5cfcf776 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-hcvbc |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-hcvbc |
Created |
Created container: main | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dbc4 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dhjphp | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dbc4 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d5wm7r | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-service | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-ha-replicas-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-ha-replicas-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-ha-replicas-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-hcvbc |
Started |
Started container main | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-5c5cfcf776 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-5c5cfcf776-hcvbc | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d5wm7r |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dhjphp |
AddedInterface |
Add eth0 [10.134.0.66/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d5wm7r |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dhjphp |
Created |
Created container: main | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d5wm7r |
AddedInterface |
Add eth0 [10.132.0.62/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d5wm7r |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dhjphp |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dhjphp |
Started |
Started container main | |
| (x11) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-59675c7fb47xmlr |
Unhealthy |
Startup probe failed: Get "https://10.134.0.65:8000/health": dial tcp 10.134.0.65:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-3c960099] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-ha-replicas-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-hcvbc |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-59675c7fb47xmlr |
Killing |
Stopping container main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dhjphp |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dhjphp |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d5wm7r |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d5wm7r |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dhjphp |
FailedPreStopHook |
PreStopHook failed | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-scc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs | |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
GroupsProgressing |
Replicas are progressing, with 0 groups ready of total 1 groups |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche7vr9r |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
SuccessfulCreate |
create Pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 in StatefulSet llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn successful | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
GroupsProgressing |
Created worker statefulset for leader pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
AddedInterface |
Add eth0 [10.134.0.68/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche7vr9r |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche7vr9r |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche7vr9r |
AddedInterface |
Add eth0 [10.132.0.63/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
GroupsProgressing |
Created leader statefulset llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
SuccessfulCreate |
create Pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 in StatefulSet llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 successful | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
AddedInterface |
Add eth0 [10.134.0.67/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test386bd5808c5c450f11fd8632e1f821fb-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-rb | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:f221c928a0bb1ba5e4c45ae19b5fe18d4abac3f5b57f42edecf256c4242d4d40" already present on machine | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
CreatingRevision |
Creating revision with key 77c6c58bf6 for a newly created LeaderWorkerSet | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler-5df47fb959 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler-5df47fb959 |
SuccessfulCreate |
Created pod: llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche7vr9r | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche7vr9r |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche7vr9r |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche7vr9r |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Created |
Created container: main | |
| (x14) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-custom-template-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-custom-template-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-custom-template-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-custom-template-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-custom-template-test-epp-rb | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-custom-template-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-custom-template-test-kserve-router-scheduler-567469f665 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-custom-template-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-6w9zw |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-custom-template-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-custom-template-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-custom-template-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-custom-template-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-custom-template-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-custom-template-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-custom-template-test-kserve-5bc7bd6864 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-custom-template-test-epp-sa | |
kserve-ci-e2e-test |
multus |
scheduler-custom-template-test-kserve-5bc7bd6864-6w9zw |
AddedInterface |
Add eth0 [10.133.0.51/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-custom-template-test-kserve-5bc7bd6864 |
SuccessfulCreate |
Created pod: scheduler-custom-template-test-kserve-5bc7bd6864-6w9zw | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-custom-template-test-kserve-router-scheduler-567469f665 |
SuccessfulCreate |
Created pod: scheduler-custom-template-test-kserve-router-scheduler-5676f2xn | |
kserve-ci-e2e-test |
multus |
scheduler-custom-template-test-kserve-router-scheduler-5676f2xn |
AddedInterface |
Add eth0 [10.132.0.64/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-5676f2xn |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-5676f2xn |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-6w9zw |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-6w9zw |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-5676f2xn |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route | |
| (x8) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-custom-template-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-custom-template-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-custom-template-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-custom-template-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-6w9zw |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-5676f2xn |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-5676f2xn |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-custom-template-test-epp-auth-rb | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-v06-pd-migration-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-v06-pd-migration-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-v06-pd-migration-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-role | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-pd-migration-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-pd-migration-test-kserve-router-scheduler-59dc679cd from 0 to 1 | |
kserve-ci-e2e-test |
multus |
scheduler-v06-pd-migration-test-kserve-5c87756974-tnfnw |
AddedInterface |
Add eth0 [10.132.0.65/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-tnfnw |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-pd-migration-test-kserve-5c87756974 |
SuccessfulCreate |
Created pod: scheduler-v06-pd-migration-test-kserve-5c87756974-tnfnw | |
kserve-ci-e2e-test |
multus |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-cf8ht |
AddedInterface |
Add eth0 [10.133.0.52/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-cf8ht |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-v06-pd-migration-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-pd-migration-test-epp-sa | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847 |
SuccessfulCreate |
Created pod: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-cf8ht | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-pd-migration-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-pd-migration-test-kserve-router-scheduler-59dc679cd |
SuccessfulCreate |
Created pod: scheduler-v06-pd-migration-test-kserve-router-scheduler-59hpg5t | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-pd-migration-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-pd-migration-test-kserve-5c87756974 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-tnfnw |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" in 719ms (719ms including waiting). Image size: 44914394 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-tnfnw |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-tnfnw |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-tnfnw |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-tnfnw |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-tnfnw |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-59hpg5t |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" | |
kserve-ci-e2e-test |
multus |
scheduler-v06-pd-migration-test-kserve-router-scheduler-59hpg5t |
AddedInterface |
Add eth0 [10.133.0.53/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-cf8ht |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-cf8ht |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-59hpg5t |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-59hpg5t |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" in 1.105s (1.105s including waiting). Image size: 75073927 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-59hpg5t |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-v06-pd-migration-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-tnfnw |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-tnfnw |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-cf8ht |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-59hpg5t |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-59hpg5t |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-v06-pd-migration-test-epp-auth-rb | |
| (x13) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.67:8000/health": dial tcp 10.134.0.67:8000: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
AllGroupsReady |
All replicas are ready, with 1 groups ready of total 1 groups |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-dc21cb14] is Ready | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-v06-threshold-migration-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-v06-threshold-migration-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-v06-threshold-migration-test-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5c6bfv |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-9k996 |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-9k996 |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-threshold-migration-test-kserve-5994569d5b |
SuccessfulCreate |
Created pod: scheduler-v06-threshold-migration-test-kserve-5994569d5b-9k996 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc599dc49 |
SuccessfulCreate |
Created pod: scheduler-v06-threshold-migration-test-kserve-prefill-5fc5c6bfv | |
kserve-ci-e2e-test |
multus |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5c6bfv |
AddedInterface |
Add eth0 [10.133.0.54/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test0a07e82be2036793543b2d3db2ea0785-scheduler-v0 | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5c6bfv |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5c6bfv |
Started |
Started container main | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-threshold-migration-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-threshold-migration-test-kserve-prefill-5fc599dc49 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-threshold-migration-test-kserve-router-scheduler-dbc65f645 |
SuccessfulCreate |
Created pod: scheduler-v06-threshold-migration-test-kserve-router-sched4tk44 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-threshold-migration-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-threshold-migration-test-kserve-router-scheduler-dbc65f645 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-threshold-migration-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-threshold-migration-test-kserve-5994569d5b from 0 to 1 | |
kserve-ci-e2e-test |
multus |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-9k996 |
AddedInterface |
Add eth0 [10.132.0.66/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-9k996 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-sched4tk44 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-sched4tk44 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-sched4tk44 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
multus |
scheduler-v06-threshold-migration-test-kserve-router-sched4tk44 |
AddedInterface |
Add eth0 [10.133.0.55/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-9k996 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-9k996 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-9k996 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche7vr9r |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test386bd5808c5c450f11fd8632e1f821fb-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche7vr9r |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Killing |
Stopping container main | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-v06-threshold-migration-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-9k996 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5c6bfv |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-9k996 |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-sched4tk44 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test0a07e82be2036793543b2d3db2ea0785-scheduler-v0 | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-sched4tk44 |
FailedPreStopHook |
PreStopHook failed | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-inline-config-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-inline-config-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-inline-config-test-kserve-route" not found |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-inline-config-test-kserve-router-scheduler-d9ddf6c4d |
SuccessfulCreate |
Created pod: scheduler-inline-config-test-kserve-router-scheduler-d9ddfb42pr | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-inline-config-test-epp-role | |
kserve-ci-e2e-test |
multus |
scheduler-inline-config-test-kserve-7c6c58cc96-94kmg |
AddedInterface |
Add eth0 [10.134.0.69/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-94kmg |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-inline-config-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-inline-config-test-kserve-router-scheduler-d9ddf6c4d from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-inline-config-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-inline-config-test-kserve-7c6c58cc96 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-epp-service | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-inline-config-test-kserve-7c6c58cc96 |
SuccessfulCreate |
Created pod: scheduler-inline-config-test-kserve-7c6c58cc96-94kmg | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-inline-config-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-94kmg |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-94kmg |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-inline-config-test-epp-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d9ddfb42pr |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
multus |
scheduler-inline-config-test-kserve-router-scheduler-d9ddfb42pr |
AddedInterface |
Add eth0 [10.134.0.70/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d9ddfb42pr |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d9ddfb42pr |
Created |
Created container: main | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-inline-config-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4t4h8n |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-service | |
kserve-ci-e2e-test |
multus |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4t4h8n |
AddedInterface |
Add eth0 [10.133.0.56/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4t4h8n |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler-79866dc455 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler-79866dc455 |
SuccessfulCreate |
Created pod: llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche8zhmt | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4t4h8n |
Created |
Created container: main | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4 |
SuccessfulCreate |
Created pod: llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4t4h8n | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test80f99418f0f3eb4c80f02e6144a6d4f2-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler | |
kserve-ci-e2e-test |
multus |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche8zhmt |
AddedInterface |
Add eth0 [10.132.0.67/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche8zhmt |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche8zhmt |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche8zhmt |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-inline-config-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d9ddfb42pr |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d9ddfb42pr |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-94kmg |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-4c1ba212] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test80f99418f0f3eb4c80f02e6144a6d4f2-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche8zhmt |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche8zhmt |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4t4h8n |
Killing |
Stopping container main |