| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
router-gateway-1-openshift-default-54c47cdfc7-rs72c |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-rs72c to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-54c47cdfc7-hb6xz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-hb6xz to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-97l8n |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-97l8n to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-4l7qk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-4l7qk to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5j9qhd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5j9qhd to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-745fc78d48-m5r6h |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-745fc78d48-m5r6h to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-745fc78d48-mrzcn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-745fc78d48-mrzcn to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d9h92n |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d9h92n to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5 to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
auth-disabled-test-kserve-router-scheduler-565d6d8849-8sgkm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-disabled-test-kserve-router-scheduler-565d6d8849-8sgkm to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-router-scheduler-5c8954f69-2fnp4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-5c8954f69-2fnp4 to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-5c5cfcf776-8vkw8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-8vkw8 to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-router-scheduler-5c8954f69-mh7p2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-5c8954f69-mh7p2 to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-custom-template-test-kserve-router-scheduler-567695vv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567695vv to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
tls-verification-test-kserve-6799cd4648-xlzj2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/tls-verification-test-kserve-6799cd4648-xlzj2 to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
tls-verification-test-kserve-router-scheduler-655f6fd4c7-4557t |
Scheduled |
Successfully assigned kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-655f6fd4c7-4557t to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
rolling-upgrade-test-kserve-54bc76f55b-45st6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-45st6 to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
rolling-upgrade-test-kserve-859df57bcb-dpmdh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-dpmdh to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-test-kserve-router-scheduler-5955866cj96wq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5955866cj96wq to ip-10-0-141-44.ec2.internal | ||
kuadrant-system |
authorino-7c77957575-czzst |
Scheduled |
Successfully assigned kuadrant-system/authorino-7c77957575-czzst to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79vbf2x |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79vbf2x to ip-10-0-132-16.ec2.internal | ||
kuadrant-system |
dns-operator-controller-manager-65b49595d7-rc99j |
Scheduled |
Successfully assigned kuadrant-system/dns-operator-controller-manager-65b49595d7-rc99j to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dbbtfs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dbbtfs to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4h5s4w |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4h5s4w to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-configmap-ref-test-kserve-router-scheduler-68f879pk76 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f879pk76 to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-s9q6h |
Scheduled |
Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-s9q6h to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-test-kserve-b964bcdd-z2m45 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-b964bcdd-z2m45 to ip-10-0-132-16.ec2.internal | ||
kuadrant-system |
authorino-8df697c9f-cg5dt |
Scheduled |
Successfully assigned kuadrant-system/authorino-8df697c9f-cg5dt to ip-10-0-141-44.ec2.internal | ||
kuadrant-system |
authorino-operator-6d85f6564-tsj82 |
Scheduled |
Successfully assigned kuadrant-system/authorino-operator-6d85f6564-tsj82 to ip-10-0-141-118.ec2.internal | ||
kuadrant-system |
kuadrant-operator-controller-manager-bb7ddb7d7-z679n |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-z679n to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
e2e-pvc-model-download-q2skc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/e2e-pvc-model-download-q2skc to ip-10-0-141-44.ec2.internal | ||
kuadrant-system |
authorino-b6c89bb85-d9kpg |
Scheduled |
Successfully assigned kuadrant-system/authorino-b6c89bb85-d9kpg to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-configmap-ref-test-kserve-744bf59fbd-p9jvd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-p9jvd to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-test-kserve-router-scheduler-5b9d496c6c-9xznb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5b9d496c6c-9xznb to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-test-kserve-5f8f4fd684-jp6nc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-5f8f4fd684-jp6nc to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-router-scheduler-549db8f6f92qng |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-549db8f6f92qng to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
auth-enabled-test-kserve-7d99555666-77kds |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-enabled-test-kserve-7d99555666-77kds to ip-10-0-132-16.ec2.internal | ||
openshift-ingress |
router-default-5bc67f59d-8gfgw |
Scheduled |
Successfully assigned openshift-ingress/router-default-5bc67f59d-8gfgw to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l to ip-10-0-141-118.ec2.internal | ||
kuadrant-system |
kuadrant-console-plugin-85fd4b8b9d-rqdm2 |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-rqdm2 to ip-10-0-141-118.ec2.internal | ||
kuadrant-system |
limitador-limitador-69574b596d-t6fxz |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-69574b596d-t6fxz to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
prestop-hook-test-kserve-router-scheduler-5f5849dc8f-wlflw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-5f5849dc8f-wlflw to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5 to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-router-scheduler-6c664d56p6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6c664d56p6 to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bf6wbv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bf6wbv to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-775b7467d7gkzsf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-775b7467d7gkzsf to ip-10-0-132-16.ec2.internal | ||
openshift-ingress |
openshift-ai-inference-openshift-default-866675cbb8-cvzqk |
Scheduled |
Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-866675cbb8-cvzqk to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmz2ph |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmz2ph to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddhqdr7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddhqdr7 to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
auth-enabled-test-kserve-router-scheduler-6f9bd5659b-zpjht |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-6f9bd5659b-zpjht to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-6ghzv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-6ghzv to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-inline-config-test-kserve-7c6c58cc96-wfsdw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-wfsdw to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4z99mg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4z99mg to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesxccr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesxccr to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-78595fb58d-pb8bv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-78595fb58d-pb8bv to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879x5hm6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879x5hm6 to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schepcjxs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schepcjxs to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schedcjmk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schedcjmk to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4 to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scherv8q8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scherv8q8 to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-54c47cdfc7-s6w2m |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-s6w2m to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-d7xqv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-d7xqv to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj to ip-10-0-141-118.ec2.internal | ||
kuadrant-system |
limitador-limitador-ff68ff5cb-5wssx |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-ff68ff5cb-5wssx to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
prestop-hook-test-kserve-5c66d6b7c6-wq7jj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-5c66d6b7c6-wq7jj to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-799f46c59b-6hn7v |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-6hn7v to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-799f46c59b-9zb2v |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-9zb2v to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-prefill-749f64cc84-rf4dw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-749f64cc84-rf4dw to ip-10-0-132-16.ec2.internal | ||
kuadrant-system |
limitador-operator-controller-manager-6f9f468797-xh7g7 |
Scheduled |
Successfully assigned kuadrant-system/limitador-operator-controller-manager-6f9f468797-xh7g7 to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-f445c495-vthvl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-f445c495-vthvl to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5cc9f5567d5bzm4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5cc9f5567d5bzm4 to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
prestop-hook-test-kserve-5c66d6b7c6-hnjkg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-5c66d6b7c6-hnjkg to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheh4528 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheh4528 to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-7948w2q |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-7948w2q to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schelrzbf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schelrzbf to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4khzx2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4khzx2 to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexshdm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexshdm to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-799f46c59b-bswgn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-bswgn to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheztzw7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheztzw7 to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schett6vl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schett6vl to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-prefill-84464f6744-knbm4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-84464f6744-knbm4 to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-84dc4d978f-8wd4k |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-84dc4d978f-8wd4k to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-2-openshift-default-684dc9b4b9-nkv2c |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nkv2c to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-fbc5f5d46-c2vcs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-fbc5f5d46-c2vcs to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
auth-invalid-token-test-kserve-router-scheduler-6b9cbc8d98dtpp4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-invalid-token-test-kserve-router-scheduler-6b9cbc8d98dtpp4 to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-56cbd96798-zfl5f |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-56cbd96798-zfl5f to ip-10-0-141-44.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-56cbd96798-gjgcf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-56cbd96798-gjgcf to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
lora-single-adapter-test-kserve-84645dc545-rjkj5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/lora-single-adapter-test-kserve-84645dc545-rjkj5 to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
lora-multiple-adapters-test-kserve-857c79454-z99g7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-857c79454-z99g7 to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-799f46c59b-rg72r |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-rg72r to ip-10-0-141-118.ec2.internal | ||
openshift-ingress |
istiod-openshift-gateway-94bb8fbfd-p9b99 |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p9b99 to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-2-openshift-default-54c789bdc6-fz6x9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fz6x9 to ip-10-0-141-118.ec2.internal | ||
kserve-ci-e2e-test |
auth-invalid-token-test-kserve-6c6c746446-f2ppq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-invalid-token-test-kserve-6c6c746446-f2ppq to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-68796975c7-ddffs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-68796975c7-ddffs to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
auth-disabled-test-kserve-5ff8d867d8-w25vd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-disabled-test-kserve-5ff8d867d8-w25vd to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 to ip-10-0-132-16.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 to ip-10-0-141-44.ec2.internal | ||
openshift-ingress |
deployment-controller |
router-default |
ScalingReplicaSet |
Scaled up replica set router-default-5bc67f59d from 0 to 1 | |
openshift-ingress |
service-controller |
router-default |
UnAvailableLoadBalancer |
There are no available nodes for LoadBalancer | |
openshift-ingress |
service-controller |
router-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
service-controller |
router-default |
EnsuredLoadBalancer |
Ensured load balancer | |
| (x12) | openshift-ingress |
replicaset-controller |
router-default-5bc67f59d |
FailedCreate |
Error creating: pods "router-default-5bc67f59d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
| (x16) | openshift-ingress |
replicaset-controller |
router-default-5bc67f59d |
FailedCreate |
Error creating: pods "router-default-5bc67f59d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
| (x3) | openshift-ingress |
service-controller |
router-default |
UpdatedLoadBalancer |
Updated load balancer with new hosts |
openshift-ingress |
replicaset-controller |
router-default-5bc67f59d |
SuccessfulCreate |
Created pod: router-default-5bc67f59d-8gfgw | |
| (x5) | openshift-ingress |
kubelet |
router-default-5bc67f59d-8gfgw |
FailedMount |
MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found |
| (x6) | openshift-ingress |
kubelet |
router-default-5bc67f59d-8gfgw |
FailedMount |
MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt |
openshift-ingress |
multus |
router-default-5bc67f59d-8gfgw |
AddedInterface |
Add eth0 [10.132.0.15/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
router-default-5bc67f59d-8gfgw |
Pulled |
Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0595b1d6de8e08ddb61ce581075357331193db6206d341c15cf213514ef0f693" already present on machine | |
openshift-ingress |
kubelet |
router-default-5bc67f59d-8gfgw |
Created |
Created container: router | |
openshift-ingress |
kubelet |
router-default-5bc67f59d-8gfgw |
Started |
Started container router | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-94bb8fbfd |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-94bb8fbfd-p9b99 | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-94bb8fbfd from 0 to 1 | |
openshift-ingress |
multus |
istiod-openshift-gateway-94bb8fbfd-p9b99 |
AddedInterface |
Add eth0 [10.132.0.34/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-p9b99 |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-p9b99 |
Created |
Created container: discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-p9b99 |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" in 2.486s (2.486s including waiting). Image size: 181034515 bytes. | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-p9b99 |
Started |
Started container discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-p9b99 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-p9b99 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
gateway_labeler_controller |
openshift-ai-inference |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway openshift-ai-inference | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-cvzqk |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
deployment-controller |
openshift-ai-inference-openshift-default |
ScalingReplicaSet |
Scaled up replica set openshift-ai-inference-openshift-default-866675cbb8 from 0 to 1 | |
openshift-ingress |
multus |
openshift-ai-inference-openshift-default-866675cbb8-cvzqk |
AddedInterface |
Add eth0 [10.133.0.18/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
openshift-ai-inference-openshift-default-866675cbb8 |
SuccessfulCreate |
Created pod: openshift-ai-inference-openshift-default-866675cbb8-cvzqk | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-cvzqk |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 4.745s (4.745s including waiting). Image size: 181251556 bytes. | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
InstallWaiting |
installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability. | |
kuadrant-system |
deployment-controller |
authorino-operator |
ScalingReplicaSet |
Scaled up replica set authorino-operator-6d85f6564 from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
InstallSucceeded |
waiting for install components to report healthy | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
replicaset-controller |
authorino-operator-6d85f6564 |
SuccessfulCreate |
Created pod: authorino-operator-6d85f6564-tsj82 | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-tsj82 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:b2cc2c0f0729dad98f970830816e300c0b961ba42491f362295512d886384687" | |
kuadrant-system |
multus |
authorino-operator-6d85f6564-tsj82 |
AddedInterface |
Add eth0 [10.132.0.39/23] from ovn-kubernetes | |
kuadrant-system |
authorino-operator-6d85f6564-tsj82_f0b0da80-3295-4c38-833e-005caeaad878 |
aac3a15d.authorino.kuadrant.io |
LeaderElection |
authorino-operator-6d85f6564-tsj82_f0b0da80-3295-4c38-833e-005caeaad878 became leader | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-tsj82 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:b2cc2c0f0729dad98f970830816e300c0b961ba42491f362295512d886384687" in 2.315s (2.315s including waiting). Image size: 168639631 bytes. | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-tsj82 |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-tsj82 |
Started |
Started container manager | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
multus |
kuadrant-operator-controller-manager-bb7ddb7d7-z679n |
AddedInterface |
Add eth0 [10.132.0.40/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
replicaset-controller |
kuadrant-operator-controller-manager-bb7ddb7d7 |
SuccessfulCreate |
Created pod: kuadrant-operator-controller-manager-bb7ddb7d7-z679n | |
kuadrant-system |
deployment-controller |
kuadrant-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set kuadrant-operator-controller-manager-bb7ddb7d7 from 0 to 1 | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-z679n |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:0b77e4a874b620095a0300877aea53e78559a601ce62b194537ed21c2743bbf3" | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
InstallWaiting |
installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
replicaset-controller |
limitador-operator-controller-manager-6f9f468797 |
SuccessfulCreate |
Created pod: limitador-operator-controller-manager-6f9f468797-xh7g7 | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
deployment-controller |
limitador-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set limitador-operator-controller-manager-6f9f468797 from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-xh7g7 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:183bad2a6f5872aea38f54ad507f7e005d6facb02b18769e0407c82799f96a3e" | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
InstallWaiting |
installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
multus |
limitador-operator-controller-manager-6f9f468797-xh7g7 |
AddedInterface |
Add eth0 [10.134.0.26/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
deployment-controller |
dns-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set dns-operator-controller-manager-65b49595d7 from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
replicaset-controller |
dns-operator-controller-manager-65b49595d7 |
SuccessfulCreate |
Created pod: dns-operator-controller-manager-65b49595d7-rc99j | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-z679n |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:0b77e4a874b620095a0300877aea53e78559a601ce62b194537ed21c2743bbf3" in 4.301s (4.301s including waiting). Image size: 425661757 bytes. | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-rc99j |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ba46f54446ecd3ed1a3d877dcbb7359ff8f2d918827f3411a5cb0781915a65d5" | |
kuadrant-system |
multus |
dns-operator-controller-manager-65b49595d7-rc99j |
AddedInterface |
Add eth0 [10.132.0.41/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-z679n |
Created |
Created container: manager | |
kuadrant-system |
kuadrant-operator-controller-manager-bb7ddb7d7-z679n_0bc958e9-72c6-417e-af04-bbbcef6c353c |
f139389e.kuadrant.io |
LeaderElection |
kuadrant-operator-controller-manager-bb7ddb7d7-z679n_0bc958e9-72c6-417e-af04-bbbcef6c353c became leader | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
InstallWaiting |
installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-z679n |
Started |
Started container manager | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-xh7g7 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:183bad2a6f5872aea38f54ad507f7e005d6facb02b18769e0407c82799f96a3e" in 2.905s (2.905s including waiting). Image size: 178538972 bytes. | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-xh7g7 |
Started |
Started container manager | |
kuadrant-system |
limitador-operator-controller-manager-6f9f468797-xh7g7_85c3a981-bca9-4a33-9e91-d8c72014f862 |
3745a16e.kuadrant.io |
LeaderElection |
limitador-operator-controller-manager-6f9f468797-xh7g7_85c3a981-bca9-4a33-9e91-d8c72014f862 became leader | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-xh7g7 |
Created |
Created container: manager | |
kuadrant-system |
deployment-controller |
kuadrant-console-plugin |
ScalingReplicaSet |
Scaled up replica set kuadrant-console-plugin-85fd4b8b9d from 0 to 1 | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-rqdm2 |
FailedMount |
MountVolume.SetUp failed for volume "plugin-serving-cert" : secret "plugin-serving-cert" not found | |
kuadrant-system |
replicaset-controller |
kuadrant-console-plugin-85fd4b8b9d |
SuccessfulCreate |
Created pod: kuadrant-console-plugin-85fd4b8b9d-rqdm2 | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-rqdm2 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:6e69f41d3d70b0afa7691a5d2400065d3bcdec2ea82830cf2992b8e69ba06e2a" | |
kuadrant-system |
dns-operator-controller-manager-65b49595d7-rc99j_0bb58b88-f043-4ba5-ab46-23bd40472962 |
a3f98d6c.kuadrant.io |
LeaderElection |
dns-operator-controller-manager-65b49595d7-rc99j_0bb58b88-f043-4ba5-ab46-23bd40472962 became leader | |
kuadrant-system |
multus |
kuadrant-console-plugin-85fd4b8b9d-rqdm2 |
AddedInterface |
Add eth0 [10.132.0.42/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-rc99j |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ba46f54446ecd3ed1a3d877dcbb7359ff8f2d918827f3411a5cb0781915a65d5" in 3.933s (3.933s including waiting). Image size: 190472853 bytes. | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-rc99j |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-rc99j |
Started |
Started container manager | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-rqdm2 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:6e69f41d3d70b0afa7691a5d2400065d3bcdec2ea82830cf2992b8e69ba06e2a" in 4.78s (4.78s including waiting). Image size: 342502139 bytes. | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-rqdm2 |
Started |
Started container kuadrant-console-plugin | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-rqdm2 |
Created |
Created container: kuadrant-console-plugin | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-69574b596d from 0 to 1 | |
kuadrant-system |
replicaset-controller |
limitador-limitador-ff68ff5cb |
SuccessfulCreate |
Created pod: limitador-limitador-ff68ff5cb-5wssx | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-ff68ff5cb from 0 to 1 | |
kuadrant-system |
replicaset-controller |
limitador-limitador-69574b596d |
SuccessfulCreate |
Created pod: limitador-limitador-69574b596d-t6fxz | |
kuadrant-system |
multus |
authorino-b6c89bb85-d9kpg |
AddedInterface |
Add eth0 [10.132.0.43/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-5wssx |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" | |
kuadrant-system |
multus |
limitador-limitador-ff68ff5cb-5wssx |
AddedInterface |
Add eth0 [10.133.0.20/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-8df697c9f from 0 to 1 | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-b6c89bb85 from 0 to 1 | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-t6fxz |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" | |
kuadrant-system |
replicaset-controller |
authorino-b6c89bb85 |
SuccessfulCreate |
Created pod: authorino-b6c89bb85-d9kpg | |
kuadrant-system |
replicaset-controller |
authorino-8df697c9f |
SuccessfulCreate |
Created pod: authorino-8df697c9f-cg5dt | |
kuadrant-system |
multus |
limitador-limitador-69574b596d-t6fxz |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-d9kpg |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" | |
kuadrant-system |
multus |
authorino-8df697c9f-cg5dt |
AddedInterface |
Add eth0 [10.133.0.21/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-8df697c9f-cg5dt |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-d9kpg |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-d9kpg |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" in 2.507s (2.507s including waiting). Image size: 202706732 bytes. | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-d9kpg |
Started |
Started container authorino | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-t6fxz |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" in 4.025s (4.025s including waiting). Image size: 250499765 bytes. | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-t6fxz |
Created |
Created container: limitador | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-t6fxz |
Started |
Started container limitador | |
kuadrant-system |
kubelet |
authorino-8df697c9f-cg5dt |
Started |
Started container authorino | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-5wssx |
Created |
Created container: limitador | |
kuadrant-system |
kubelet |
authorino-8df697c9f-cg5dt |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" in 4.406s (4.406s including waiting). Image size: 202706732 bytes. | |
kuadrant-system |
kubelet |
authorino-8df697c9f-cg5dt |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-5wssx |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" in 5.607s (5.607s including waiting). Image size: 250499765 bytes. | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-5wssx |
Started |
Started container limitador | |
kuadrant-system |
replicaset-controller |
authorino-b6c89bb85 |
SuccessfulDelete |
Deleted pod: authorino-b6c89bb85-d9kpg | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-b6c89bb85 from 1 to 0 | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-d9kpg |
Killing |
Stopping container authorino | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-5wssx |
Killing |
Stopping container limitador | |
kuadrant-system |
replicaset-controller |
limitador-limitador-ff68ff5cb |
SuccessfulDelete |
Deleted pod: limitador-limitador-ff68ff5cb-5wssx | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled down replica set limitador-limitador-ff68ff5cb from 1 to 0 | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-7c77957575 from 0 to 1 | |
kuadrant-system |
multus |
authorino-7c77957575-czzst |
AddedInterface |
Add eth0 [10.132.0.44/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-7c77957575-czzst |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" | |
kuadrant-system |
replicaset-controller |
authorino-7c77957575 |
SuccessfulCreate |
Created pod: authorino-7c77957575-czzst | |
kuadrant-system |
kubelet |
authorino-7c77957575-czzst |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-7c77957575-czzst |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" in 498ms (498ms including waiting). Image size: 202706732 bytes. | |
kuadrant-system |
kubelet |
authorino-7c77957575-czzst |
Started |
Started container authorino | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-8df697c9f from 1 to 0 | |
kuadrant-system |
replicaset-controller |
authorino-8df697c9f |
SuccessfulDelete |
Deleted pod: authorino-8df697c9f-cg5dt | |
kuadrant-system |
kubelet |
authorino-8df697c9f-cg5dt |
Killing |
Stopping container authorino | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-54c47cdfc7-rs72c | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-799f46c59b-bswgn | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-rs72c |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-rs72c |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-bswgn |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-54c47cdfc7-rs72c |
AddedInterface |
Add eth0 [10.133.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-799f46c59b-bswgn |
AddedInterface |
Add eth0 [10.133.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-bswgn |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-bswgn |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-rs72c |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-799f46c59b-bswgn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.Secret kserve-ci-e2e-test/gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
kserve-ci-e2e-test |
replicaset-controller |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5 |
SuccessfulCreate |
Created pod: gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
kserve-ci-e2e-test |
multus |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5 |
AddedInterface |
Add eth0 [10.132.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-bswgn |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
deployment-controller |
gw-section-name-router-with-gat-2f0a622e-kserve |
ScalingReplicaSet |
Scaled up replica set gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-route | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.335s (1.335s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-799f46c59b-9zb2v | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-799f46c59b-9zb2v |
AddedInterface |
Add eth0 [10.133.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-rs72c |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-54c47cdfc7-rs72c | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-9zb2v |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-9zb2v |
Started |
Started container istio-proxy |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-9zb2v |
Created |
Created container: istio-proxy |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
precise-prefix-cache-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy precise-prefix-cache-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "precise-prefix-cache-test-kserve-route" not found |
| (x5) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-9zb2v |
Unhealthy |
Startup probe failed: Get "http://10.133.0.27:15021/healthz/ready": dial tcp 10.133.0.27:15021: connect: connection refused |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-56cbd96798-gjgcf |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-56cbd96798-zfl5f |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/precise-prefix-cache-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Role kserve-ci-e2e-test/precise-prefix-cache-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/precise-prefix-cache-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-kserve-workload-svc | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-56cbd96798-zfl5f |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-56cbd96798-zfl5f |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
precise-prefix-cache-test-kserve |
ScalingReplicaSet |
Scaled up replica set precise-prefix-cache-test-kserve-56cbd96798 from 0 to 2 | |
kserve-ci-e2e-test |
deployment-controller |
precise-prefix-cache-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set precise-prefix-cache-test-kserve-router-scheduler-64c46df48 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-56cbd96798-zfl5f |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-56cbd96798 |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-56cbd96798-zfl5f | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-56cbd96798 |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-56cbd96798-gjgcf | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-router-scheduler-64c46df48 |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-56cbd96798-gjgcf |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5wqrb5 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" in 1.548s (1.548s including waiting). Image size: 75073927 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-56cbd96798-gjgcf |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-56cbd96798-gjgcf |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" in 3.683s (3.683s including waiting). Image size: 301879232 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1" | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-56cbd96798-gjgcf |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-56cbd96798-zfl5f |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-56cbd96798-zfl5f |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 2.521s (2.521s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-56cbd96798-zfl5f |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-56cbd96798-gjgcf |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-56cbd96798-zfl5f |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bf6wbv |
Created |
Created container: main | |
kserve-ci-e2e-test |
deployment-controller |
gw-section-name-router-with-gat-f1d92d0f-kserve |
ScalingReplicaSet |
Scaled up replica set gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b |
SuccessfulCreate |
Created pod: gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bf6wbv | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.Secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-56cbd96798-gjgcf |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.022s (1.022s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bf6wbv |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bf6wbv |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bf6wbv |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-56cbd96798-gjgcf |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-56cbd96798-gjgcf |
Created |
Created container: main | |
| (x2) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-cvzqk |
Started |
Started container istio-proxy |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-cvzqk |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
| (x2) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-cvzqk |
Created |
Created container: istio-proxy |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-54c47cdfc7-s6w2m | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-54c47cdfc7-s6w2m |
AddedInterface |
Add eth0 [10.132.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-s6w2m |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-s6w2m |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 2.506s (2.506s including waiting). Image size: 181251556 bytes. | |
| (x6) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-cvzqk |
Unhealthy |
Startup probe failed: Get "http://10.133.0.18:15021/healthz/ready": dial tcp 10.133.0.18:15021: connect: connection refused |
| (x6) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-cvzqk |
ProbeError |
Startup probe error: Get "http://10.133.0.18:15021/healthz/ready": dial tcp 10.133.0.18:15021: connect: connection refused body: |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-799f46c59b-9zb2v | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-9zb2v |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/precise-prefix-cache-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bf6wbv |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-9zb2v |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.27:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-enabled-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7d99555666-77kds |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
deployment-controller |
auth-enabled-test-kserve |
ScalingReplicaSet |
Scaled up replica set auth-enabled-test-kserve-7d99555666 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-enabled-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/auth-enabled-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-enabled-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-enabled-test-kserve | |
kserve-ci-e2e-test |
multus |
auth-enabled-test-kserve-7d99555666-77kds |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Role kserve-ci-e2e-test/auth-enabled-test-epp-role | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7d99555666-77kds |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7d99555666-77kds |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
auth-enabled-test-kserve-7d99555666 |
SuccessfulCreate |
Created pod: auth-enabled-test-kserve-7d99555666-77kds | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Secret kserve-ci-e2e-test/auth-enabled-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/auth-enabled-test-epp-rb | |
kserve-ci-e2e-test |
replicaset-controller |
auth-enabled-test-kserve-router-scheduler-6f9bd5659b |
SuccessfulCreate |
Created pod: auth-enabled-test-kserve-router-scheduler-6f9bd5659b-zpjht | |
kserve-ci-e2e-test |
deployment-controller |
auth-enabled-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set auth-enabled-test-kserve-router-scheduler-6f9bd5659b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t |
Started |
Started container tokenizer | |
| (x2) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t |
Created |
Created container: main |
| (x2) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t |
Started |
Started container main |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1" in 33.527s (33.527s including waiting). Image size: 2989890188 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
multus |
auth-enabled-test-kserve-router-scheduler-6f9bd5659b-zpjht |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6f9bd5659b-zpjht |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6f9bd5659b-zpjht |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6f9bd5659b-zpjht |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6f9bd5659b-zpjht |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6f9bd5659b-zpjht |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6f9bd5659b-zpjht |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7d99555666-77kds |
Pulling |
Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t |
Unhealthy |
Liveness probe failed: timeout: failed to connect service "10.133.0.29:9003" within 1s: context deadline exceeded | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/auth-enabled-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/auth-enabled-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-enabled-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7d99555666-77kds |
Pulled |
Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" in 26.831s (26.831s including waiting). Image size: 3531177328 bytes. | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7d99555666-77kds |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7d99555666-77kds |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
LLMInferenceServiceReady |
LLMInferenceService [precise-prefix-cache-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-56cbd96798-gjgcf |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-64c46df4zp66t |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-56cbd96798-zfl5f |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-router-managed-test-llm-e45d1f79 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-e45d1f79-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-e45d1f79-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-router-managed-test-llm-e45d1f79-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879 |
SuccessfulCreate |
Created pod: llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879x5hm6 | |
kserve-ci-e2e-test |
multus |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879x5hm6 |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-role | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler-5dd88bfbb7 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler-5dd88bfbb7 |
SuccessfulCreate |
Created pod: llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-service | |
kserve-ci-e2e-test |
multus |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf |
AddedInterface |
Add eth0 [10.132.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testef4d2875be14b30dc1561ed84d0d4bde-llmisvc-rout | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-sa | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879x5hm6 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879x5hm6 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879x5hm6 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" in 1.769s (1.769s including waiting). Image size: 75073927 bytes. | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879x5hm6 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testef4d2875be14b30dc1561ed84d0d4bde-llmisvc-rout | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-router-managed-test-llm-e45d1f79] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schem88rf |
FailedPreStopHook |
PreStopHook failed | |
| (x10) | kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7d99555666-77kds |
Unhealthy |
Startup probe failed: Get "https://10.134.0.30:8000/health": dial tcp 10.134.0.30:8000: connect: connection refused |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-router-managed-test-llm-5b1e8f15 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-5b1e8f15-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-5b1e8f15-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-router-managed-test-llm-5b1e8f15-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4z99mg |
AddedInterface |
Add eth0 [10.133.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-sa | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp |
AddedInterface |
Add eth0 [10.132.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4 |
SuccessfulCreate |
Created pod: llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4z99mg | |
kserve-ci-e2e-test |
deployment-controller |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler-749449dbc8 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4z99mg |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4z99mg |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4z99mg |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test7f54e84970003a6e7372bdbcb574f7ed-llmisvc-rout | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-role | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler-749449dbc8 |
SuccessfulCreate |
Created pod: llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
LLMInferenceServiceReady |
LLMInferenceService [auth-enabled-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-enabled-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6f9bd5659b-zpjht |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6f9bd5659b-zpjht |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7d99555666-77kds |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-router-managed-test-llm-5b1e8f15] is Ready | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7d99555666-77kds |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.30:8000/health": dial tcp 10.134.0.30:8000: connect: connection refused | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-service | |
kserve-ci-e2e-test |
deployment-controller |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler-6d86bd4d9d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler-6d86bd4d9d |
SuccessfulCreate |
Created pod: llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheztzw7 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd |
SuccessfulCreate |
Created pod: llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddhqdr7 | |
kserve-ci-e2e-test |
multus |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddhqdr7 |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddhqdr7 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddhqdr7 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddhqdr7 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testb7025ca4d8a6f8f5b2fd08b5581d2678-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-rb | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheztzw7 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheztzw7 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheztzw7 |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheztzw7 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-invalid-token-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Secret kserve-ci-e2e-test/auth-invalid-token-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-invalid-token-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
auth-invalid-token-test-kserve |
ScalingReplicaSet |
Scaled up replica set auth-invalid-token-test-kserve-6c6c746446 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
auth-invalid-token-test-kserve-6c6c746446 |
SuccessfulCreate |
Created pod: auth-invalid-token-test-kserve-6c6c746446-f2ppq | |
kserve-ci-e2e-test |
replicaset-controller |
auth-invalid-token-test-kserve-router-scheduler-6b9cbc8d98 |
SuccessfulCreate |
Created pod: auth-invalid-token-test-kserve-router-scheduler-6b9cbc8d98dtpp4 | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-6c6c746446-f2ppq |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/auth-invalid-token-test-epp-sa | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-6b9cbc8d98dtpp4 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-invalid-token-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-6b9cbc8d98dtpp4 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-6c6c746446-f2ppq |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
auth-invalid-token-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set auth-invalid-token-test-kserve-router-scheduler-6b9cbc8d98 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-6c6c746446-f2ppq |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Role kserve-ci-e2e-test/auth-invalid-token-test-epp-role | |
kserve-ci-e2e-test |
multus |
auth-invalid-token-test-kserve-router-scheduler-6b9cbc8d98dtpp4 |
AddedInterface |
Add eth0 [10.133.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/auth-invalid-token-test-epp-rb | |
kserve-ci-e2e-test |
multus |
auth-invalid-token-test-kserve-6c6c746446-f2ppq |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-invalid-token-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-invalid-token-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-6b9cbc8d98dtpp4 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-6b9cbc8d98dtpp4 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-6b9cbc8d98dtpp4 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-6b9cbc8d98dtpp4 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-6c6c746446-f2ppq |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-6c6c746446-f2ppq |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-6c6c746446-f2ppq |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-a50492e9] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/auth-invalid-token-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/auth-invalid-token-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-invalid-token-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testb7025ca4d8a6f8f5b2fd08b5581d2678-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheztzw7 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheztzw7 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddhqdr7 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4z99mg |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test7f54e84970003a6e7372bdbcb574f7ed-llmisvc-rout | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schejlxsp |
Killing |
Stopping container main | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-router-managed-test-llm-4b931143 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-4b931143-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-4b931143-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-router-managed-test-llm-4b931143-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler-68cc9685d6 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56 |
SuccessfulCreate |
Created pod: llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-6ghzv | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test8ac8e3d2264ccb939eb021b0b835847c-llmisvc-rout | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-service | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-6ghzv |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m |
AddedInterface |
Add eth0 [10.132.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m |
Created |
Created container: main | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler-68cc9685d6 |
SuccessfulCreate |
Created pod: llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-6ghzv |
AddedInterface |
Add eth0 [10.133.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-6ghzv |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-6ghzv |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-router-managed-test-llm-4b931143] is Ready | |
| (x11) | kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-6c6c746446-f2ppq |
Unhealthy |
Startup probe failed: Get "https://10.134.0.32:8000/health": dial tcp 10.134.0.32:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
LLMInferenceServiceReady |
LLMInferenceService [auth-invalid-token-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-6c6c746446-f2ppq |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-6b9cbc8d98dtpp4 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-6b9cbc8d98dtpp4 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-invalid-token-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-6c6c746446-f2ppq |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.32:8000/health": dial tcp 10.134.0.32:8000: connect: connection refused | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
auth-disabled-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy auth-disabled-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/auth-disabled-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "auth-disabled-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-disabled-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-disabled-test-kserve | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-5ff8d867d8-w25vd |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-5ff8d867d8-w25vd |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
auth-disabled-test-kserve-5ff8d867d8 |
SuccessfulCreate |
Created pod: auth-disabled-test-kserve-5ff8d867d8-w25vd | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-5ff8d867d8-w25vd |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
auth-disabled-test-kserve |
ScalingReplicaSet |
Scaled up replica set auth-disabled-test-kserve-5ff8d867d8 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Secret kserve-ci-e2e-test/auth-disabled-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
auth-disabled-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set auth-disabled-test-kserve-router-scheduler-565d6d8849 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/auth-disabled-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-disabled-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/auth-disabled-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-disabled-test-epp-auth-rb | |
kserve-ci-e2e-test |
multus |
auth-disabled-test-kserve-5ff8d867d8-w25vd |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
auth-disabled-test-kserve-router-scheduler-565d6d8849 |
SuccessfulCreate |
Created pod: auth-disabled-test-kserve-router-scheduler-565d6d8849-8sgkm | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Role kserve-ci-e2e-test/auth-disabled-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-disabled-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-565d6d8849-8sgkm |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-565d6d8849-8sgkm |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
auth-disabled-test-kserve-router-scheduler-565d6d8849-8sgkm |
AddedInterface |
Add eth0 [10.133.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-565d6d8849-8sgkm |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-565d6d8849-8sgkm |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-565d6d8849-8sgkm |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-565d6d8849-8sgkm |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-5ff8d867d8-w25vd |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-5ff8d867d8-w25vd |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-5ff8d867d8-w25vd |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/auth-disabled-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/auth-disabled-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-disabled-test-kserve-shadow-svc |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-service | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmz2ph |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmz2ph |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test76d7f532acb694e4a7bcef75d32cd8a1-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler-6fcb489785 |
SuccessfulCreate |
Created pod: llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schepcjxs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler-6fcb489785 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmz2ph |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmz2ph |
AddedInterface |
Add eth0 [10.133.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f |
SuccessfulCreate |
Created pod: llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmz2ph | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-rb | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schepcjxs |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" | |
kserve-ci-e2e-test |
multus |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schepcjxs |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schepcjxs |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schepcjxs |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schepcjxs |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" in 11.153s (11.153s including waiting). Image size: 75073927 bytes. | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schepcjxs |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schepcjxs |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fmz2ph |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test76d7f532acb694e4a7bcef75d32cd8a1-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-4f8c0978] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test8ac8e3d2264ccb939eb021b0b835847c-llmisvc-rout | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schetvb8m |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-6ghzv |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-f445c495 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-7ca60146-kserve-f445c495-vthvl | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-f445c495-vthvl |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-f445c495-vthvl |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-f445c495-vthvl |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-f445c495-vthvl |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-role | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler-7f5c854898 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schedcjmk | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler-7f5c854898 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-7ca60146-kserve-f445c495 from 0 to 1 | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test5216bfd716f919dc046bc693ceb22e41-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schedcjmk |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schedcjmk |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schedcjmk |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schedcjmk |
AddedInterface |
Add eth0 [10.133.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schedcjmk |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schedcjmk |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schedcjmk |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-f445c495-vthvl |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-f445c495-vthvl |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-f445c495-vthvl |
Created |
Created container: main | |
| (x11) | kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-5ff8d867d8-w25vd |
Unhealthy |
Startup probe failed: Get "https://10.134.0.33:8000/health": dial tcp 10.134.0.33:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
LLMInferenceServiceReady |
LLMInferenceService [auth-disabled-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-disabled-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-565d6d8849-8sgkm |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-565d6d8849-8sgkm |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-5ff8d867d8-w25vd |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-5ff8d867d8-w25vd |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.33:8000/health": dial tcp 10.134.0.33:8000: connect: connection refused | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-799f46c59b-rg72r | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-rg72r |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-rg72r |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-rg72r |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-799f46c59b-rg72r |
AddedInterface |
Add eth0 [10.132.0.51/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-799f46c59b-rg72r | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-rg72r |
Killing |
Stopping container istio-proxy | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4khzx2 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4khzx2 |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4khzx2 |
AddedInterface |
Add eth0 [10.133.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4khzx2 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4khzx2 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-s6w2m |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.47:15021/healthz/ready": read tcp 10.132.0.2:52664->10.132.0.47:15021: read: connection reset by peer | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-s6w2m |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-s6w2m |
Created |
Created container: istio-proxy |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-s6w2m |
Started |
Started container istio-proxy |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-e95b1dc1] is Ready | |
| (x7) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-f445c495-vthvl |
Unhealthy |
Startup probe failed: Get "https://10.134.0.35:8000/health": dial tcp 10.134.0.35:8000: connect: connection refused |
| (x6) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-s6w2m |
Unhealthy |
Startup probe failed: Get "http://10.132.0.47:15021/healthz/ready": dial tcp 10.132.0.47:15021: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4khzx2 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-with-7ca60146] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-87882a8e-kserve-fbc5f5d46 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-fbc5f5d46 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-87882a8e-kserve-fbc5f5d46-c2vcs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test21fe6730fe484f3a92b1a16afe1bac8f-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-fbc5f5d46-c2vcs |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexshdm |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-fbc5f5d46-c2vcs |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler-66ddf487d4 |
SuccessfulCreate |
Created pod: llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexshdm | |
kserve-ci-e2e-test |
deployment-controller |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler-66ddf487d4 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexshdm |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-role | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-fbc5f5d46-c2vcs |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexshdm |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-87882a8e |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route" not found |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-fbc5f5d46-c2vcs |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexshdm |
AddedInterface |
Add eth0 [10.133.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexshdm |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexshdm |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test5216bfd716f919dc046bc693ceb22e41-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-f445c495-vthvl |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexshdm |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schedcjmk |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schedcjmk |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schedcjmk |
Unhealthy |
Readiness probe failed: timeout: failed to connect service "10.133.0.38:9003" within 1s: context deadline exceeded | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-fbc5f5d46-c2vcs |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-fbc5f5d46-c2vcs |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-fbc5f5d46-c2vcs |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-f445c495-vthvl |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.35:8000/health": dial tcp 10.134.0.35:8000: connect: connection refused | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-workload-svc | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-78595fb58d from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test05addb65ba05195619f26ef266e8fc04-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-78595fb58d |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-78595fb58d-pb8bv | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler-684fcd8f47 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesxccr | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-role | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesxccr |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesxccr |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesxccr |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-rb | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler-684fcd8f47 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-78595fb58d-pb8bv |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-78595fb58d-pb8bv |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-78595fb58d-pb8bv |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-78595fb58d-pb8bv |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesxccr |
AddedInterface |
Add eth0 [10.133.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesxccr |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesxccr |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesxccr |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-78595fb58d-pb8bv |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-78595fb58d-pb8bv |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-78595fb58d-pb8bv |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-shadow-svc |
| (x7) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-78595fb58d-pb8bv |
Unhealthy |
Startup probe failed: Get "https://10.134.0.37:8000/health": dial tcp 10.134.0.37:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-with-ba4d693a] is Ready | |
| (x11) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-fbc5f5d46-c2vcs |
Unhealthy |
Startup probe failed: Get "https://10.134.0.36:8000/health": dial tcp 10.134.0.36:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-87882a8e] is Ready | |
kserve-ci-e2e-test |
persistentvolume-controller |
e2e-pvc-model-storage |
WaitForFirstConsumer |
waiting for first consumer to be created before binding | |
kserve-ci-e2e-test |
job-controller |
e2e-pvc-model-download |
SuccessfulCreate |
Created pod: e2e-pvc-model-download-q2skc | |
kserve-ci-e2e-test |
ebs.csi.aws.com_aws-ebs-csi-driver-controller-dd59db487-g72gz_a10a608b-6bf3-4a24-b0f7-39a0023201c6 |
e2e-pvc-model-storage |
Provisioning |
External provisioner is provisioning volume for claim "kserve-ci-e2e-test/e2e-pvc-model-storage" | |
kserve-ci-e2e-test |
persistentvolume-controller |
e2e-pvc-model-storage |
ExternalProvisioning |
Waiting for a volume to be created either by the external provisioner 'ebs.csi.aws.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test21fe6730fe484f3a92b1a16afe1bac8f-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexshdm |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexshdm |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-fbc5f5d46-c2vcs |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
ebs.csi.aws.com_aws-ebs-csi-driver-controller-dd59db487-g72gz_a10a608b-6bf3-4a24-b0f7-39a0023201c6 |
e2e-pvc-model-storage |
ProvisioningSucceeded |
Successfully provisioned volume pvc-d2189ca3-9cab-4233-b265-8aa73aeb27a0 | |
kserve-ci-e2e-test |
attachdetach-controller |
e2e-pvc-model-download-q2skc |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-d2189ca3-9cab-4233-b265-8aa73aeb27a0" | |
kserve-ci-e2e-test |
kubelet |
e2e-pvc-model-download-q2skc |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
e2e-pvc-model-download-q2skc |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
e2e-pvc-model-download-q2skc |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
e2e-pvc-model-download-q2skc |
AddedInterface |
Add eth0 [10.133.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
job-controller |
e2e-pvc-model-download |
Completed |
Job completed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-fbc5f5d46-c2vcs |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.36:8000/health": dial tcp 10.134.0.36:8000: connect: connection refused | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-pvc-router-manage-59b9d263 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-59b9d263-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-59b9d263-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-sa | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler-5f555d4d85 |
SuccessfulCreate |
Created pod: llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schelrzbf | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testc9569cf4801efc0ed27b2f25ffaee875-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d |
SuccessfulCreate |
Created pod: llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dbbtfs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-pvc-router-manage-59b9d263-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-service | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler-5f555d4d85 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv8bf079eb6eda4debfb4ef5bb7817824c-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schelrzbf |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schelrzbf |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schelrzbf |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schelrzbf |
AddedInterface |
Add eth0 [10.133.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dbbtfs |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-d2189ca3-9cab-4233-b265-8aa73aeb27a0" | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schelrzbf |
FailedAttachVolume |
Multi-Attach error for volume "pvc-d2189ca3-9cab-4233-b265-8aa73aeb27a0" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dbbtfs | |
| (x14) | kserve-ci-e2e-test |
OpenDataHubModelController |
custom-route-timeout-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-test-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dbbtfs |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dbbtfs |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dbbtfs |
Created |
Created container: main | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dbbtfs |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-test-kserve-b964bcdd |
SuccessfulCreate |
Created pod: custom-route-timeout-test-kserve-b964bcdd-z2m45 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Role kserve-ci-e2e-test/custom-route-timeout-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-test-kserve |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-test-kserve-b964bcdd from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-test-kserve-router-scheduler-5955866c99 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-5955866cj96wq |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-5955866cj96wq |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-test-kserve-b964bcdd-z2m45 |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-b964bcdd-z2m45 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-test-kserve-router-scheduler-5955866c99 |
SuccessfulCreate |
Created pod: custom-route-timeout-test-kserve-router-scheduler-5955866cj96wq | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-b964bcdd-z2m45 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-test-epp-rb | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-test-kserve-router-scheduler-5955866cj96wq |
AddedInterface |
Add eth0 [10.133.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-b964bcdd-z2m45 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-5955866cj96wq |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-5955866cj96wq |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-5955866cj96wq |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-5955866cj96wq |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-b964bcdd-z2m45 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-b964bcdd-z2m45 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-b964bcdd-z2m45 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv8bf079eb6eda4debfb4ef5bb7817824c-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-test-kserve-shadow-svc |
| (x14) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dbbtfs |
Unhealthy |
Startup probe failed: Get "https://10.134.0.38:8000/health": dial tcp 10.134.0.38:8000: connect: connection refused |
| (x14) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-b964bcdd-z2m45 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.39:8000/health": dial tcp 10.134.0.39:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-pvc-router-manage-59b9d263] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dbbtfs |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schelrzbf |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testc9569cf4801efc0ed27b2f25ffaee875-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schelrzbf |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
LLMInferenceServiceReady |
LLMInferenceService [custom-route-timeout-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-b964bcdd-z2m45 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-5955866cj96wq |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-5955866cj96wq |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dbbtfs |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.38:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c |
SuccessfulCreate |
Created pod: llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-d7xqv | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testf5d060a5eb39a04e074b78907a1556a6-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-epp-sa | |
kserve-ci-e2e-test |
deployment-controller |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler-67b4bb9646 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79497db4cc from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvb19f98874e050eec8ca94d49676113f0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79497db4cc |
SuccessfulCreate |
Created pod: llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79vbf2x | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schett6vl |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-pvc-router-manage-e8706282 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-e8706282-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-e8706282-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schett6vl |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schett6vl |
Created |
Created container: main | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler-67b4bb9646 |
SuccessfulCreate |
Created pod: llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schett6vl | |
kserve-ci-e2e-test |
multus |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schett6vl |
AddedInterface |
Add eth0 [10.133.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79vbf2x |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-d2189ca3-9cab-4233-b265-8aa73aeb27a0" | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-799f46c59b-6hn7v | |
| (x4) | kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-1-openshift-default-799f46c59b from 0 to 1 |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schett6vl |
FailedAttachVolume |
Multi-Attach error for volume "pvc-d2189ca3-9cab-4233-b265-8aa73aeb27a0" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-d7xqv, llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79vbf2x | |
| (x4) | kserve-ci-e2e-test |
gateway_labeler_controller |
router-gateway-1 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway router-gateway-1 |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-d7xqv |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-d2189ca3-9cab-4233-b265-8aa73aeb27a0" | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-6hn7v |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-799f46c59b-6hn7v |
AddedInterface |
Add eth0 [10.132.0.52/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-6hn7v |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-6hn7v |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-d7xqv |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79vbf2x |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79vbf2x |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79vbf2x |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79vbf2x |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-d7xqv |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" | |
| (x2) | kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled down replica set router-gateway-1-openshift-default-54c47cdfc7 from 1 to 0 |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-d7xqv |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-d7xqv |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-d7xqv |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-d7xqv |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-d7xqv |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" in 775ms (775ms including waiting). Image size: 44914394 bytes. | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-d7xqv |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-s6w2m |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-54c47cdfc7-s6w2m | |
| (x3) | kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-1-openshift-default-54c47cdfc7 from 0 to 1 |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-54c47cdfc7-hb6xz | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-54c47cdfc7-hb6xz |
AddedInterface |
Add eth0 [10.132.0.53/23] from ovn-kubernetes | |
| (x4) | kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled down replica set router-gateway-1-openshift-default-799f46c59b from 1 to 0 |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-6hn7v |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-799f46c59b-6hn7v | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-s6w2m |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-hb6xz |
Started |
Started container istio-proxy |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-hb6xz |
Created |
Created container: istio-proxy |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-hb6xz |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine |
| (x5) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-hb6xz |
Unhealthy |
Startup probe failed: Get "http://10.132.0.53:15021/healthz/ready": dial tcp 10.132.0.53:15021: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvb19f98874e050eec8ca94d49676113f0-kserve-self-signed-certs | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-test-epp-rb | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-test-kserve-router-scheduler-5b9d496c6c |
SuccessfulCreate |
Created pod: router-with-refs-test-kserve-router-scheduler-5b9d496c6c-9xznb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-5f8f4fd684-jp6nc |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-5f8f4fd684-jp6nc |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
multus |
router-with-refs-test-kserve-5f8f4fd684-jp6nc |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Role kserve-ci-e2e-test/router-with-refs-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-test-epp-sa | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-test-kserve-5f8f4fd684 |
SuccessfulCreate |
Created pod: router-with-refs-test-kserve-5f8f4fd684-jp6nc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-test-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-5f8f4fd684-jp6nc |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-test-kserve |
ScalingReplicaSet |
Scaled up replica set router-with-refs-test-kserve-5f8f4fd684 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set router-with-refs-test-kserve-router-scheduler-5b9d496c6c from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-5b9d496c6c-9xznb |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
| (x5) | kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-test-kserve-shadow-svc |
kserve-ci-e2e-test |
multus |
router-with-refs-test-kserve-router-scheduler-5b9d496c6c-9xznb |
AddedInterface |
Add eth0 [10.133.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-5b9d496c6c-9xznb |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-5b9d496c6c-9xznb |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-5b9d496c6c-9xznb |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-5b9d496c6c-9xznb |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-5b9d496c6c-9xznb |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-5f8f4fd684-jp6nc |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-5f8f4fd684-jp6nc |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-5f8f4fd684-jp6nc |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs | |
| (x13) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-d7xqv |
Unhealthy |
Startup probe failed: Get "https://10.134.0.40:8001/health": dial tcp 10.134.0.40:8001: connect: connection refused |
| (x13) | kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-5f8f4fd684-jp6nc |
Unhealthy |
Startup probe failed: Get "https://10.134.0.42:8000/health": dial tcp 10.134.0.42:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
LLMInferenceServiceReady |
LLMInferenceService [router-with-refs-test] is Ready | |
| (x19) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79vbf2x |
Unhealthy |
Startup probe failed: Get "https://10.134.0.41:8000/health": dial tcp 10.134.0.41:8000: connect: connection refused |
| (x3) | kserve-ci-e2e-test |
GatewayAuthBootstrap |
router-gateway-1 |
ReconcileError |
Failed to delete gateway PodMonitor: failed to delete PodMonitor: podmonitors.monitoring.coreos.com "router-gateway-1-metrics" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-5f8f4fd684-jp6nc |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-5b9d496c6c-9xznb |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-5b9d496c6c-9xznb |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-pvc-router-manage-e8706282] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testf5d060a5eb39a04e074b78907a1556a6-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schett6vl |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schett6vl |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79vbf2x |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-d7xqv |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-d7xqv |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-5f8f4fd684-jp6nc |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.42:8000/health": dial tcp 10.134.0.42:8000: connect: connection refused | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-797c6f8c49 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-7948w2q | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5cc9f5567d |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5cc9f5567d5bzm4 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test00d7278d8a22c4e39146a6b0eb840f45-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs | |
| (x9) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-50bc673d |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5cc9f5567d from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-797c6f8c49 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5cc9f5567d5bzm4 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-7948w2q |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler-bc55f88c6 |
SuccessfulCreate |
Created pod: llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheh4528 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler-bc55f88c6 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheh4528 |
AddedInterface |
Add eth0 [10.133.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheh4528 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheh4528 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheh4528 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5cc9f5567d5bzm4 |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5cc9f5567d5bzm4 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5cc9f5567d5bzm4 |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5cc9f5567d5bzm4 |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5cc9f5567d5bzm4 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-7948w2q |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5cc9f5567d5bzm4 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-7948w2q |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-7948w2q |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheh4528 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheh4528 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheh4528 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5cc9f5567d5bzm4 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5cc9f5567d5bzm4 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5cc9f5567d5bzm4 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-7948w2q |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-7948w2q |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-7948w2q |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-pvc-router-manage-2577e794 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-2577e794-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-2577e794-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
SuccessfulCreate |
create Pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 in StatefulSet llmisvc-model-pvc-router-manage-2577e794-kserve-mn successful | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler-7dbcb75dbc |
SuccessfulCreate |
Created pod: llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test37591b20e96e9663d45a730d03070f1e-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-rb | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler-7dbcb75dbc from 0 to 1 | |
kserve-ci-e2e-test |
multus |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4 |
AddedInterface |
Add eth0 [10.132.0.54/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
GroupsProgressing |
Created worker statefulset for leader pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-scc | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
SuccessfulCreate |
create Pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 in StatefulSet llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 successful | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
CreatingRevision |
Creating revision with key 686d468674 for a newly created LeaderWorkerSet | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
GroupsProgressing |
Created leader statefulset llmisvc-model-pvc-router-manage-2577e794-kserve-mn | |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
GroupsProgressing |
Replicas are progressing, with 0 groups ready of total 1 groups |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4 |
Created |
Created container: main | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-d2189ca3-9cab-4233-b265-8aa73aeb27a0" | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4 |
FailedAttachVolume |
Multi-Attach error for volume "pvc-d2189ca3-9cab-4233-b265-8aa73aeb27a0" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0, llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
AddedInterface |
Add eth0 [10.134.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Created |
Created container: main | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
AddedInterface |
Add eth0 [10.134.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs | |
| (x8) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-route | |
| (x23) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-7948w2q |
Unhealthy |
Startup probe failed: Get "https://10.134.0.44:8000/health": dial tcp 10.134.0.44:8000: connect: connection refused |
| (x23) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5cc9f5567d5bzm4 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.43:8001/health": dial tcp 10.134.0.43:8001: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-50bc673d] is Ready | |
| (x21) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.45:8000/health": dial tcp 10.134.0.45:8000: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-7948w2q |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test00d7278d8a22c4e39146a6b0eb840f45-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheh4528 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheh4528 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5cc9f5567d5bzm4 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5cc9f5567d5bzm4 |
Killing |
Stopping container llm-d-routing-sidecar | |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
AllGroupsReady |
All replicas are ready, with 1 groups ready of total 1 groups |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
custom-route-timeout-pd-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-pd-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-pd-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Role kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-role | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-prefill-749f64cc84 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-prefill-749f64cc84 |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-prefill-749f64cc84-rf4dw | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-router-scheduler-6c664f7f6b |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-router-scheduler-6c664d56p6 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-68796975c7 |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-68796975c7-ddffs | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-68796975c7 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-router-scheduler-6c664f7f6b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6c664d56p6 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-68796975c7-ddffs |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6c664d56p6 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6c664d56p6 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-prefill-749f64cc84-rf4dw |
AddedInterface |
Add eth0 [10.134.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-68796975c7-ddffs |
AddedInterface |
Add eth0 [10.134.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-749f64cc84-rf4dw |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-749f64cc84-rf4dw |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-68796975c7-ddffs |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-router-scheduler-6c664d56p6 |
AddedInterface |
Add eth0 [10.133.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-749f64cc84-rf4dw |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-68796975c7-ddffs |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-68796975c7-ddffs |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-68796975c7-ddffs |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-68796975c7-ddffs |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6c664d56p6 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6c664d56p6 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6c664d56p6 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-749f64cc84-rf4dw |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-pvc-router-manage-2577e794] is Ready | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-749f64cc84-rf4dw |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-68796975c7-ddffs |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-68796975c7-ddffs |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-68796975c7-ddffs |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-749f64cc84-rf4dw |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schew8zd4 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test37591b20e96e9663d45a730d03070f1e-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-v1a1-to-v1a2 |
UpdateFailed |
Failed to update status for LLMInferenceService "conv-test-v1a1-to-v1a2": Operation cannot be fulfilled on llminferenceservices.serving.kserve.io "conv-test-v1a1-to-v1a2": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-criticality |
UpdateFailed |
Failed to update status for LLMInferenceService "conv-test-criticality": Operation cannot be fulfilled on llminferenceservices.serving.kserve.io "conv-test-criticality": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-lora-crit |
UpdateFailed |
Failed to update status for LLMInferenceService "conv-test-lora-crit": Operation cannot be fulfilled on llminferenceservices.serving.kserve.io "conv-test-lora-crit": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-stop-feature-test-epp-auth-rb | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-745fc78d48 |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-745fc78d48-m5r6h | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Role kserve-ci-e2e-test/stop-feature-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-745fc78d48 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-745fc78d48-m5r6h |
FailedMount |
MountVolume.SetUp failed for volume "tls-certs" : failed to sync secret cache: timed out waiting for the condition | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-router-scheduler-5c8954f69 |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-router-scheduler-5c8954f69-2fnp4 | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-router-scheduler-5c8954f69 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-5c8954f69-2fnp4 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-router-scheduler-5c8954f69-2fnp4 |
AddedInterface |
Add eth0 [10.133.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-5c8954f69-2fnp4 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-5c8954f69-2fnp4 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/stop-feature-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-5c8954f69-2fnp4 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-745fc78d48-m5r6h |
AddedInterface |
Add eth0 [10.134.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-745fc78d48-m5r6h |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-745fc78d48-m5r6h |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-5c8954f69-2fnp4 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-5c8954f69-2fnp4 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-745fc78d48-m5r6h |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-745fc78d48-m5r6h |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-745fc78d48-m5r6h |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-745fc78d48-m5r6h |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/stop-feature-test-kserve-shadow-svc |
| (x16) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-68796975c7-ddffs |
Unhealthy |
Startup probe failed: Get "https://10.134.0.47:8001/health": dial tcp 10.134.0.47:8001: connect: connection refused |
| (x16) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-749f64cc84-rf4dw |
Unhealthy |
Startup probe failed: Get "https://10.134.0.48:8000/health": dial tcp 10.134.0.48:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
LLMInferenceServiceReady |
LLMInferenceService [custom-route-timeout-pd-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6c664d56p6 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6c664d56p6 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-68796975c7-ddffs |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-68796975c7-ddffs |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-749f64cc84-rf4dw |
Killing |
Stopping container main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6c664d56p6 |
FailedMount |
MountVolume.SetUp failed for volume "tls-certs" : secret "custom-route-timeout-pd-test-kserve-self-signed-certs" not found |
| (x13) | kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-745fc78d48-m5r6h |
Unhealthy |
Startup probe failed: Get "https://10.134.0.49:8000/health": dial tcp 10.134.0.49:8000: connect: connection refused |
kserve-ci-e2e-test |
service-controller |
router-gateway-2-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-2-openshift-default-54c789bdc6 |
SuccessfulCreate |
Created pod: router-gateway-2-openshift-default-54c789bdc6-fz6x9 | |
kserve-ci-e2e-test |
multus |
router-gateway-2-openshift-default-54c789bdc6-fz6x9 |
AddedInterface |
Add eth0 [10.132.0.55/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-fz6x9 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-2-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-2-openshift-default-54c789bdc6 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-fz6x9 |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-fz6x9 |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
gateway_labeler_controller |
router-gateway-2 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway router-gateway-2 | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-2-openshift-default-684dc9b4b9 |
SuccessfulCreate |
Created pod: router-gateway-2-openshift-default-684dc9b4b9-nkv2c | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-2-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-2-openshift-default-684dc9b4b9 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
router-gateway-2-openshift-default-684dc9b4b9-nkv2c |
AddedInterface |
Add eth0 [10.132.0.56/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
service-controller |
router-gateway-2-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-2-openshift-default-54c789bdc6 |
SuccessfulDelete |
Deleted pod: router-gateway-2-openshift-default-54c789bdc6-fz6x9 | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-fz6x9 |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-2-openshift-default |
ScalingReplicaSet |
Scaled down replica set router-gateway-2-openshift-default-54c789bdc6 from 1 to 0 | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-nkv2c |
Created |
Created container: istio-proxy |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-nkv2c |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-nkv2c |
Started |
Started container istio-proxy |
| (x5) | kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-nkv2c |
Unhealthy |
Startup probe failed: Get "http://10.132.0.56:15021/healthz/ready": dial tcp 10.132.0.56:15021: connect: connection refused |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-prefill-84464f6744 |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-prefill-84464f6744-knbm4 | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-84dc4d978f-8wd4k |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-prefill-84464f6744 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-84dc4d978f-8wd4k |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-84dc4d978f-8wd4k |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-84dc4d978f |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-84dc4d978f-8wd4k | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-84dc4d978f-8wd4k |
AddedInterface |
Add eth0 [10.134.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-84dc4d978f-8wd4k |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-84dc4d978f-8wd4k |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-84dc4d978f-8wd4k |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-prefill-84464f6744-knbm4 |
AddedInterface |
Add eth0 [10.134.0.51/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-84464f6744-knbm4 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-84464f6744-knbm4 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-router-scheduler-549db8f6fd |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-router-scheduler-549db8f6f92qng | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-router-scheduler-549db8f6fd from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-84dc4d978f from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Role kserve-ci-e2e-test/router-with-refs-pd-test-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-pd-test-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-pd-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-84464f6744-knbm4 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-549db8f6f92qng |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
| (x9) | kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-pd-test-kserve-shadow-svc |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-router-scheduler-549db8f6f92qng |
AddedInterface |
Add eth0 [10.133.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-549db8f6f92qng |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-549db8f6f92qng |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-549db8f6f92qng |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-549db8f6f92qng |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-549db8f6f92qng |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-84464f6744-knbm4 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-84464f6744-knbm4 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-84464f6744-knbm4 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-84dc4d978f-8wd4k |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-84dc4d978f-8wd4k |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-84dc4d978f-8wd4k |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-5c8954f69-2fnp4 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.InferencePool kserve-ci-e2e-test/stop-feature-test-inference-pool | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-5c8954f69-2fnp4 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-745fc78d48-m5r6h |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
LLMInferenceServiceNotReady |
LLMInferenceService [stop-feature-test] is no longer Ready because of: GatewaysReady, HTTPRoutesReady, InferencePoolReady, MainWorkloadReady, PrefillWorkerWorkloadReady, PrefillWorkloadReady, RouterReady, SchedulerWorkloadReady, WorkerWorkloadReady, WorkloadsReady | |
| (x25) | kserve-ci-e2e-test |
OpenDataHubModelController |
stop-feature-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy stop-feature-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "stop-feature-test-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-745fc78d48-m5r6h |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.49:8000/health": dial tcp 10.134.0.49:8000: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-5c8954f69-mh7p2 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-router-scheduler-5c8954f69-mh7p2 |
AddedInterface |
Add eth0 [10.133.0.51/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-745fc78d48 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-router-scheduler-5c8954f69 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-745fc78d48-mrzcn |
AddedInterface |
Add eth0 [10.134.0.52/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-745fc78d48-mrzcn |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-745fc78d48-mrzcn |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-745fc78d48-mrzcn |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-router-scheduler-5c8954f69 |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-router-scheduler-5c8954f69-mh7p2 | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-5c8954f69-mh7p2 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-5c8954f69-mh7p2 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-745fc78d48 |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-745fc78d48-mrzcn | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-5c8954f69-mh7p2 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-5c8954f69-mh7p2 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-5c8954f69-mh7p2 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-745fc78d48-mrzcn |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-745fc78d48-mrzcn |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-745fc78d48-mrzcn |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
| (x16) | kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-84464f6744-knbm4 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.51:8000/health": dial tcp 10.134.0.51:8000: connect: connection refused |
| (x16) | kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-84dc4d978f-8wd4k |
Unhealthy |
Startup probe failed: Get "https://10.134.0.50:8001/health": dial tcp 10.134.0.50:8001: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
LLMInferenceServiceReady |
LLMInferenceService [router-with-refs-pd-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-84dc4d978f-8wd4k |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-84dc4d978f-8wd4k |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-84464f6744-knbm4 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-549db8f6f92qng |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-549db8f6f92qng |
FailedPreStopHook |
PreStopHook failed | |
| (x13) | kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-745fc78d48-mrzcn |
Unhealthy |
Startup probe failed: Get "https://10.134.0.52:8000/health": dial tcp 10.134.0.52:8000: connect: connection refused |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-3c960099 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-3c960099-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-3c960099-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-3c960099-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-3c960099-kserve-775b7467d7 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-775b7467d7 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-3c960099-kserve-775b7467d7gkzsf | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvd10b93c8eba12f87c3a350a5cae2ee0c-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-775b7467d7gkzsf |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-775b7467d7gkzsf |
AddedInterface |
Add eth0 [10.134.0.53/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-775b7467d7gkzsf |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-775b7467d7gkzsf |
Created |
Created container: storage-initializer | |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
LLMInferenceServiceReady |
LLMInferenceService [stop-feature-test] is Ready |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-775b7467d7gkzsf |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-775b7467d7gkzsf |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-775b7467d7gkzsf |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-745fc78d48-mrzcn |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-5c8954f69-mh7p2 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvd10b93c8eba12f87c3a350a5cae2ee0c-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-5c8954f69-mh7p2 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-745fc78d48-mrzcn |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.52:8000/health": dial tcp 10.134.0.52:8000: connect: connection refused | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
lora-single-adapter-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy lora-single-adapter-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/lora-single-adapter-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "lora-single-adapter-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.Service kserve-ci-e2e-test/lora-single-adapter-test-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
lora-single-adapter-test-kserve-84645dc545 |
SuccessfulCreate |
Created pod: lora-single-adapter-test-kserve-84645dc545-rjkj5 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/lora-single-adapter-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.Secret kserve-ci-e2e-test/lora-single-adapter-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
lora-single-adapter-test-kserve |
ScalingReplicaSet |
Scaled up replica set lora-single-adapter-test-kserve-84645dc545 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/lora-single-adapter-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/lora-single-adapter-test-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-84645dc545-rjkj5 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-84645dc545-rjkj5 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-84645dc545-rjkj5 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
lora-single-adapter-test-kserve-84645dc545-rjkj5 |
AddedInterface |
Add eth0 [10.134.0.54/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-84645dc545-rjkj5 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-84645dc545-rjkj5 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-84645dc545-rjkj5 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/lora-single-adapter-test-kserve-self-signed-certs | |
| (x11) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-775b7467d7gkzsf |
Unhealthy |
Startup probe failed: Get "https://10.134.0.53:8000/health": dial tcp 10.134.0.53:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-3c960099] is Ready | |
| (x7) | kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-84645dc545-rjkj5 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.54:8000/health": dial tcp 10.134.0.54:8000: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-775b7467d7gkzsf |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
LLMInferenceServiceReady |
LLMInferenceService [lora-single-adapter-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-775b7467d7gkzsf |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.53:8000/health": dial tcp 10.134.0.53:8000: connect: connection refused | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route" not found |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
GroupsProgressing |
Replicas are progressing, with 0 groups ready of total 1 groups |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
SuccessfulCreate |
create Pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 in StatefulSet llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn successful | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
SuccessfulCreate |
create Pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 in StatefulSet llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 successful | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
CreatingRevision |
Creating revision with key 85844bd74d for a newly created LeaderWorkerSet | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler-569f558856 from 0 to 1 | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
GroupsProgressing |
Created leader statefulset llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
GroupsProgressing |
Created worker statefulset for leader pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-scc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test386bd5808c5c450f11fd8632e1f821fb-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-rb | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scherv8q8 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scherv8q8 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scherv8q8 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler-569f558856 |
SuccessfulCreate |
Created pod: llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scherv8q8 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
AddedInterface |
Add eth0 [10.134.0.55/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scherv8q8 |
AddedInterface |
Add eth0 [10.133.0.53/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
AddedInterface |
Add eth0 [10.133.0.52/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scherv8q8 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scherv8q8 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scherv8q8 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Pulling |
Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route | |
| (x8) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-84645dc545-rjkj5 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Pulled |
Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" in 28.778s (28.778s including waiting). Image size: 3531177328 bytes. | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-84645dc545-rjkj5 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.54:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
lora-multiple-adapters-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy lora-multiple-adapters-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "lora-multiple-adapters-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/lora-multiple-adapters-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.Service kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.Secret kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
lora-multiple-adapters-test-kserve |
ScalingReplicaSet |
Scaled up replica set lora-multiple-adapters-test-kserve-857c79454 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
lora-multiple-adapters-test-kserve-857c79454 |
SuccessfulCreate |
Created pod: lora-multiple-adapters-test-kserve-857c79454-z99g7 | |
kserve-ci-e2e-test |
multus |
lora-multiple-adapters-test-kserve-857c79454-z99g7 |
AddedInterface |
Add eth0 [10.134.0.56/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-857c79454-z99g7 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-857c79454-z99g7 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-route | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-857c79454-z99g7 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-857c79454-z99g7 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-857c79454-z99g7 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-857c79454-z99g7 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-self-signed-certs | |
| (x9) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.55:8000/health": dial tcp 10.134.0.55:8000: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
AllGroupsReady |
All replicas are ready, with 1 groups ready of total 1 groups |
| (x7) | kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-857c79454-z99g7 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.56:8000/health": dial tcp 10.134.0.56:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
LLMInferenceServiceReady |
LLMInferenceService [lora-multiple-adapters-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-857c79454-z99g7 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-dc21cb14] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scherv8q8 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scherv8q8 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test386bd5808c5c450f11fd8632e1f821fb-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-857c79454-z99g7 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.56:8000/health": dial tcp 10.134.0.56:8000: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.55:8000/health": dial tcp 10.134.0.55:8000: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Killing |
Stopping container main | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
tls-verification-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy tls-verification-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/tls-verification-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "tls-verification-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/tls-verification-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Service kserve-ci-e2e-test/tls-verification-test-kserve-workload-svc | |
kserve-ci-e2e-test |
multus |
tls-verification-test-kserve-6799cd4648-xlzj2 |
AddedInterface |
Add eth0 [10.133.0.54/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-6799cd4648-xlzj2 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-6799cd4648-xlzj2 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-6799cd4648-xlzj2 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Service kserve-ci-e2e-test/tls-verification-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Role kserve-ci-e2e-test/tls-verification-test-epp-role | |
kserve-ci-e2e-test |
replicaset-controller |
tls-verification-test-kserve-6799cd4648 |
SuccessfulCreate |
Created pod: tls-verification-test-kserve-6799cd4648-xlzj2 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Secret kserve-ci-e2e-test/tls-verification-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
tls-verification-test-kserve |
ScalingReplicaSet |
Scaled up replica set tls-verification-test-kserve-6799cd4648 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
tls-verification-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set tls-verification-test-kserve-router-scheduler-655f6fd4c7 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
tls-verification-test-kserve-router-scheduler-655f6fd4c7 |
SuccessfulCreate |
Created pod: tls-verification-test-kserve-router-scheduler-655f6fd4c7-4557t | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-tls-verification-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/tls-verification-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/tls-verification-test-kserve | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-655f6fd4c7-4557t |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-655f6fd4c7-4557t |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-655f6fd4c7-4557t |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
multus |
tls-verification-test-kserve-router-scheduler-655f6fd4c7-4557t |
AddedInterface |
Add eth0 [10.134.0.57/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-655f6fd4c7-4557t |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-655f6fd4c7-4557t |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-655f6fd4c7-4557t |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-6799cd4648-xlzj2 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-6799cd4648-xlzj2 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-6799cd4648-xlzj2 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/tls-verification-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/tls-verification-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/tls-verification-test-kserve-shadow-svc |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-inline-config-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-inline-config-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-inline-config-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-inline-config-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-inline-config-test-epp-role | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-inline-config-test-kserve-7c6c58cc96 |
SuccessfulCreate |
Created pod: scheduler-inline-config-test-kserve-7c6c58cc96-wfsdw | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-inline-config-test-kserve-router-scheduler-d9ddf6c4d |
SuccessfulCreate |
Created pod: scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-inline-config-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-inline-config-test-kserve-router-scheduler-d9ddf6c4d from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-inline-config-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-inline-config-test-kserve-7c6c58cc96 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-inline-config-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-wfsdw |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
multus |
scheduler-inline-config-test-kserve-7c6c58cc96-wfsdw |
AddedInterface |
Add eth0 [10.133.0.55/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-wfsdw |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-wfsdw |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l |
AddedInterface |
Add eth0 [10.132.0.57/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-inline-config-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-inline-config-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-wfsdw |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d9ddf7ws8l |
FailedPreStopHook |
PreStopHook failed | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-service | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4 |
SuccessfulCreate |
Created pod: llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4h5s4w | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler-79866dc455 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler-79866dc455 |
SuccessfulCreate |
Created pod: llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test80f99418f0f3eb4c80f02e6144a6d4f2-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4h5s4w |
Created |
Created container: main | |
kserve-ci-e2e-test |
multus |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4h5s4w |
AddedInterface |
Add eth0 [10.133.0.56/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj |
AddedInterface |
Add eth0 [10.132.0.58/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4h5s4w |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4h5s4w |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-shadow-svc |
| (x11) | kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-6799cd4648-xlzj2 |
Unhealthy |
Startup probe failed: Get "https://10.133.0.54:8000/health": dial tcp 10.133.0.54:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
LLMInferenceServiceReady |
LLMInferenceService [tls-verification-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-4c1ba212] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4h5s4w |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche9ddmj |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test80f99418f0f3eb4c80f02e6144a6d4f2-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-655f6fd4c7-4557t |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-655f6fd4c7-4557t |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-tls-verification-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-6799cd4648-xlzj2 |
Killing |
Stopping container main | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-configmap-ref-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-configmap-ref-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-configmap-ref-test-kserve-route" not found |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-configmap-ref-test-kserve-router-scheduler-68f876cc5d |
SuccessfulCreate |
Created pod: scheduler-configmap-ref-test-kserve-router-scheduler-68f879pk76 | |
kserve-ci-e2e-test |
multus |
scheduler-configmap-ref-test-kserve-router-scheduler-68f879pk76 |
AddedInterface |
Add eth0 [10.134.0.58/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-p9jvd |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-p9jvd |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-p9jvd |
Started |
Started container main | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-configmap-ref-test-kserve-744bf59fbd |
SuccessfulCreate |
Created pod: scheduler-configmap-ref-test-kserve-744bf59fbd-p9jvd | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-workload-svc | |
kserve-ci-e2e-test |
multus |
scheduler-configmap-ref-test-kserve-744bf59fbd-p9jvd |
AddedInterface |
Add eth0 [10.133.0.57/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-configmap-ref-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-configmap-ref-test-kserve-router-scheduler-68f876cc5d from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-configmap-ref-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-configmap-ref-test-kserve-744bf59fbd from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-68f879pk76 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-68f879pk76 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-68f879pk76 |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-prestop-hook-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/prestop-hook-test-epp-sa | |
kserve-ci-e2e-test |
replicaset-controller |
prestop-hook-test-kserve-5c66d6b7c6 |
SuccessfulCreate |
Created pod: prestop-hook-test-kserve-5c66d6b7c6-wq7jj | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Service kserve-ci-e2e-test/prestop-hook-test-kserve-workload-svc | |
kserve-ci-e2e-test |
deployment-controller |
prestop-hook-test-kserve |
ScalingReplicaSet |
Scaled up replica set prestop-hook-test-kserve-5c66d6b7c6 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Secret kserve-ci-e2e-test/prestop-hook-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/prestop-hook-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c66d6b7c6-wq7jj |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
prestop-hook-test-kserve-5c66d6b7c6-wq7jj |
AddedInterface |
Add eth0 [10.133.0.58/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Service kserve-ci-e2e-test/prestop-hook-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c66d6b7c6-wq7jj |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c66d6b7c6-wq7jj |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
prestop-hook-test-kserve-router-scheduler-5f5849dc8f-wlflw |
AddedInterface |
Add eth0 [10.134.0.59/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/prestop-hook-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Role kserve-ci-e2e-test/prestop-hook-test-epp-role | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-5f5849dc8f-wlflw |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
prestop-hook-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set prestop-hook-test-kserve-router-scheduler-5f5849dc8f from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-5f5849dc8f-wlflw |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-5f5849dc8f-wlflw |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
prestop-hook-test-kserve-router-scheduler-5f5849dc8f |
SuccessfulCreate |
Created pod: prestop-hook-test-kserve-router-scheduler-5f5849dc8f-wlflw | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-5f5849dc8f-wlflw |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-5f5849dc8f-wlflw |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-5f5849dc8f-wlflw |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c66d6b7c6-wq7jj |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c66d6b7c6-wq7jj |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c66d6b7c6-wq7jj |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/prestop-hook-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/prestop-hook-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-configmap-ref-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-68f879pk76 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-p9jvd |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-68f879pk76 |
FailedPreStopHook |
PreStopHook failed | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-ha-replicas-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-ha-replicas-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-ha-replicas-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-role | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-5c5cfcf776-8vkw8 |
AddedInterface |
Add eth0 [10.133.0.59/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-8vkw8 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-8vkw8 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-8vkw8 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-sa | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-5c5cfcf776 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-5c5cfcf776-8vkw8 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-ha-replicas-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-ha-replicas-test-kserve-5c5cfcf776 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-ha-replicas-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dbc4 from 0 to 2 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dbc4 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d9h92n | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dbc4 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5 | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d9h92n |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d9h92n |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d9h92n |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d9h92n |
AddedInterface |
Add eth0 [10.134.0.60/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5 |
AddedInterface |
Add eth0 [10.132.0.59/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5 |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-ha-replicas-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d9h92n |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-8vkw8 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb | |
| (x2) | kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d78mv5 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85d9h92n |
Killing |
Stopping container main | |
| (x11) | kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c66d6b7c6-wq7jj |
Unhealthy |
Startup probe failed: Get "https://10.133.0.58:8000/health": dial tcp 10.133.0.58:8000: connect: connection refused |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-custom-template-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-custom-template-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-custom-template-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-custom-template-test-kserve-route" not found |
kserve-ci-e2e-test |
replicaset-controller |
prestop-hook-test-kserve-5c66d6b7c6 |
SuccessfulCreate |
Created pod: prestop-hook-test-kserve-5c66d6b7c6-hnjkg | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c66d6b7c6-wq7jj |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-custom-template-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-custom-template-test-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c66d6b7c6-hnjkg |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-custom-template-test-kserve | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c66d6b7c6-hnjkg |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-custom-template-test-kserve-5bc7bd6864 |
SuccessfulCreate |
Created pod: scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c66d6b7c6-hnjkg |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:6455858d9bcb13c4793d39d844d39ea45d90725b82962b5a6791b22458b6ca42" already present on machine | |
kserve-ci-e2e-test |
multus |
prestop-hook-test-kserve-5c66d6b7c6-hnjkg |
AddedInterface |
Add eth0 [10.133.0.60/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-custom-template-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-custom-template-test-kserve-5bc7bd6864 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-custom-template-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
multus |
scheduler-custom-template-test-kserve-router-scheduler-567695vv |
AddedInterface |
Add eth0 [10.132.0.61/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-567695vv |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-567695vv |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-custom-template-test-epp-sa | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-custom-template-test-kserve-router-scheduler-567469f665 |
SuccessfulCreate |
Created pod: scheduler-custom-template-test-kserve-router-scheduler-567695vv | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-custom-template-test-epp-auth-rb | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-custom-template-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-custom-template-test-kserve-router-scheduler-567469f665 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-custom-template-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-custom-template-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-567695vv |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
multus |
scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj |
AddedInterface |
Add eth0 [10.132.0.60/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c66d6b7c6-hnjkg |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c66d6b7c6-hnjkg |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c66d6b7c6-hnjkg |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c66d6b7c6-wq7jj |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.58:8000/health": dial tcp 10.133.0.58:8000: connect: connection refused | |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/prestop-hook-test-kserve-self-signed-certs |
| (x2) | kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c66d6b7c6-hnjkg |
Unhealthy |
Startup probe failed: Get "https://10.133.0.60:8000/health": dial tcp 10.133.0.60:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-custom-template-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-custom-template-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-custom-template-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-5f5849dc8f-wlflw |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-prestop-hook-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-5f5849dc8f-wlflw |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c66d6b7c6-hnjkg |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-custom-template-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-custom-template-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-5fjrj |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-567695vv |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-567695vv |
FailedPreStopHook |
PreStopHook failed | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
rolling-upgrade-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy rolling-upgrade-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/rolling-upgrade-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "rolling-upgrade-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Role kserve-ci-e2e-test/rolling-upgrade-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/rolling-upgrade-test-epp-rb | |
kserve-ci-e2e-test |
deployment-controller |
rolling-upgrade-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd |
SuccessfulCreate |
Created pod: rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-s9q6h | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
multus |
rolling-upgrade-test-kserve-54bc76f55b-45st6 |
AddedInterface |
Add eth0 [10.133.0.61/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-s9q6h |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-s9q6h |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-s9q6h |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
multus |
rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-s9q6h |
AddedInterface |
Add eth0 [10.134.0.61/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-54bc76f55b-45st6 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-54bc76f55b-45st6 |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Service kserve-ci-e2e-test/rolling-upgrade-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/rolling-upgrade-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-rolling-upgrade-test-epp-auth-rb | |
kserve-ci-e2e-test |
deployment-controller |
rolling-upgrade-test-kserve |
ScalingReplicaSet |
Scaled up replica set rolling-upgrade-test-kserve-54bc76f55b from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
replicaset-controller |
rolling-upgrade-test-kserve-54bc76f55b |
SuccessfulCreate |
Created pod: rolling-upgrade-test-kserve-54bc76f55b-45st6 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Service kserve-ci-e2e-test/rolling-upgrade-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-54bc76f55b-45st6 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-role | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-pd-migration-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-pd-migration-test-kserve-router-scheduler-59dc679cd from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-pd-migration-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-pd-migration-test-kserve-5c87756974 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s |
AddedInterface |
Add eth0 [10.132.0.62/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-v06-pd-migration-test-epp-auth-rb | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-pd-migration-test-kserve-5c87756974 |
SuccessfulCreate |
Created pod: scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-pd-migration-test-epp-sa | |
kserve-ci-e2e-test |
multus |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-97l8n |
AddedInterface |
Add eth0 [10.133.0.62/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-97l8n |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-97l8n |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-97l8n |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847 |
SuccessfulCreate |
Created pod: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-97l8n | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-pd-migration-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill | |
kserve-ci-e2e-test |
multus |
scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s |
AddedInterface |
Add eth0 [10.132.0.63/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s |
Started |
Started container main | |
| (x14) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-v06-pd-migration-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-v06-pd-migration-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-v06-pd-migration-test-kserve-route" not found |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-pd-migration-test-kserve-router-scheduler-59dc679cd |
SuccessfulCreate |
Created pod: scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" in 896ms (896ms including waiting). Image size: 44914394 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s |
Started |
Started container main | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/rolling-upgrade-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/rolling-upgrade-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-self-signed-certs | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
LLMInferenceServiceReady |
LLMInferenceService [rolling-upgrade-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-v06-pd-migration-test] is Ready | |
kserve-ci-e2e-test |
deployment-controller |
rolling-upgrade-test-kserve |
ScalingReplicaSet |
Scaled up replica set rolling-upgrade-test-kserve-859df57bcb from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
rolling-upgrade-test-kserve-859df57bcb |
SuccessfulCreate |
Created pod: rolling-upgrade-test-kserve-859df57bcb-dpmdh | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Updated |
Updated v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-dpmdh |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-ch58s |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-598r59s |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-97l8n |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
multus |
rolling-upgrade-test-kserve-859df57bcb-dpmdh |
AddedInterface |
Add eth0 [10.134.0.62/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-dpmdh |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-dpmdh |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-v06-pd-migration-test-epp-auth-rb | |
kserve-ci-e2e-test |
replicaset-controller |
rolling-upgrade-test-kserve-54bc76f55b |
SuccessfulDelete |
Deleted pod: rolling-upgrade-test-kserve-54bc76f55b-45st6 | |
kserve-ci-e2e-test |
deployment-controller |
rolling-upgrade-test-kserve |
ScalingReplicaSet |
Scaled down replica set rolling-upgrade-test-kserve-54bc76f55b from 1 to 0 | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-54bc76f55b-45st6 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-97l8n |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.62:8000/health": dial tcp 10.133.0.62:8000: connect: connection refused | |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-v06-threshold-migration-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-v06-threshold-migration-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-v06-threshold-migration-test-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-threshold-migration-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-threshold-migration-test-kserve-5994569d5b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc599dc49 |
SuccessfulCreate |
Created pod: scheduler-v06-threshold-migration-test-kserve-prefill-5fc5j9qhd | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-threshold-migration-test-kserve-5994569d5b |
SuccessfulCreate |
Created pod: scheduler-v06-threshold-migration-test-kserve-5994569d5b-4l7qk | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-workload-svc | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-threshold-migration-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-threshold-migration-test-kserve-prefill-5fc599dc49 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test0a07e82be2036793543b2d3db2ea0785-scheduler-v0 | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5j9qhd |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-4l7qk |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5j9qhd |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-4l7qk |
AddedInterface |
Add eth0 [10.133.0.63/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq |
AddedInterface |
Add eth0 [10.132.0.64/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5j9qhd |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
multus |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5j9qhd |
AddedInterface |
Add eth0 [10.133.0.64/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-threshold-migration-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-threshold-migration-test-kserve-router-scheduler-dbc65f645 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-threshold-migration-test-kserve-router-scheduler-dbc65f645 |
SuccessfulCreate |
Created pod: scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-epp-sa | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-4l7qk |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-4l7qk |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-4l7qk |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-4l7qk |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-4l7qk |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" in 772ms (772ms including waiting). Image size: 44914394 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-4l7qk |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-rolling-upgrade-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-s9q6h |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-s9q6h |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-dpmdh |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-self-signed-certs | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-route | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-dpmdh |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.62:8000/health": EOF | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-v06-threshold-migration-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5j9qhd |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-4l7qk |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test0a07e82be2036793543b2d3db2ea0785-scheduler-v0 | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-4l7qk |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedlk7xq |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5j9qhd |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.64:8000/health": dial tcp 10.133.0.64:8000: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-4l7qk |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.63:8001/health": dial tcp 10.133.0.63:8001: connect: connection refused |