| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kuadrant-system |
limitador-limitador-69574b596d-4xqs4 |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-69574b596d-4xqs4 to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
rolling-upgrade-test-kserve-859df57bcb-95l7h |
Scheduled |
Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-95l7h to ip-10-0-135-126.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-pd-migration-test-kserve-router-scheduler-6f6gggx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-6f6gggx to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz to ip-10-0-135-126.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5dmkx2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5dmkx2 to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-threshold-migration-test-kserve-router-schedzx9nx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedzx9nx to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-inline-config-test-kserve-router-scheduler-568fcc29ws |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-568fcc29ws to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-779bc4c586-hpj62 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-779bc4c586-hpj62 to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-inline-config-test-kserve-7c6c58cc96-dqvgf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-dqvgf to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-779bc4c586-xrcs9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-779bc4c586-xrcs9 to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-router-scheduler-59cf7696fd-549td |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-59cf7696fd-549td to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fbhn5k |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fbhn5k to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
auth-disabled-test-kserve-router-scheduler-cbd548bb4-6hsgn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-disabled-test-kserve-router-scheduler-cbd548bb4-6hsgn to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-router-scheduler-59cf7696fd-54khg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-59cf7696fd-54khg to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85f6mqct |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-85cd85f6mqct to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz to ip-10-0-135-126.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm to ip-10-0-135-126.ec2.internal | ||
kserve-ci-e2e-test |
tls-verification-test-kserve-6bc7757754-k6d85 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/tls-verification-test-kserve-6bc7757754-k6d85 to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
tls-verification-test-kserve-router-scheduler-5f8d594d4b-q8h9v |
Scheduled |
Successfully assigned kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-5f8d594d4b-q8h9v to ip-10-0-143-100.ec2.internal | ||
kuadrant-system |
dns-operator-controller-manager-65b49595d7-76qtk |
Scheduled |
Successfully assigned kuadrant-system/dns-operator-controller-manager-65b49595d7-76qtk to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-test-kserve-router-scheduler-6c56cf97vk2ts |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-6c56cf97vk2ts to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-custom-template-test-kserve-5bc7bd6864-f8wm8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-f8wm8 to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
rolling-upgrade-test-kserve-router-scheduler-745dd558f-mdh27 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-745dd558f-mdh27 to ip-10-0-143-100.ec2.internal | ||
kuadrant-system |
authorino-7c77957575-w4lkk |
Scheduled |
Successfully assigned kuadrant-system/authorino-7c77957575-w4lkk to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dxd8ww |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dxd8ww to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-797zsws |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-797zsws to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-test-kserve-bd7dd6dc4-zfhxm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-bd7dd6dc4-zfhxm to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4bf9pm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4bf9pm to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-54c47cdfc7-7cwwt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-7cwwt to ip-10-0-135-126.ec2.internal | ||
kuadrant-system |
kuadrant-console-plugin-85fd4b8b9d-6vqdx |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-6vqdx to ip-10-0-136-80.ec2.internal | ||
kuadrant-system |
authorino-8df697c9f-cgx8d |
Scheduled |
Successfully assigned kuadrant-system/authorino-8df697c9f-cgx8d to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-54c47cdfc7-gjwrm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-gjwrm to ip-10-0-135-126.ec2.internal | ||
kserve-ci-e2e-test |
e2e-pvc-model-download-w44vk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/e2e-pvc-model-download-w44vk to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-799f46c59b-2gq6r |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-2gq6r to ip-10-0-135-126.ec2.internal | ||
kuadrant-system |
kuadrant-operator-controller-manager-bb7ddb7d7-kp78l |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-kp78l to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
rolling-upgrade-test-kserve-54bc76f55b-5nvsx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-5nvsx to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-799f46c59b-8zpjr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zpjr to ip-10-0-135-126.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-router-scheduler-59cc6tcb6q |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-59cc6tcb6q to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5xdnmc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5xdnmc to ip-10-0-143-100.ec2.internal | ||
kuadrant-system |
authorino-b6c89bb85-5xw9l |
Scheduled |
Successfully assigned kuadrant-system/authorino-b6c89bb85-5xw9l to ip-10-0-135-126.ec2.internal | ||
kserve-ci-e2e-test |
auth-enabled-test-kserve-598dd9464-dqmnc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-enabled-test-kserve-598dd9464-dqmnc to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf to ip-10-0-135-126.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-fb864fd8f-krp9h |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-fb864fd8f-krp9h to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-799f46c59b-hd9rl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-hd9rl to ip-10-0-135-126.ec2.internal | ||
openshift-ingress |
router-default-559484955d-q46dq |
Scheduled |
Successfully assigned openshift-ingress/router-default-559484955d-q46dq to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-799f46c59b-nbkkb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-nbkkb to ip-10-0-135-126.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-vs44g |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-vs44g to ip-10-0-136-80.ec2.internal | ||
kuadrant-system |
limitador-limitador-ff68ff5cb-ph894 |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-ff68ff5cb-ph894 to ip-10-0-143-100.ec2.internal | ||
kuadrant-system |
limitador-operator-controller-manager-6f9f468797-ct7rc |
Scheduled |
Successfully assigned kuadrant-system/limitador-operator-controller-manager-6f9f468797-ct7rc to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbfhfsgk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbfhfsgk to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn to ip-10-0-135-126.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng to ip-10-0-135-126.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
auth-enabled-test-kserve-router-scheduler-8444585c95-fwn2t |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-8444585c95-fwn2t to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-rrpmk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-rrpmk to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz to ip-10-0-135-126.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4xbrg9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4xbrg9 to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schejbt5j |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schejbt5j to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6cc48f668b-md6gb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6cc48f668b-md6gb to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2 to ip-10-0-135-126.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scherdpsl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scherdpsl to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schestqb2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schestqb2 to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche5fptt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche5fptt to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-sche2l22r |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-sche2l22r to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schen59vx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schen59vx to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-prefill-fbb965dc8-4nrzb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-fbb965dc8-4nrzb to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-2-openshift-default-54c789bdc6-dckx4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-dckx4 to ip-10-0-135-126.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-2-openshift-default-684dc9b4b9-mhvbh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-mhvbh to ip-10-0-135-126.ec2.internal | ||
openshift-ingress |
openshift-ai-inference-openshift-default-655f7c58b4-lcjkw |
Scheduled |
Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-lcjkw to ip-10-0-135-126.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-5ccd7c9ddd-sbl79 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-5ccd7c9ddd-sbl79 to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schewjstj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schewjstj to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-d66767cfc-twflf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-d66767cfc-twflf to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schezhqlg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schezhqlg to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scherndv9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scherndv9 to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexlpkr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexlpkr to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schecp7wv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schecp7wv to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph to ip-10-0-135-126.ec2.internal | ||
kserve-ci-e2e-test |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schehvsgn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schehvsgn to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche7vqpj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche7vqpj to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
auth-invalid-token-test-kserve-6c78d67c56-sxd27 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-invalid-token-test-kserve-6c78d67c56-sxd27 to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherkzd9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherkzd9 to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
lora-multiple-adapters-test-kserve-64fdd68f44-jsxsq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-64fdd68f44-jsxsq to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-prefill-6ddb4b6c98-wphcd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-6ddb4b6c98-wphcd to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-router-scheduler-9f96557cc2rtjb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-9f96557cc2rtjb to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
auth-disabled-test-kserve-7998df8854-d9nzk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-disabled-test-kserve-7998df8854-d9nzk to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-test-kserve-7dc67694b-lh52n |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-7dc67694b-lh52n to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-test-kserve-router-scheduler-55c98c487b-tzm6k |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-55c98c487b-tzm6k to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-configmap-ref-test-kserve-744bf59fbd-6cx96 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-6cx96 to ip-10-0-143-100.ec2.internal | ||
kuadrant-system |
authorino-operator-6d85f6564-97wxk |
Scheduled |
Successfully assigned kuadrant-system/authorino-operator-6d85f6564-97wxk to ip-10-0-135-126.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-7886454c6-qxk94 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-7886454c6-qxk94 to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
lora-single-adapter-test-kserve-786667d575-d9ffw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/lora-single-adapter-test-kserve-786667d575-d9ffw to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-7597885744-94nl8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7597885744-94nl8 to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
auth-invalid-token-test-kserve-router-scheduler-66fccd984fhr5cm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-invalid-token-test-kserve-router-scheduler-66fccd984fhr5cm to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-7597885744-t6hgf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7597885744-t6hgf to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5fcd5db4ddxt8b4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5fcd5db4ddxt8b4 to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
prestop-hook-test-kserve-6785946898-2mr2b |
Scheduled |
Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-6785946898-2mr2b to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
prestop-hook-test-kserve-router-scheduler-cd554b854-6xg7k |
Scheduled |
Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-cd554b854-6xg7k to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-configmap-ref-test-kserve-router-scheduler-669ffwt8cj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-669ffwt8cj to ip-10-0-143-100.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-x2drp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-x2drp to ip-10-0-143-100.ec2.internal | ||
openshift-ingress |
istiod-openshift-gateway-94bb8fbfd-wgrrr |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wgrrr to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
prestop-hook-test-kserve-6785946898-6ph2c |
Scheduled |
Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-6785946898-6ph2c to ip-10-0-136-80.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5bwl2gq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5bwl2gq to ip-10-0-136-80.ec2.internal | ||
| (x6) | openshift-ingress |
replicaset-controller |
router-default-559484955d |
FailedCreate |
Error creating: pods "router-default-559484955d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
openshift-ingress |
deployment-controller |
router-default |
ScalingReplicaSet |
Scaled up replica set router-default-559484955d from 0 to 1 | |
openshift-ingress |
service-controller |
router-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
service-controller |
router-default |
UnAvailableLoadBalancer |
There are no available nodes for LoadBalancer | |
openshift-ingress |
service-controller |
router-default |
EnsuredLoadBalancer |
Ensured load balancer | |
| (x16) | openshift-ingress |
replicaset-controller |
router-default-559484955d |
FailedCreate |
Error creating: pods "router-default-559484955d-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
| (x3) | openshift-ingress |
service-controller |
router-default |
UpdatedLoadBalancer |
Updated load balancer with new hosts |
openshift-ingress |
replicaset-controller |
router-default-559484955d |
SuccessfulCreate |
Created pod: router-default-559484955d-q46dq | |
| (x6) | openshift-ingress |
kubelet |
router-default-559484955d-q46dq |
FailedMount |
MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt |
| (x6) | openshift-ingress |
kubelet |
router-default-559484955d-q46dq |
FailedMount |
MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found |
openshift-ingress |
multus |
router-default-559484955d-q46dq |
AddedInterface |
Add eth0 [10.132.0.12/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
router-default-559484955d-q46dq |
Created |
Created container: router | |
openshift-ingress |
kubelet |
router-default-559484955d-q46dq |
Started |
Started container router | |
openshift-ingress |
kubelet |
router-default-559484955d-q46dq |
Pulled |
Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:46713c6ea38edae61b620b46e06c09cd34ab99a709cbe49d71f62b5fce883b8b" already present on machine | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-94bb8fbfd from 0 to 1 | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-94bb8fbfd |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-94bb8fbfd-wgrrr | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-wgrrr |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" | |
openshift-ingress |
multus |
istiod-openshift-gateway-94bb8fbfd-wgrrr |
AddedInterface |
Add eth0 [10.132.0.29/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-wgrrr |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" in 2.21s (2.21s including waiting). Image size: 181034515 bytes. | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-wgrrr |
Created |
Created container: discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-wgrrr |
Started |
Started container discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-wgrrr |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-wgrrr |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
gateway_labeler_controller |
openshift-ai-inference |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway openshift-ai-inference | |
openshift-ingress |
replicaset-controller |
openshift-ai-inference-openshift-default-655f7c58b4 |
SuccessfulCreate |
Created pod: openshift-ai-inference-openshift-default-655f7c58b4-lcjkw | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
deployment-controller |
openshift-ai-inference-openshift-default |
ScalingReplicaSet |
Scaled up replica set openshift-ai-inference-openshift-default-655f7c58b4 from 0 to 1 | |
openshift-ingress |
multus |
openshift-ai-inference-openshift-default-655f7c58b4-lcjkw |
AddedInterface |
Add eth0 [10.133.0.17/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-655f7c58b4-lcjkw |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-655f7c58b4-lcjkw |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 2.956s (2.956s including waiting). Image size: 181251556 bytes. | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
replicaset-controller |
limitador-operator-controller-manager-6f9f468797 |
SuccessfulCreate |
Created pod: limitador-operator-controller-manager-6f9f468797-ct7rc | |
kuadrant-system |
deployment-controller |
limitador-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set limitador-operator-controller-manager-6f9f468797 from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
AllRequirementsMet |
all requirements found, attempting install | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-ct7rc |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:183bad2a6f5872aea38f54ad507f7e005d6facb02b18769e0407c82799f96a3e" | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
multus |
limitador-operator-controller-manager-6f9f468797-ct7rc |
AddedInterface |
Add eth0 [10.132.0.34/23] from ovn-kubernetes | |
| (x2) | kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
InstallWaiting |
installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability. |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-ct7rc |
Started |
Started container manager | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-ct7rc |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-ct7rc |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:183bad2a6f5872aea38f54ad507f7e005d6facb02b18769e0407c82799f96a3e" in 2.509s (2.509s including waiting). Image size: 178538972 bytes. | |
kuadrant-system |
limitador-operator-controller-manager-6f9f468797-ct7rc_f5ce3e3a-3d91-486c-bc86-97507d7d7504 |
3745a16e.kuadrant.io |
LeaderElection |
limitador-operator-controller-manager-6f9f468797-ct7rc_f5ce3e3a-3d91-486c-bc86-97507d7d7504 became leader | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
replicaset-controller |
kuadrant-operator-controller-manager-bb7ddb7d7 |
SuccessfulCreate |
Created pod: kuadrant-operator-controller-manager-bb7ddb7d7-kp78l | |
kuadrant-system |
deployment-controller |
kuadrant-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set kuadrant-operator-controller-manager-bb7ddb7d7 from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
InstallWaiting |
installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-kp78l |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:0b77e4a874b620095a0300877aea53e78559a601ce62b194537ed21c2743bbf3" | |
kuadrant-system |
multus |
kuadrant-operator-controller-manager-bb7ddb7d7-kp78l |
AddedInterface |
Add eth0 [10.132.0.35/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
InstallWaiting |
installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability. | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
multus |
authorino-operator-6d85f6564-97wxk |
AddedInterface |
Add eth0 [10.133.0.19/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
authorino-operator |
ScalingReplicaSet |
Scaled up replica set authorino-operator-6d85f6564 from 0 to 1 | |
kuadrant-system |
replicaset-controller |
authorino-operator-6d85f6564 |
SuccessfulCreate |
Created pod: authorino-operator-6d85f6564-97wxk | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-97wxk |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:b2cc2c0f0729dad98f970830816e300c0b961ba42491f362295512d886384687" | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
replicaset-controller |
dns-operator-controller-manager-65b49595d7 |
SuccessfulCreate |
Created pod: dns-operator-controller-manager-65b49595d7-76qtk | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-76qtk |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ba46f54446ecd3ed1a3d877dcbb7359ff8f2d918827f3411a5cb0781915a65d5" | |
kuadrant-system |
multus |
dns-operator-controller-manager-65b49595d7-76qtk |
AddedInterface |
Add eth0 [10.132.0.36/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
InstallWaiting |
installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
deployment-controller |
dns-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set dns-operator-controller-manager-65b49595d7 from 0 to 1 | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-97wxk |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:b2cc2c0f0729dad98f970830816e300c0b961ba42491f362295512d886384687" in 2.414s (2.414s including waiting). Image size: 168639631 bytes. | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-97wxk |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-97wxk |
Started |
Started container manager | |
kuadrant-system |
authorino-operator-6d85f6564-97wxk_b72dbfb9-6922-4dd5-955b-121f36aded67 |
aac3a15d.authorino.kuadrant.io |
LeaderElection |
authorino-operator-6d85f6564-97wxk_b72dbfb9-6922-4dd5-955b-121f36aded67 became leader | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-76qtk |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-76qtk |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ba46f54446ecd3ed1a3d877dcbb7359ff8f2d918827f3411a5cb0781915a65d5" in 2.625s (2.625s including waiting). Image size: 190472853 bytes. | |
kuadrant-system |
dns-operator-controller-manager-65b49595d7-76qtk_280173e2-5271-4a69-9cb2-ef79cae69d50 |
a3f98d6c.kuadrant.io |
LeaderElection |
dns-operator-controller-manager-65b49595d7-76qtk_280173e2-5271-4a69-9cb2-ef79cae69d50 became leader | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-76qtk |
Started |
Started container manager | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-kp78l |
Created |
Created container: manager | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
kuadrant-operator-controller-manager-bb7ddb7d7-kp78l_1cbd8287-f3dc-4d32-8b69-6a726afb2841 |
f139389e.kuadrant.io |
LeaderElection |
kuadrant-operator-controller-manager-bb7ddb7d7-kp78l_1cbd8287-f3dc-4d32-8b69-6a726afb2841 became leader | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-kp78l |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:0b77e4a874b620095a0300877aea53e78559a601ce62b194537ed21c2743bbf3" in 9.093s (9.093s including waiting). Image size: 425661757 bytes. | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-kp78l |
Started |
Started container manager | |
kuadrant-system |
replicaset-controller |
kuadrant-console-plugin-85fd4b8b9d |
SuccessfulCreate |
Created pod: kuadrant-console-plugin-85fd4b8b9d-6vqdx | |
kuadrant-system |
deployment-controller |
kuadrant-console-plugin |
ScalingReplicaSet |
Scaled up replica set kuadrant-console-plugin-85fd4b8b9d from 0 to 1 | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-6vqdx |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:6e69f41d3d70b0afa7691a5d2400065d3bcdec2ea82830cf2992b8e69ba06e2a" | |
kuadrant-system |
multus |
kuadrant-console-plugin-85fd4b8b9d-6vqdx |
AddedInterface |
Add eth0 [10.132.0.37/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-6vqdx |
Started |
Started container kuadrant-console-plugin | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-6vqdx |
Created |
Created container: kuadrant-console-plugin | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-6vqdx |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:6e69f41d3d70b0afa7691a5d2400065d3bcdec2ea82830cf2992b8e69ba06e2a" in 4.669s (4.669s including waiting). Image size: 342502139 bytes. | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
replicaset-controller |
limitador-limitador-69574b596d |
SuccessfulCreate |
Created pod: limitador-limitador-69574b596d-4xqs4 | |
kuadrant-system |
multus |
limitador-limitador-69574b596d-4xqs4 |
AddedInterface |
Add eth0 [10.132.0.38/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-4xqs4 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" | |
kuadrant-system |
multus |
limitador-limitador-ff68ff5cb-ph894 |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-ph894 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-b6c89bb85 from 0 to 1 | |
kuadrant-system |
replicaset-controller |
authorino-b6c89bb85 |
SuccessfulCreate |
Created pod: authorino-b6c89bb85-5xw9l | |
kuadrant-system |
replicaset-controller |
limitador-limitador-ff68ff5cb |
SuccessfulCreate |
Created pod: limitador-limitador-ff68ff5cb-ph894 | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-69574b596d from 0 to 1 | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-ff68ff5cb from 0 to 1 | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-5xw9l |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" | |
kuadrant-system |
multus |
authorino-b6c89bb85-5xw9l |
AddedInterface |
Add eth0 [10.133.0.20/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-8df697c9f from 0 to 1 | |
kuadrant-system |
multus |
authorino-8df697c9f-cgx8d |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kuadrant-system |
replicaset-controller |
authorino-8df697c9f |
SuccessfulCreate |
Created pod: authorino-8df697c9f-cgx8d | |
kuadrant-system |
kubelet |
authorino-8df697c9f-cgx8d |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-ph894 |
Started |
Started container limitador | |
kuadrant-system |
kubelet |
authorino-8df697c9f-cgx8d |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-5xw9l |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-4xqs4 |
Started |
Started container limitador | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-5xw9l |
Started |
Started container authorino | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-5xw9l |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" in 2.538s (2.538s including waiting). Image size: 202706732 bytes. | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-ph894 |
Created |
Created container: limitador | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-4xqs4 |
Created |
Created container: limitador | |
kuadrant-system |
kubelet |
authorino-8df697c9f-cgx8d |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" in 2.856s (2.856s including waiting). Image size: 202706732 bytes. | |
kuadrant-system |
kubelet |
authorino-8df697c9f-cgx8d |
Started |
Started container authorino | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-4xqs4 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" in 3.631s (3.631s including waiting). Image size: 250499765 bytes. | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-ph894 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" in 4.144s (4.144s including waiting). Image size: 250499765 bytes. | |
kuadrant-system |
replicaset-controller |
authorino-b6c89bb85 |
SuccessfulDelete |
Deleted pod: authorino-b6c89bb85-5xw9l | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-b6c89bb85 from 1 to 0 | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-5xw9l |
Killing |
Stopping container authorino | |
kuadrant-system |
replicaset-controller |
limitador-limitador-ff68ff5cb |
SuccessfulDelete |
Deleted pod: limitador-limitador-ff68ff5cb-ph894 | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-ph894 |
Killing |
Stopping container limitador | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled down replica set limitador-limitador-ff68ff5cb from 1 to 0 | |
kuadrant-system |
replicaset-controller |
authorino-7c77957575 |
SuccessfulCreate |
Created pod: authorino-7c77957575-w4lkk | |
kuadrant-system |
kubelet |
authorino-7c77957575-w4lkk |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" | |
kuadrant-system |
multus |
authorino-7c77957575-w4lkk |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-7c77957575 from 0 to 1 | |
kuadrant-system |
kubelet |
authorino-7c77957575-w4lkk |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" in 545ms (545ms including waiting). Image size: 202706732 bytes. | |
kuadrant-system |
kubelet |
authorino-8df697c9f-cgx8d |
Killing |
Stopping container authorino | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-8df697c9f from 1 to 0 | |
kuadrant-system |
kubelet |
authorino-7c77957575-w4lkk |
Created |
Created container: authorino | |
kuadrant-system |
replicaset-controller |
authorino-8df697c9f |
SuccessfulDelete |
Deleted pod: authorino-8df697c9f-cgx8d | |
kuadrant-system |
kubelet |
authorino-7c77957575-w4lkk |
Started |
Started container authorino | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-8zpjr |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-799f46c59b-8zpjr |
AddedInterface |
Add eth0 [10.133.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-8zpjr |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-8zpjr |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-799f46c59b-8zpjr | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-54c47cdfc7-7cwwt | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-54c47cdfc7-7cwwt |
AddedInterface |
Add eth0 [10.133.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-799f46c59b-8zpjr | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-8zpjr |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.Secret kserve-ci-e2e-test/gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5xdnmc |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
kserve-ci-e2e-test |
multus |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5xdnmc |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-route | |
kserve-ci-e2e-test |
deployment-controller |
gw-section-name-router-with-gat-2f0a622e-kserve |
ScalingReplicaSet |
Scaled up replica set gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5 |
SuccessfulCreate |
Created pod: gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5xdnmc | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5xdnmc |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5xdnmc |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.067s (1.067s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5xdnmc |
Created |
Created container: main | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-799f46c59b-2gq6r | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-799f46c59b-2gq6r |
AddedInterface |
Add eth0 [10.133.0.24/23] from ovn-kubernetes | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
precise-prefix-cache-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy precise-prefix-cache-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "precise-prefix-cache-test-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-7cwwt |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.23:15021/healthz/ready": read tcp 10.133.0.2:52112->10.133.0.23:15021: read: connection reset by peer | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-7cwwt |
Started |
Started container istio-proxy |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-7cwwt |
Created |
Created container: istio-proxy |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-7cwwt |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-2gq6r |
Unhealthy |
Startup probe failed: Get "http://10.133.0.24:15021/healthz/ready": read tcp 10.133.0.2:56484->10.133.0.24:15021: read: connection reset by peer | |
| (x8) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-2gq6r |
Unhealthy |
Startup probe failed: Get "http://10.133.0.24:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-7597885744 |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-7597885744-t6hgf | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/precise-prefix-cache-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Role kserve-ci-e2e-test/precise-prefix-cache-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-2gq6r |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-2gq6r |
Started |
Started container istio-proxy |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-7597885744 |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-7597885744-94nl8 | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-2gq6r |
Created |
Created container: istio-proxy |
kserve-ci-e2e-test |
deployment-controller |
precise-prefix-cache-test-kserve |
ScalingReplicaSet |
Scaled up replica set precise-prefix-cache-test-kserve-7597885744 from 0 to 2 | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-7597885744-94nl8 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-7597885744-t6hgf |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
deployment-controller |
precise-prefix-cache-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set precise-prefix-cache-test-kserve-router-scheduler-5bf6f9486c from 0 to 1 | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f9486c |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-7597885744-94nl8 |
AddedInterface |
Add eth0 [10.132.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-7597885744-t6hgf |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/precise-prefix-cache-test-epp-rb | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-7597885744-t6hgf |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-7597885744-t6hgf |
Started |
Started container storage-initializer | |
| (x5) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-7cwwt |
Unhealthy |
Startup probe failed: Get "http://10.133.0.23:15021/healthz/ready": dial tcp 10.133.0.23:15021: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
Pulling |
Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-7597885744-94nl8 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-7597885744-t6hgf |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-7597885744-t6hgf |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-7597885744-94nl8 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" in 3.301s (3.301s including waiting). Image size: 300574656 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-7597885744-t6hgf |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-7597885744-94nl8 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5xdnmc |
Killing |
Stopping container main | |
| (x6) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-2gq6r |
Unhealthy |
Startup probe failed: Get "http://10.133.0.24:15021/healthz/ready": dial tcp 10.133.0.24:15021: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-7597885744-94nl8 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
Pulling |
Pulling image "quay.io/opendatahub/llm-d-kv-cache:v0.8.0" | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" in 3.778s (3.778s including waiting). Image size: 179512283 bytes. | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-7cwwt |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-54c47cdfc7-7cwwt | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled down replica set router-gateway-1-openshift-default-54c47cdfc7 from 1 to 0 | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-7597885744-94nl8 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.003s (1.003s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-7597885744-94nl8 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-7597885744-94nl8 |
Created |
Created container: main | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-655f7c58b4-lcjkw |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
| (x2) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-655f7c58b4-lcjkw |
Created |
Created container: istio-proxy |
| (x2) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-655f7c58b4-lcjkw |
Started |
Started container istio-proxy |
| (x5) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-655f7c58b4-lcjkw |
ProbeError |
Startup probe error: Get "http://10.133.0.17:15021/healthz/ready": dial tcp 10.133.0.17:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-655f7c58b4-lcjkw |
Unhealthy |
Startup probe failed: Get "http://10.133.0.17:15021/healthz/ready": dial tcp 10.133.0.17:15021: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.Secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
gw-section-name-router-with-gat-f1d92d0f-kserve |
ScalingReplicaSet |
Scaled up replica set gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b |
SuccessfulCreate |
Created pod: gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc | |
kserve-ci-e2e-test |
multus |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf |
AddedInterface |
Add eth0 [10.133.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.056s (1.056s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
UpdateFailed |
Failed to update status for LLMInferenceService "gw-section-name-router-with-gat-f1d92d0f": Operation cannot be fulfilled on llminferenceservices.serving.kserve.io "gw-section-name-router-with-gat-f1d92d0f": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf |
Created |
Created container: main | |
| (x2) | kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-1-openshift-default-54c47cdfc7 from 0 to 1 |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-54c47cdfc7-gjwrm | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-54c47cdfc7-gjwrm |
AddedInterface |
Add eth0 [10.133.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-799f46c59b-2gq6r | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-2gq6r |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/precise-prefix-cache-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bk2lkf |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
Pulled |
Successfully pulled image "quay.io/opendatahub/llm-d-kv-cache:v0.8.0" in 40.725s (40.725s including waiting). Image size: 2935159967 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-enabled-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
auth-enabled-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set auth-enabled-test-kserve-router-scheduler-8444585c95 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-enabled-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/auth-enabled-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Role kserve-ci-e2e-test/auth-enabled-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-enabled-test-epp-auth-rb | |
kserve-ci-e2e-test |
replicaset-controller |
auth-enabled-test-kserve-router-scheduler-8444585c95 |
SuccessfulCreate |
Created pod: auth-enabled-test-kserve-router-scheduler-8444585c95-fwn2t | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/auth-enabled-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-enabled-test-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
auth-enabled-test-kserve-598dd9464 |
SuccessfulCreate |
Created pod: auth-enabled-test-kserve-598dd9464-dqmnc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Secret kserve-ci-e2e-test/auth-enabled-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
auth-enabled-test-kserve |
ScalingReplicaSet |
Scaled up replica set auth-enabled-test-kserve-598dd9464 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-598dd9464-dqmnc |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
auth-enabled-test-kserve-598dd9464-dqmnc |
AddedInterface |
Add eth0 [10.132.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-8444585c95-fwn2t |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-598dd9464-dqmnc |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-598dd9464-dqmnc |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-8444585c95-fwn2t |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-8444585c95-fwn2t |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
auth-enabled-test-kserve-router-scheduler-8444585c95-fwn2t |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-8444585c95-fwn2t |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-8444585c95-fwn2t |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-8444585c95-fwn2t |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-598dd9464-dqmnc |
Pulling |
Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/auth-enabled-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/auth-enabled-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-enabled-test-kserve-shadow-svc |
| (x4) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
BackOff |
Back-off restarting failed container main in pod precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm_kserve-ci-e2e-test(517feab4-224b-4309-9286-c8cfe4236e75) |
| (x2) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine |
| (x3) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
Started |
Started container main |
| (x3) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
Created |
Created container: main |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-598dd9464-dqmnc |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-598dd9464-dqmnc |
Pulled |
Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" in 27.017s (27.017s including waiting). Image size: 3531177328 bytes. | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-598dd9464-dqmnc |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
Unhealthy |
Liveness probe failed: timeout: failed to connect service "10.134.0.39:9003" within 1s: context deadline exceeded | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
Unhealthy |
Liveness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
LLMInferenceServiceReady |
LLMInferenceService [precise-prefix-cache-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-7597885744-94nl8 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-7597885744-t6hgf |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
| (x2) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-5bf6f948cxswm |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.39:8082/healthz": dial tcp 10.134.0.39:8082: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-7597885744-94nl8 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.40:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testef4d2875be14b30dc1561ed84d0d4bde-llmisvc-rout | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879 |
SuccessfulCreate |
Created pod: llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2 | |
kserve-ci-e2e-test |
multus |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2 |
AddedInterface |
Add eth0 [10.133.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-rb | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-router-managed-test-llm-e45d1f79-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-sa | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler-7c9f98478b from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler-7c9f98478b |
SuccessfulCreate |
Created pod: llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schezhqlg | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2 |
Created |
Created container: main | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-router-managed-test-llm-e45d1f79 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-e45d1f79-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-e45d1f79-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schezhqlg |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schezhqlg |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schezhqlg |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schezhqlg |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-shadow-svc |
| (x10) | kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-598dd9464-dqmnc |
Unhealthy |
Startup probe failed: Get "https://10.132.0.41:8000/health": dial tcp 10.132.0.41:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-router-managed-test-llm-e45d1f79] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schezhqlg |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testef4d2875be14b30dc1561ed84d0d4bde-llmisvc-rout | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879mfts2 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
LLMInferenceServiceReady |
LLMInferenceService [auth-enabled-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schezhqlg |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-enabled-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-598dd9464-dqmnc |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-8444585c95-fwn2t |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-8444585c95-fwn2t |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-router-managed-test-llm-5b1e8f15 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-5b1e8f15-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-5b1e8f15-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-598dd9464-dqmnc |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.41:8000/health": dial tcp 10.132.0.41:8000: connect: connection refused | |
kserve-ci-e2e-test |
multus |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4xbrg9 |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4xbrg9 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4xbrg9 |
Started |
Started container main | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-router-managed-test-llm-5b1e8f15-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler-6586f4d6cc |
SuccessfulCreate |
Created pod: llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherkzd9 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler-6586f4d6cc from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4xbrg9 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4 |
SuccessfulCreate |
Created pod: llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4xbrg9 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test7f54e84970003a6e7372bdbcb574f7ed-llmisvc-rout | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherkzd9 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherkzd9 |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherkzd9 |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherkzd9 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-invalid-token-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-invalid-token-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-invalid-token-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-invalid-token-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/auth-invalid-token-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-invalid-token-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/auth-invalid-token-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Role kserve-ci-e2e-test/auth-invalid-token-test-epp-role | |
kserve-ci-e2e-test |
replicaset-controller |
auth-invalid-token-test-kserve-router-scheduler-66fccd984f |
SuccessfulCreate |
Created pod: auth-invalid-token-test-kserve-router-scheduler-66fccd984fhr5cm | |
kserve-ci-e2e-test |
deployment-controller |
auth-invalid-token-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set auth-invalid-token-test-kserve-router-scheduler-66fccd984f from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
auth-invalid-token-test-kserve |
ScalingReplicaSet |
Scaled up replica set auth-invalid-token-test-kserve-6c78d67c56 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Secret kserve-ci-e2e-test/auth-invalid-token-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
auth-invalid-token-test-kserve-6c78d67c56 |
SuccessfulCreate |
Created pod: auth-invalid-token-test-kserve-6c78d67c56-sxd27 | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-6c78d67c56-sxd27 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-66fccd984fhr5cm |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-66fccd984fhr5cm |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-66fccd984fhr5cm |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
auth-invalid-token-test-kserve-router-scheduler-66fccd984fhr5cm |
AddedInterface |
Add eth0 [10.132.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-6c78d67c56-sxd27 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-6c78d67c56-sxd27 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
multus |
auth-invalid-token-test-kserve-6c78d67c56-sxd27 |
AddedInterface |
Add eth0 [10.132.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-66fccd984fhr5cm |
Pulling |
Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-66fccd984fhr5cm |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" in 3.086s (3.086s including waiting). Image size: 179512283 bytes. | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-66fccd984fhr5cm |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-66fccd984fhr5cm |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-6c78d67c56-sxd27 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-6c78d67c56-sxd27 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-6c78d67c56-sxd27 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/auth-invalid-token-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/auth-invalid-token-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-invalid-token-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-router-managed-test-llm-5b1e8f15] is Ready | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler-69655bc8c5 |
SuccessfulCreate |
Created pod: llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schecp7wv | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd |
SuccessfulCreate |
Created pod: llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testb7025ca4d8a6f8f5b2fd08b5581d2678-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-service | |
kserve-ci-e2e-test |
deployment-controller |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler-69655bc8c5 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schecp7wv |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schecp7wv |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schecp7wv |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schecp7wv |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd4k5ng |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testb7025ca4d8a6f8f5b2fd08b5581d2678-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-a50492e9] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schecp7wv |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schecp7wv |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4xbrg9 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test7f54e84970003a6e7372bdbcb574f7ed-llmisvc-rout | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherkzd9 |
Killing |
Stopping container main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scherkzd9 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x11) | kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-6c78d67c56-sxd27 |
Unhealthy |
Startup probe failed: Get "https://10.132.0.42:8000/health": dial tcp 10.132.0.42:8000: connect: connection refused |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-router-managed-test-llm-4b931143 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-4b931143-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-4b931143-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-router-managed-test-llm-4b931143-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56 |
SuccessfulCreate |
Created pod: llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-rrpmk | |
kserve-ci-e2e-test |
deployment-controller |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler-595f78db49 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler-595f78db49 |
SuccessfulCreate |
Created pod: llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche7vqpj | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test8ac8e3d2264ccb939eb021b0b835847c-llmisvc-rout | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-workload-svc | |
kserve-ci-e2e-test |
multus |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche7vqpj |
AddedInterface |
Add eth0 [10.134.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche7vqpj |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche7vqpj |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-rrpmk |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-rrpmk |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-rrpmk |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-rrpmk |
AddedInterface |
Add eth0 [10.134.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche7vqpj |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
LLMInferenceServiceReady |
LLMInferenceService [auth-invalid-token-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-route | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-6c78d67c56-sxd27 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-invalid-token-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-66fccd984fhr5cm |
Killing |
Stopping container main | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-router-managed-test-llm-4b931143] is Ready | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-66fccd984fhr5cm |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler-6db55854f4 |
SuccessfulCreate |
Created pod: llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scherdpsl | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler-6db55854f4 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f |
SuccessfulCreate |
Created pod: llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test76d7f532acb694e4a7bcef75d32cd8a1-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn |
Created |
Created container: main | |
kserve-ci-e2e-test |
multus |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scherdpsl |
AddedInterface |
Add eth0 [10.134.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scherdpsl |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scherdpsl |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scherdpsl |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-6c78d67c56-sxd27 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.42:8000/health": dial tcp 10.132.0.42:8000: connect: connection refused | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-shadow-svc |
| (x14) | kserve-ci-e2e-test |
OpenDataHubModelController |
auth-disabled-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy auth-disabled-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/auth-disabled-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "auth-disabled-test-kserve-route" not found |
kserve-ci-e2e-test |
replicaset-controller |
auth-disabled-test-kserve-router-scheduler-cbd548bb4 |
SuccessfulCreate |
Created pod: auth-disabled-test-kserve-router-scheduler-cbd548bb4-6hsgn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-disabled-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Secret kserve-ci-e2e-test/auth-disabled-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
multus |
auth-disabled-test-kserve-7998df8854-d9nzk |
AddedInterface |
Add eth0 [10.132.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-7998df8854-d9nzk |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-7998df8854-d9nzk |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
auth-disabled-test-kserve |
ScalingReplicaSet |
Scaled up replica set auth-disabled-test-kserve-7998df8854 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
auth-disabled-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set auth-disabled-test-kserve-router-scheduler-cbd548bb4 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/auth-disabled-test-epp-rb | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-7998df8854-d9nzk |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-disabled-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/auth-disabled-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-disabled-test-epp-auth-rb | |
kserve-ci-e2e-test |
replicaset-controller |
auth-disabled-test-kserve-7998df8854 |
SuccessfulCreate |
Created pod: auth-disabled-test-kserve-7998df8854-d9nzk | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Role kserve-ci-e2e-test/auth-disabled-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-disabled-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-disabled-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-cbd548bb4-6hsgn |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-cbd548bb4-6hsgn |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-cbd548bb4-6hsgn |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
multus |
auth-disabled-test-kserve-router-scheduler-cbd548bb4-6hsgn |
AddedInterface |
Add eth0 [10.132.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-cbd548bb4-6hsgn |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-cbd548bb4-6hsgn |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-cbd548bb4-6hsgn |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-4f8c0978] is Ready | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-7998df8854-d9nzk |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-7998df8854-d9nzk |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-7998df8854-d9nzk |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/auth-disabled-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/auth-disabled-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-disabled-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test76d7f532acb694e4a7bcef75d32cd8a1-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scherdpsl |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn |
Killing |
Stopping container main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scherdpsl |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fst4hn |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.29:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test8ac8e3d2264ccb939eb021b0b835847c-llmisvc-rout | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-rrpmk |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche7vqpj |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche7vqpj |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-d66767cfc-twflf |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-d66767cfc |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-7ca60146-kserve-d66767cfc-twflf | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-rb | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler-7b8c64659f from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-7ca60146-kserve-d66767cfc from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-d66767cfc-twflf |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-d66767cfc-twflf |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-sa | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler-7b8c64659f |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-sche2l22r | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test5216bfd716f919dc046bc693ceb22e41-llmisvc-mode | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-sche2l22r |
AddedInterface |
Add eth0 [10.134.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-sche2l22r |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-d66767cfc-twflf |
AddedInterface |
Add eth0 [10.132.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-sche2l22r |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-sche2l22r |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-sche2l22r |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-sche2l22r |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-sche2l22r |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-d66767cfc-twflf |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-d66767cfc-twflf |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-d66767cfc-twflf |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-shadow-svc |
| (x11) | kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-7998df8854-d9nzk |
Unhealthy |
Startup probe failed: Get "https://10.132.0.44:8000/health": dial tcp 10.132.0.44:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
LLMInferenceServiceReady |
LLMInferenceService [auth-disabled-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-7998df8854-d9nzk |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-disabled-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-cbd548bb4-6hsgn |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-cbd548bb4-6hsgn |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-7998df8854-d9nzk |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.44:8000/health": dial tcp 10.132.0.44:8000: connect: connection refused | |
| (x7) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-d66767cfc-twflf |
Unhealthy |
Startup probe failed: Get "https://10.132.0.46:8000/health": dial tcp 10.132.0.46:8000: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-nbkkb |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-799f46c59b-nbkkb | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-799f46c59b-nbkkb | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-nbkkb |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-nbkkb |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-799f46c59b-nbkkb |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-nbkkb |
Killing |
Stopping container istio-proxy | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route" not found |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-gjwrm |
Created |
Created container: istio-proxy |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-gjwrm |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-gjwrm |
Started |
Started container istio-proxy |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-e95b1dc1] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-with-7ca60146] is Ready | |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs |
| (x5) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-gjwrm |
Unhealthy |
Startup probe failed: Get "http://10.133.0.26:15021/healthz/ready": dial tcp 10.133.0.26:15021: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4j8wph |
Killing |
Stopping container main | |
| (x3) | kserve-ci-e2e-test |
GatewayAuthBootstrap |
router-gateway-1 |
ReconcileError |
Failed to delete gateway PodMonitor: failed to delete PodMonitor: podmonitors.monitoring.coreos.com "router-gateway-1-metrics" not found |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-87882a8e |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route" not found |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5fcd5db4dd |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5fcd5db4ddxt8b4 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5fcd5db4ddxt8b4 |
AddedInterface |
Add eth0 [10.132.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5fcd5db4ddxt8b4 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5fcd5db4ddxt8b4 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5fcd5db4ddxt8b4 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexlpkr |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexlpkr |
AddedInterface |
Add eth0 [10.134.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-role | |
kserve-ci-e2e-test |
deployment-controller |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler-d6c7dbb9 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler-d6c7dbb9 |
SuccessfulCreate |
Created pod: llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexlpkr | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test21fe6730fe484f3a92b1a16afe1bac8f-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-workload-svc | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5fcd5db4dd from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexlpkr |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexlpkr |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexlpkr |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexlpkr |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexlpkr |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-d66767cfc-twflf |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-sche2l22r |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test5216bfd716f919dc046bc693ceb22e41-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5fcd5db4ddxt8b4 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5fcd5db4ddxt8b4 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5fcd5db4ddxt8b4 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-shadow-svc |
| (x2) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-sche2l22r |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-sa | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6cc48f668b-md6gb |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6cc48f668b-md6gb |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6cc48f668b-md6gb |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test05addb65ba05195619f26ef266e8fc04-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-workload-svc | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6cc48f668b-md6gb |
AddedInterface |
Add eth0 [10.132.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler-7575997cbd from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6cc48f668b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6cc48f668b |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6cc48f668b-md6gb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-service | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler-7575997cbd |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schejbt5j | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schejbt5j |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schejbt5j |
AddedInterface |
Add eth0 [10.134.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schejbt5j |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schejbt5j |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schejbt5j |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schejbt5j |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schejbt5j |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6cc48f668b-md6gb |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6cc48f668b-md6gb |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6cc48f668b-md6gb |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route | |
| (x7) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6cc48f668b-md6gb |
Unhealthy |
Startup probe failed: Get "https://10.132.0.48:8000/health": dial tcp 10.132.0.48:8000: connect: connection refused |
| (x11) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5fcd5db4ddxt8b4 |
Unhealthy |
Startup probe failed: Get "https://10.132.0.47:8000/health": dial tcp 10.132.0.47:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-with-ba4d693a] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-87882a8e] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test21fe6730fe484f3a92b1a16afe1bac8f-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5fcd5db4ddxt8b4 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexlpkr |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6cc48f668b-md6gb |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test05addb65ba05195619f26ef266e8fc04-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schejbt5j |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schexlpkr |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
| (x2) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schejbt5j |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5fcd5db4ddxt8b4 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.47:8000/health": dial tcp 10.132.0.47:8000: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6cc48f668b-md6gb |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.48:8000/health": dial tcp 10.132.0.48:8000: connect: connection refused | |
kserve-ci-e2e-test |
persistentvolume-controller |
e2e-pvc-model-storage |
WaitForFirstConsumer |
waiting for first consumer to be created before binding | |
| (x2) | kserve-ci-e2e-test |
persistentvolume-controller |
e2e-pvc-model-storage |
ExternalProvisioning |
Waiting for a volume to be created either by the external provisioner 'ebs.csi.aws.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. |
kserve-ci-e2e-test |
ebs.csi.aws.com_aws-ebs-csi-driver-controller-78b5546f6b-2bnq4_6eab85ca-fdf5-4079-ab3c-1f5d8415a6b6 |
e2e-pvc-model-storage |
Provisioning |
External provisioner is provisioning volume for claim "kserve-ci-e2e-test/e2e-pvc-model-storage" | |
kserve-ci-e2e-test |
job-controller |
e2e-pvc-model-download |
SuccessfulCreate |
Created pod: e2e-pvc-model-download-w44vk | |
kserve-ci-e2e-test |
ebs.csi.aws.com_aws-ebs-csi-driver-controller-78b5546f6b-2bnq4_6eab85ca-fdf5-4079-ab3c-1f5d8415a6b6 |
e2e-pvc-model-storage |
ProvisioningSucceeded |
Successfully provisioned volume pvc-04ad49c2-6cf9-47f2-b0f1-d4607b16c200 | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
custom-route-timeout-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-test-epp-sa | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-test-kserve-bd7dd6dc4 |
SuccessfulCreate |
Created pod: custom-route-timeout-test-kserve-bd7dd6dc4-zfhxm | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Role kserve-ci-e2e-test/custom-route-timeout-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-kserve-workload-svc | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-test-kserve-router-scheduler-6c56cf9764 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-test-kserve |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-test-kserve-bd7dd6dc4 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve | |
kserve-ci-e2e-test |
attachdetach-controller |
e2e-pvc-model-download-w44vk |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-04ad49c2-6cf9-47f2-b0f1-d4607b16c200" | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-test-kserve-router-scheduler-6c56cf9764 |
SuccessfulCreate |
Created pod: custom-route-timeout-test-kserve-router-scheduler-6c56cf97vk2ts | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-test-kserve-router-scheduler-6c56cf97vk2ts |
AddedInterface |
Add eth0 [10.134.0.52/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-6c56cf97vk2ts |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-6c56cf97vk2ts |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-bd7dd6dc4-zfhxm |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-bd7dd6dc4-zfhxm |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-6c56cf97vk2ts |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-bd7dd6dc4-zfhxm |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-test-kserve-bd7dd6dc4-zfhxm |
AddedInterface |
Add eth0 [10.132.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-6c56cf97vk2ts |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-6c56cf97vk2ts |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-6c56cf97vk2ts |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-bd7dd6dc4-zfhxm |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-bd7dd6dc4-zfhxm |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-bd7dd6dc4-zfhxm |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
e2e-pvc-model-download-w44vk |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
multus |
e2e-pvc-model-download-w44vk |
AddedInterface |
Add eth0 [10.134.0.51/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
e2e-pvc-model-download-w44vk |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
e2e-pvc-model-download-w44vk |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route | |
kserve-ci-e2e-test |
job-controller |
e2e-pvc-model-download |
Completed |
Job completed | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-pvc-router-manage-59b9d263 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-59b9d263-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-59b9d263-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler-6c65b6df8d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler-6c65b6df8d |
SuccessfulCreate |
Created pod: llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scherndv9 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testc9569cf4801efc0ed27b2f25ffaee875-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv8bf079eb6eda4debfb4ef5bb7817824c-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-pvc-router-manage-59b9d263-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d |
SuccessfulCreate |
Created pod: llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dxd8ww | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scherndv9 |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scherndv9 |
AddedInterface |
Add eth0 [10.134.0.53/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scherndv9 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scherndv9 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dxd8ww |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-04ad49c2-6cf9-47f2-b0f1-d4607b16c200" | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dxd8ww |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dxd8ww |
AddedInterface |
Add eth0 [10.132.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dxd8ww |
Created |
Created container: main | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scherndv9 |
FailedAttachVolume |
Multi-Attach error for volume "pvc-04ad49c2-6cf9-47f2-b0f1-d4607b16c200" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dxd8ww | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dxd8ww |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-shadow-svc |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv8bf079eb6eda4debfb4ef5bb7817824c-kserve-self-signed-certs |
| (x12) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-bd7dd6dc4-zfhxm |
Unhealthy |
Startup probe failed: Get "https://10.132.0.49:8000/health": dial tcp 10.132.0.49:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
LLMInferenceServiceReady |
LLMInferenceService [custom-route-timeout-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-bd7dd6dc4-zfhxm |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-6c56cf97vk2ts |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-6c56cf97vk2ts |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
| (x12) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dxd8ww |
Unhealthy |
Startup probe failed: Get "https://10.132.0.50:8000/health": dial tcp 10.132.0.50:8000: connect: connection refused |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-799f46c59b-hd9rl | |
| (x4) | kserve-ci-e2e-test |
gateway_labeler_controller |
router-gateway-1 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway router-gateway-1 |
| (x4) | kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-1-openshift-default-799f46c59b from 0 to 1 |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-799f46c59b-hd9rl |
AddedInterface |
Add eth0 [10.133.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-hd9rl |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-hd9rl |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-hd9rl |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-799f46c59b-hd9rl | |
| (x4) | kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled down replica set router-gateway-1-openshift-default-799f46c59b from 1 to 0 |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-pvc-router-manage-59b9d263] is Ready | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-hd9rl |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Role kserve-ci-e2e-test/router-with-refs-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-test-kserve |
ScalingReplicaSet |
Scaled up replica set router-with-refs-test-kserve-7dc67694b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-test-kserve-7dc67694b |
SuccessfulCreate |
Created pod: router-with-refs-test-kserve-7dc67694b-lh52n | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-7dc67694b-lh52n |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
router-with-refs-test-kserve-7dc67694b-lh52n |
AddedInterface |
Add eth0 [10.132.0.51/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-test-kserve-router-scheduler-55c98c487b |
SuccessfulCreate |
Created pod: router-with-refs-test-kserve-router-scheduler-55c98c487b-tzm6k | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-7dc67694b-lh52n |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-7dc67694b-lh52n |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set router-with-refs-test-kserve-router-scheduler-55c98c487b from 0 to 1 | |
kserve-ci-e2e-test |
multus |
router-with-refs-test-kserve-router-scheduler-55c98c487b-tzm6k |
AddedInterface |
Add eth0 [10.134.0.54/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-55c98c487b-tzm6k |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-55c98c487b-tzm6k |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-55c98c487b-tzm6k |
Started |
Started container storage-initializer | |
| (x5) | kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testc9569cf4801efc0ed27b2f25ffaee875-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-55c98c487b-tzm6k |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-55c98c487b-tzm6k |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-55c98c487b-tzm6k |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dxd8ww |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scherndv9 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-7dc67694b-lh52n |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-7dc67694b-lh52n |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-7dc67694b-lh52n |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs | |
| (x2) | kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scherndv9 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dxd8ww |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.50:8000/health": dial tcp 10.132.0.50:8000: connect: connection refused | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79497db4cc |
SuccessfulCreate |
Created pod: llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-797zsws | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-role | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79497db4cc from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-prefill | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468 |
SuccessfulCreate |
Created pod: llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-vs44g | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvb19f98874e050eec8ca94d49676113f0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testf5d060a5eb39a04e074b78907a1556a6-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schehvsgn |
Created |
Created container: main | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-pvc-router-manage-e8706282 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-e8706282-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-e8706282-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schehvsgn |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-epp-sa | |
kserve-ci-e2e-test |
multus |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schehvsgn |
AddedInterface |
Add eth0 [10.134.0.55/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler-77688f7d79 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler-77688f7d79 |
SuccessfulCreate |
Created pod: llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schehvsgn | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schehvsgn |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-route | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-shadow-svc |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schehvsgn |
FailedAttachVolume |
Multi-Attach error for volume "pvc-04ad49c2-6cf9-47f2-b0f1-d4607b16c200" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-vs44g, llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-797zsws | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-vs44g |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-04ad49c2-6cf9-47f2-b0f1-d4607b16c200" | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-797zsws |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-04ad49c2-6cf9-47f2-b0f1-d4607b16c200" | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-vs44g |
Pulling |
Pulling image "quay.io/opendatahub/odh-llm-d-router-disagg-sidecar:v0.9.0" | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-797zsws |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-vs44g |
AddedInterface |
Add eth0 [10.132.0.52/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-797zsws |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-797zsws |
AddedInterface |
Add eth0 [10.132.0.53/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-797zsws |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-vs44g |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-vs44g |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-vs44g |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-disagg-sidecar:v0.9.0" in 1.753s (1.753s including waiting). Image size: 166803393 bytes. | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-vs44g |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-vs44g |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-vs44g |
Started |
Started container main | |
| (x3) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvb19f98874e050eec8ca94d49676113f0-kserve-self-signed-certs |
| (x11) | kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-7dc67694b-lh52n |
Unhealthy |
Startup probe failed: Get "https://10.132.0.51:8000/health": dial tcp 10.132.0.51:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
LLMInferenceServiceReady |
LLMInferenceService [router-with-refs-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-7dc67694b-lh52n |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-55c98c487b-tzm6k |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-55c98c487b-tzm6k |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-7dc67694b-lh52n |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.51:8000/health": dial tcp 10.132.0.51:8000: connect: connection refused | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-50bc673d |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test00d7278d8a22c4e39146a6b0eb840f45-llmisvc-mode | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5b787ff89f from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-role | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5b787ff89f |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5bwl2gq | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbfhfsgk |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-disagg-sidecar:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbfhfsgk |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbf from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-epp-sa | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbfhfsgk |
AddedInterface |
Add eth0 [10.132.0.54/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler-6c9bbbc76f |
SuccessfulCreate |
Created pod: llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schewjstj | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbf |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbfhfsgk | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler-6c9bbbc76f from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbfhfsgk |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5bwl2gq |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5bwl2gq |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5bwl2gq |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5bwl2gq |
AddedInterface |
Add eth0 [10.132.0.55/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schewjstj |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schewjstj |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schewjstj |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schewjstj |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schewjstj |
AddedInterface |
Add eth0 [10.134.0.56/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbfhfsgk |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbfhfsgk |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbfhfsgk |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schewjstj |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schewjstj |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5bwl2gq |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5bwl2gq |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5bwl2gq |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbfhfsgk |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbfhfsgk |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbfhfsgk |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route | |
| (x16) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-vs44g |
Unhealthy |
Startup probe failed: Get "https://10.132.0.52:8001/health": dial tcp 10.132.0.52:8001: connect: connection refused |
| (x16) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-797zsws |
Unhealthy |
Startup probe failed: Get "https://10.132.0.53:8000/health": dial tcp 10.132.0.53:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-pvc-router-manage-e8706282] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testf5d060a5eb39a04e074b78907a1556a6-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-vs44g |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-vs44g |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schehvsgn |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-797zsws |
Killing |
Stopping container main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schehvsgn |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-pvc-router-manage-2577e794 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-2577e794-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-2577e794-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-scc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test37591b20e96e9663d45a730d03070f1e-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schestqb2 |
Started |
Started container main | |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
GroupsProgressing |
Replicas are progressing, with 0 groups ready of total 1 groups |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler-794465cd98 |
SuccessfulCreate |
Created pod: llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schestqb2 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler-794465cd98 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-sa | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
SuccessfulCreate |
create Pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 in StatefulSet llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 successful | |
kserve-ci-e2e-test |
multus |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schestqb2 |
AddedInterface |
Add eth0 [10.134.0.57/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
SuccessfulCreate |
create Pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 in StatefulSet llmisvc-model-pvc-router-manage-2577e794-kserve-mn successful | |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schestqb2 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
CreatingRevision |
Creating revision with key 686d468674 for a newly created LeaderWorkerSet | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-rb | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
GroupsProgressing |
Created leader statefulset llmisvc-model-pvc-router-manage-2577e794-kserve-mn | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
GroupsProgressing |
Created worker statefulset for leader pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 | |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schestqb2 |
Created |
Created container: main | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-04ad49c2-6cf9-47f2-b0f1-d4607b16c200" | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schestqb2 |
FailedAttachVolume |
Multi-Attach error for volume "pvc-04ad49c2-6cf9-47f2-b0f1-d4607b16c200" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0, llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Created |
Created container: main | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
AddedInterface |
Add eth0 [10.132.0.57/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
AddedInterface |
Add eth0 [10.132.0.56/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-route | |
| (x8) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-shadow-svc |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs |
| (x18) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5bwl2gq |
Unhealthy |
Startup probe failed: Get "https://10.132.0.55:8000/health": dial tcp 10.132.0.55:8000: connect: connection refused |
| (x18) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbfhfsgk |
Unhealthy |
Startup probe failed: Get "https://10.132.0.54:8001/health": dial tcp 10.132.0.54:8001: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-50bc673d] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test00d7278d8a22c4e39146a6b0eb840f45-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5bwl2gq |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbfhfsgk |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schewjstj |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbfhfsgk |
Killing |
Stopping container main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schewjstj |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbfhfsgk |
Unhealthy |
Liveness probe failed: Get "https://10.132.0.54:8000/health": dial tcp 10.132.0.54:8000: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbfhfsgk |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.54:8000/health": dial tcp 10.132.0.54:8000: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-6d4d8bcdbfhfsgk |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.54:8000/health": context deadline exceeded | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
custom-route-timeout-pd-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-pd-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-pd-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Role kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-router-scheduler-59cc668989 |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-router-scheduler-59cc6tcb6q | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7886454c6-qxk94 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-disagg-sidecar:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-prefill-fbb965dc8 |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-prefill-fbb965dc8-4nrzb | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-prefill-fbb965dc8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-fbb965dc8-4nrzb |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7886454c6-qxk94 |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-fbb965dc8-4nrzb |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-router-scheduler-59cc6tcb6q |
AddedInterface |
Add eth0 [10.134.0.58/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-59cc6tcb6q |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-59cc6tcb6q |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-59cc6tcb6q |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-fbb965dc8-4nrzb |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-rb | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-prefill-fbb965dc8-4nrzb |
AddedInterface |
Add eth0 [10.132.0.59/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-router-scheduler-59cc668989 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-7886454c6 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-7886454c6-qxk94 |
AddedInterface |
Add eth0 [10.132.0.58/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-7886454c6 |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-7886454c6-qxk94 | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7886454c6-qxk94 |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7886454c6-qxk94 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7886454c6-qxk94 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7886454c6-qxk94 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-59cc6tcb6q |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-59cc6tcb6q |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-59cc6tcb6q |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-fbb965dc8-4nrzb |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-fbb965dc8-4nrzb |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-fbb965dc8-4nrzb |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7886454c6-qxk94 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7886454c6-qxk94 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7886454c6-qxk94 |
Created |
Created container: main | |
| (x16) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Unhealthy |
Startup probe failed: Get "https://10.132.0.56:8000/health": dial tcp 10.132.0.56:8000: connect: connection refused |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs | |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
AllGroupsReady |
All replicas are ready, with 1 groups ready of total 1 groups |
| (x16) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-fbb965dc8-4nrzb |
Unhealthy |
Startup probe failed: Get "https://10.132.0.59:8000/health": dial tcp 10.132.0.59:8000: connect: connection refused |
| (x16) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7886454c6-qxk94 |
Unhealthy |
Startup probe failed: Get "https://10.132.0.58:8001/health": dial tcp 10.132.0.58:8001: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
LLMInferenceServiceReady |
LLMInferenceService [custom-route-timeout-pd-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-59cc6tcb6q |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-fbb965dc8-4nrzb |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7886454c6-qxk94 |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7886454c6-qxk94 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-pvc-router-manage-2577e794] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test37591b20e96e9663d45a730d03070f1e-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schestqb2 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-59cc6tcb6q |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schestqb2 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-2-openshift-default-54c789bdc6 |
SuccessfulCreate |
Created pod: router-gateway-2-openshift-default-54c789bdc6-dckx4 | |
kserve-ci-e2e-test |
gateway_labeler_controller |
router-gateway-2 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway router-gateway-2 | |
kserve-ci-e2e-test |
service-controller |
router-gateway-2-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.56:8000/health": dial tcp 10.132.0.56:8000: connect: connection refused | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-2-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-2-openshift-default-54c789bdc6 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-2-openshift-default-684dc9b4b9 |
SuccessfulCreate |
Created pod: router-gateway-2-openshift-default-684dc9b4b9-mhvbh | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-dckx4 |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
multus |
router-gateway-2-openshift-default-684dc9b4b9-mhvbh |
AddedInterface |
Add eth0 [10.133.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-dckx4 |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-2-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-2-openshift-default-684dc9b4b9 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
router-gateway-2-openshift-default-54c789bdc6-dckx4 |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-dckx4 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-2-openshift-default-54c789bdc6 |
SuccessfulDelete |
Deleted pod: router-gateway-2-openshift-default-54c789bdc6-dckx4 | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-2-openshift-default |
ScalingReplicaSet |
Scaled down replica set router-gateway-2-openshift-default-54c789bdc6 from 1 to 0 | |
kserve-ci-e2e-test |
service-controller |
router-gateway-2-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-dckx4 |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-prefill-6ddb4b6c98-wphcd |
AddedInterface |
Add eth0 [10.132.0.61/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-router-scheduler-9f96557cc |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-router-scheduler-9f96557cc2rtjb | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-prefill-6ddb4b6c98 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-prefill-6ddb4b6c98 |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-prefill-6ddb4b6c98-wphcd | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-6ddb4b6c98-wphcd |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-epp-sa | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-6ddb4b6c98-wphcd |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-6ddb4b6c98-wphcd |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-5ccd7c9ddd |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-5ccd7c9ddd-sbl79 | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-router-scheduler-9f96557cc from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-pd-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-pd-test-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Role kserve-ci-e2e-test/router-with-refs-pd-test-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-5ccd7c9ddd from 0 to 1 | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-5ccd7c9ddd-sbl79 |
AddedInterface |
Add eth0 [10.132.0.60/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5ccd7c9ddd-sbl79 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-disagg-sidecar:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5ccd7c9ddd-sbl79 |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5ccd7c9ddd-sbl79 |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-9f96557cc2rtjb |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5ccd7c9ddd-sbl79 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5ccd7c9ddd-sbl79 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-9f96557cc2rtjb |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5ccd7c9ddd-sbl79 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-9f96557cc2rtjb |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-router-scheduler-9f96557cc2rtjb |
AddedInterface |
Add eth0 [10.134.0.59/23] from ovn-kubernetes | |
| (x9) | kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-pd-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-9f96557cc2rtjb |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-9f96557cc2rtjb |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-9f96557cc2rtjb |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-6ddb4b6c98-wphcd |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-6ddb4b6c98-wphcd |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-6ddb4b6c98-wphcd |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5ccd7c9ddd-sbl79 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5ccd7c9ddd-sbl79 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5ccd7c9ddd-sbl79 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-mhvbh |
Created |
Created container: istio-proxy |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-mhvbh |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-mhvbh |
Started |
Started container istio-proxy |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs | |
| (x5) | kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-mhvbh |
Unhealthy |
Startup probe failed: Get "http://10.133.0.34:15021/healthz/ready": dial tcp 10.133.0.34:15021: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-v1a1-to-v1a2 |
UpdateFailed |
Failed to update status for LLMInferenceService "conv-test-v1a1-to-v1a2": llminferenceservices.serving.kserve.io "conv-test-v1a1-to-v1a2" not found | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-criticality |
UpdateFailed |
Failed to update status for LLMInferenceService "conv-test-criticality": llminferenceservices.serving.kserve.io "conv-test-criticality" not found | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-round-trip |
UpdateFailed |
Failed to update status for LLMInferenceService "conv-test-round-trip": Operation cannot be fulfilled on llminferenceservices.serving.kserve.io "conv-test-round-trip": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-779bc4c586 |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-779bc4c586-hpj62 | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-779bc4c586 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-779bc4c586-hpj62 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-59cf7696fd-549td |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-router-scheduler-59cf7696fd from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-router-scheduler-59cf7696fd |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-router-scheduler-59cf7696fd-549td | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-router-scheduler-59cf7696fd-549td |
AddedInterface |
Add eth0 [10.134.0.60/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-59cf7696fd-549td |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-779bc4c586-hpj62 |
AddedInterface |
Add eth0 [10.132.0.62/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-59cf7696fd-549td |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-779bc4c586-hpj62 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-779bc4c586-hpj62 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-stop-feature-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Role kserve-ci-e2e-test/stop-feature-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/stop-feature-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-59cf7696fd-549td |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-59cf7696fd-549td |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-59cf7696fd-549td |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-779bc4c586-hpj62 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-779bc4c586-hpj62 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-779bc4c586-hpj62 |
Created |
Created container: main | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/stop-feature-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route | |
| (x19) | kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-6ddb4b6c98-wphcd |
Unhealthy |
Startup probe failed: Get "https://10.132.0.61:8000/health": dial tcp 10.132.0.61:8000: connect: connection refused |
| (x19) | kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5ccd7c9ddd-sbl79 |
Unhealthy |
Startup probe failed: Get "https://10.132.0.60:8001/health": dial tcp 10.132.0.60:8001: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
LLMInferenceServiceReady |
LLMInferenceService [router-with-refs-pd-test] is Ready | |
| (x19) | kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-779bc4c586-hpj62 |
Unhealthy |
Startup probe failed: Get "https://10.132.0.62:8000/health": dial tcp 10.132.0.62:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-6ddb4b6c98-wphcd |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5ccd7c9ddd-sbl79 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-9f96557cc2rtjb |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5ccd7c9ddd-sbl79 |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.InferencePool kserve-ci-e2e-test/stop-feature-test-inference-pool | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-59cf7696fd-549td |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-779bc4c586-hpj62 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
LLMInferenceServiceNotReady |
LLMInferenceService [stop-feature-test] is no longer Ready because of: GatewaysReady, HTTPRoutesReady, InferencePoolReady, MainWorkloadReady, PrefillWorkerWorkloadReady, PrefillWorkloadReady, RouterReady, SchedulerWorkloadReady, WorkerWorkloadReady, WorkloadsReady | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-9f96557cc2rtjb |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-6ddb4b6c98-wphcd |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.61:8000/health": dial tcp 10.132.0.61:8000: connect: connection refused | |
| (x23) | kserve-ci-e2e-test |
OpenDataHubModelController |
stop-feature-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy stop-feature-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "stop-feature-test-kserve-route" not found |
| (x2) | kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-59cf7696fd-549td |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-router-scheduler-59cf7696fd |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-router-scheduler-59cf7696fd-54khg | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-router-scheduler-59cf7696fd from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-779bc4c586 |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-779bc4c586-xrcs9 | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-779bc4c586-xrcs9 |
AddedInterface |
Add eth0 [10.132.0.63/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-779bc4c586-xrcs9 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-779bc4c586-xrcs9 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-779bc4c586 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-779bc4c586-xrcs9 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-router-scheduler-59cf7696fd-54khg |
AddedInterface |
Add eth0 [10.134.0.61/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-59cf7696fd-54khg |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-59cf7696fd-54khg |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-59cf7696fd-54khg |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-59cf7696fd-54khg |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-779bc4c586-hpj62 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.62:8000/health": dial tcp 10.132.0.62:8000: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-59cf7696fd-54khg |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-59cf7696fd-54khg |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-779bc4c586-xrcs9 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-779bc4c586-xrcs9 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-779bc4c586-xrcs9 |
Started |
Started container main | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-3c960099 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-3c960099-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-3c960099-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvd10b93c8eba12f87c3a350a5cae2ee0c-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-route | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-fb864fd8f |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-3c960099-kserve-fb864fd8f-krp9h | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-3c960099-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-3c960099-kserve-fb864fd8f from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-fb864fd8f-krp9h |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-fb864fd8f-krp9h |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-fb864fd8f-krp9h |
AddedInterface |
Add eth0 [10.132.0.64/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-fb864fd8f-krp9h |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-fb864fd8f-krp9h |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-fb864fd8f-krp9h |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-fb864fd8f-krp9h |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvd10b93c8eba12f87c3a350a5cae2ee0c-kserve-self-signed-certs | |
| (x14) | kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-779bc4c586-xrcs9 |
Unhealthy |
Startup probe failed: Get "https://10.132.0.63:8000/health": dial tcp 10.132.0.63:8000: connect: connection refused |
| (x14) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-fb864fd8f-krp9h |
Unhealthy |
Startup probe failed: Get "https://10.132.0.64:8000/health": dial tcp 10.132.0.64:8000: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
LLMInferenceServiceReady |
LLMInferenceService [stop-feature-test] is Ready |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-779bc4c586-xrcs9 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-59cf7696fd-54khg |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-3c960099] is Ready | |
| (x2) | kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-59cf7696fd-54khg |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-fb864fd8f-krp9h |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-779bc4c586-xrcs9 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.63:8000/health": dial tcp 10.132.0.63:8000: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-fb864fd8f-krp9h |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.64:8000/health": dial tcp 10.132.0.64:8000: connect: connection refused | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
lora-single-adapter-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy lora-single-adapter-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/lora-single-adapter-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "lora-single-adapter-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/lora-single-adapter-test-kserve-route | |
kserve-ci-e2e-test |
multus |
lora-single-adapter-test-kserve-786667d575-d9ffw |
AddedInterface |
Add eth0 [10.132.0.65/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-786667d575-d9ffw |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/lora-single-adapter-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.Service kserve-ci-e2e-test/lora-single-adapter-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/lora-single-adapter-test-kserve | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-786667d575-d9ffw |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
lora-single-adapter-test-kserve-786667d575 |
SuccessfulCreate |
Created pod: lora-single-adapter-test-kserve-786667d575-d9ffw | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-786667d575-d9ffw |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
lora-single-adapter-test-kserve |
ScalingReplicaSet |
Scaled up replica set lora-single-adapter-test-kserve-786667d575 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.Secret kserve-ci-e2e-test/lora-single-adapter-test-kserve-self-signed-certs | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-786667d575-d9ffw |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-786667d575-d9ffw |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-786667d575-d9ffw |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-scc | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
GroupsProgressing |
Created worker statefulset for leader pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
SuccessfulCreate |
create Pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 in StatefulSet llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn successful | |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
GroupsProgressing |
Replicas are progressing, with 0 groups ready of total 1 groups |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
GroupsProgressing |
Created leader statefulset llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
CreatingRevision |
Creating revision with key 7949cf4b8d for a newly created LeaderWorkerSet | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-sa | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
SuccessfulCreate |
create Pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 in StatefulSet llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 successful | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler-59898579 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche5fptt |
AddedInterface |
Add eth0 [10.134.0.63/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche5fptt |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche5fptt |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche5fptt |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test386bd5808c5c450f11fd8632e1f821fb-llmisvc-mode | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler-59898579 |
SuccessfulCreate |
Created pod: llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche5fptt | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
AddedInterface |
Add eth0 [10.134.0.62/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
AddedInterface |
Add eth0 [10.132.0.66/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-rb | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche5fptt |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche5fptt |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche5fptt |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Pulling |
Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/lora-single-adapter-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route | |
| (x8) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Pulled |
Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" in 39.961s (39.961s including waiting). Image size: 3531177328 bytes. | |
| (x8) | kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-786667d575-d9ffw |
Unhealthy |
Startup probe failed: Get "https://10.132.0.65:8000/health": dial tcp 10.132.0.65:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
LLMInferenceServiceReady |
LLMInferenceService [lora-single-adapter-test] is Ready | |
| (x12) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Unhealthy |
Startup probe failed: Get "https://10.132.0.66:8000/health": dial tcp 10.132.0.66:8000: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
AllGroupsReady |
All replicas are ready, with 1 groups ready of total 1 groups |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-786667d575-d9ffw |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-dc21cb14] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test386bd5808c5c450f11fd8632e1f821fb-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche5fptt |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-786667d575-d9ffw |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.65:8000/health": dial tcp 10.132.0.65:8000: connect: connection refused | |
| (x2) | kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-sche5fptt |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.66:8000/health": dial tcp 10.132.0.66:8000: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Killing |
Stopping container main | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
lora-multiple-adapters-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy lora-multiple-adapters-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "lora-multiple-adapters-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-route | |
kserve-ci-e2e-test |
replicaset-controller |
lora-multiple-adapters-test-kserve-64fdd68f44 |
SuccessfulCreate |
Created pod: lora-multiple-adapters-test-kserve-64fdd68f44-jsxsq | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/lora-multiple-adapters-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
lora-multiple-adapters-test-kserve |
ScalingReplicaSet |
Scaled up replica set lora-multiple-adapters-test-kserve-64fdd68f44 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.Secret kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.Service kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-64fdd68f44-jsxsq |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-workload-svc | |
kserve-ci-e2e-test |
multus |
lora-multiple-adapters-test-kserve-64fdd68f44-jsxsq |
AddedInterface |
Add eth0 [10.132.0.67/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-64fdd68f44-jsxsq |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-64fdd68f44-jsxsq |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-64fdd68f44-jsxsq |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-64fdd68f44-jsxsq |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-64fdd68f44-jsxsq |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-self-signed-certs | |
| (x14) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-inline-config-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-inline-config-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-inline-config-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-inline-config-test-epp-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-dqvgf |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-inline-config-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-inline-config-test-epp-role | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-inline-config-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-inline-config-test-kserve-7c6c58cc96 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-inline-config-test-kserve-router-scheduler-568fc9df99 |
SuccessfulCreate |
Created pod: scheduler-inline-config-test-kserve-router-scheduler-568fcc29ws | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-inline-config-test-kserve-7c6c58cc96 |
SuccessfulCreate |
Created pod: scheduler-inline-config-test-kserve-7c6c58cc96-dqvgf | |
kserve-ci-e2e-test |
multus |
scheduler-inline-config-test-kserve-7c6c58cc96-dqvgf |
AddedInterface |
Add eth0 [10.134.0.64/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-kserve-workload-svc | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-inline-config-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-inline-config-test-kserve-router-scheduler-568fc9df99 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
scheduler-inline-config-test-kserve-router-scheduler-568fcc29ws |
AddedInterface |
Add eth0 [10.134.0.65/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-dqvgf |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-dqvgf |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-568fcc29ws |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-568fcc29ws |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-568fcc29ws |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-inline-config-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-inline-config-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-568fcc29ws |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-dqvgf |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-568fcc29ws |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
| (x8) | kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-64fdd68f44-jsxsq |
Unhealthy |
Startup probe failed: Get "https://10.132.0.67:8000/health": dial tcp 10.132.0.67:8000: connect: connection refused |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route" not found |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4 |
SuccessfulCreate |
Created pod: llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4bf9pm | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4bf9pm |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-role | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schen59vx |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schen59vx |
AddedInterface |
Add eth0 [10.134.0.67/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler-6cc69fd994 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler-6cc69fd994 |
SuccessfulCreate |
Created pod: llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schen59vx | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test80f99418f0f3eb4c80f02e6144a6d4f2-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4bf9pm |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4bf9pm |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4bf9pm |
AddedInterface |
Add eth0 [10.134.0.66/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schen59vx |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schen59vx |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
LLMInferenceServiceReady |
LLMInferenceService [lora-multiple-adapters-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-4c1ba212] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schen59vx |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4bf9pm |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test80f99418f0f3eb4c80f02e6144a6d4f2-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schen59vx |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-64fdd68f44-jsxsq |
Killing |
Stopping container main | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-configmap-ref-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-configmap-ref-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-configmap-ref-test-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-6cx96 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-configmap-ref-test-kserve-router-scheduler-669fffdcd9 |
SuccessfulCreate |
Created pod: scheduler-configmap-ref-test-kserve-router-scheduler-669ffwt8cj | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-configmap-ref-test-kserve-744bf59fbd |
SuccessfulCreate |
Created pod: scheduler-configmap-ref-test-kserve-744bf59fbd-6cx96 | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-6cx96 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-6cx96 |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-configmap-ref-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-configmap-ref-test-kserve-router-scheduler-669fffdcd9 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-configmap-ref-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-configmap-ref-test-kserve-744bf59fbd from 0 to 1 | |
kserve-ci-e2e-test |
multus |
scheduler-configmap-ref-test-kserve-744bf59fbd-6cx96 |
AddedInterface |
Add eth0 [10.134.0.68/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-669ffwt8cj |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
multus |
scheduler-configmap-ref-test-kserve-router-scheduler-669ffwt8cj |
AddedInterface |
Add eth0 [10.134.0.69/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-669ffwt8cj |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-669ffwt8cj |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-64fdd68f44-jsxsq |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.67:8000/health": dial tcp 10.132.0.67:8000: connect: connection refused | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-shadow-svc |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
tls-verification-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy tls-verification-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/tls-verification-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "tls-verification-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Service kserve-ci-e2e-test/tls-verification-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/tls-verification-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
tls-verification-test-kserve |
ScalingReplicaSet |
Scaled up replica set tls-verification-test-kserve-6bc7757754 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Secret kserve-ci-e2e-test/tls-verification-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/tls-verification-test-epp-sa | |
kserve-ci-e2e-test |
replicaset-controller |
tls-verification-test-kserve-6bc7757754 |
SuccessfulCreate |
Created pod: tls-verification-test-kserve-6bc7757754-k6d85 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-tls-verification-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-6bc7757754-k6d85 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-5f8d594d4b-q8h9v |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-5f8d594d4b-q8h9v |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Service kserve-ci-e2e-test/tls-verification-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
multus |
tls-verification-test-kserve-router-scheduler-5f8d594d4b-q8h9v |
AddedInterface |
Add eth0 [10.134.0.70/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/tls-verification-test-epp-rb | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-6bc7757754-k6d85 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Role kserve-ci-e2e-test/tls-verification-test-epp-role | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-5f8d594d4b-q8h9v |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-6bc7757754-k6d85 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
multus |
tls-verification-test-kserve-6bc7757754-k6d85 |
AddedInterface |
Add eth0 [10.132.0.68/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
tls-verification-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set tls-verification-test-kserve-router-scheduler-5f8d594d4b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
tls-verification-test-kserve-router-scheduler-5f8d594d4b |
SuccessfulCreate |
Created pod: tls-verification-test-kserve-router-scheduler-5f8d594d4b-q8h9v | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-5f8d594d4b-q8h9v |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-5f8d594d4b-q8h9v |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-5f8d594d4b-q8h9v |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-6bc7757754-k6d85 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-6bc7757754-k6d85 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-6bc7757754-k6d85 |
Created |
Created container: main | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/tls-verification-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/tls-verification-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/tls-verification-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-configmap-ref-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-669ffwt8cj |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-6cx96 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-669ffwt8cj |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-ha-replicas-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-ha-replicas-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-ha-replicas-test-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
scheduler-ha-replicas-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-ha-replicas-test-kserve-5c5cfcf776 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-role | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-5c5cfcf776 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fbhn5k |
AddedInterface |
Add eth0 [10.134.0.71/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fbhn5k |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fcfc |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fbhn5k | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fcfc |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-85cd85f6mqct | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85f6mqct |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85f6mqct |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85f6mqct |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85f6mqct |
AddedInterface |
Add eth0 [10.132.0.69/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fbhn5k |
Created |
Created container: main | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-ha-replicas-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fcfc from 0 to 2 | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz |
AddedInterface |
Add eth0 [10.133.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fbhn5k |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-ha-replicas-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-rr5bz |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85f6mqct |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fbhn5k |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fbhn5k |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
| (x3) | kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85f6mqct |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fbhn5k |
FailedPreStopHook |
PreStopHook failed | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-custom-template-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-custom-template-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-custom-template-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-custom-template-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-custom-template-test-epp-sa | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-custom-template-test-kserve-5bc7bd6864 |
SuccessfulCreate |
Created pod: scheduler-custom-template-test-kserve-5bc7bd6864-f8wm8 | |
| (x11) | kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-6bc7757754-k6d85 |
Unhealthy |
Startup probe failed: Get "https://10.132.0.68:8000/health": dial tcp 10.132.0.68:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-custom-template-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-custom-template-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-custom-template-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-custom-template-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-custom-template-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-custom-template-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-custom-template-test-kserve-5bc7bd6864 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm |
AddedInterface |
Add eth0 [10.133.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-custom-template-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-f8wm8 |
Started |
Started container main | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-custom-template-test-kserve-router-scheduler-89d9b575b |
SuccessfulCreate |
Created pod: scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm |
Pulling |
Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-f8wm8 |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-custom-template-test-epp-rb | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-custom-template-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-custom-template-test-kserve-router-scheduler-89d9b575b from 0 to 1 | |
kserve-ci-e2e-test |
multus |
scheduler-custom-template-test-kserve-5bc7bd6864-f8wm8 |
AddedInterface |
Add eth0 [10.134.0.72/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-f8wm8 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" in 2.622s (2.622s including waiting). Image size: 179512283 bytes. | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-custom-template-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-custom-template-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-custom-template-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
LLMInferenceServiceReady |
LLMInferenceService [tls-verification-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-6bc7757754-k6d85 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-5f8d594d4b-q8h9v |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-tls-verification-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-5f8d594d4b-q8h9v |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-6bc7757754-k6d85 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.68:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Role kserve-ci-e2e-test/prestop-hook-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-prestop-hook-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Service kserve-ci-e2e-test/prestop-hook-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
replicaset-controller |
prestop-hook-test-kserve-6785946898 |
SuccessfulCreate |
Created pod: prestop-hook-test-kserve-6785946898-6ph2c | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/prestop-hook-test-epp-rb | |
kserve-ci-e2e-test |
replicaset-controller |
prestop-hook-test-kserve-router-scheduler-cd554b854 |
SuccessfulCreate |
Created pod: prestop-hook-test-kserve-router-scheduler-cd554b854-6xg7k | |
kserve-ci-e2e-test |
deployment-controller |
prestop-hook-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set prestop-hook-test-kserve-router-scheduler-cd554b854 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-6785946898-6ph2c |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/prestop-hook-test-epp-sa | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-6785946898-6ph2c |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-6785946898-6ph2c |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
multus |
prestop-hook-test-kserve-6785946898-6ph2c |
AddedInterface |
Add eth0 [10.132.0.70/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Service kserve-ci-e2e-test/prestop-hook-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/prestop-hook-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Secret kserve-ci-e2e-test/prestop-hook-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
prestop-hook-test-kserve |
ScalingReplicaSet |
Scaled up replica set prestop-hook-test-kserve-6785946898 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-cd554b854-6xg7k |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-cd554b854-6xg7k |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-cd554b854-6xg7k |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
multus |
prestop-hook-test-kserve-router-scheduler-cd554b854-6xg7k |
AddedInterface |
Add eth0 [10.134.0.73/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-cd554b854-6xg7k |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-cd554b854-6xg7k |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-cd554b854-6xg7k |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-custom-template-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-6785946898-6ph2c |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-6785946898-6ph2c |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-6785946898-6ph2c |
Created |
Created container: main | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/prestop-hook-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/prestop-hook-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-custom-template-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-f8wm8 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-89dk9gbm |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-v06-pd-migration-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-v06-pd-migration-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-v06-pd-migration-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-v06-pd-migration-test-epp-auth-rb | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-pd-migration-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-pd-migration-test-kserve-router-scheduler-6fc5d87465 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-pd-migration-test-kserve-74c855b64f |
SuccessfulCreate |
Created pod: scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-pd-migration-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-pd-migration-test-kserve-74c855b64f from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-pd-migration-test-kserve-router-scheduler-6fc5d87465 |
SuccessfulCreate |
Created pod: scheduler-v06-pd-migration-test-kserve-router-scheduler-6f6gggx | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-pd-migration-test-epp-sa | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-pd-migration-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847 |
SuccessfulCreate |
Created pod: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-x2drp | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-6f6gggx |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
multus |
scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz |
AddedInterface |
Add eth0 [10.133.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-x2drp |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-x2drp |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-x2drp |
AddedInterface |
Add eth0 [10.134.0.74/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz |
Pulling |
Pulling image "quay.io/opendatahub/odh-llm-d-router-disagg-sidecar:v0.9.0" | |
kserve-ci-e2e-test |
multus |
scheduler-v06-pd-migration-test-kserve-router-scheduler-6f6gggx |
AddedInterface |
Add eth0 [10.134.0.75/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-x2drp |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-6f6gggx |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-6f6gggx |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-disagg-sidecar:v0.9.0" in 1.483s (1.483s including waiting). Image size: 166803393 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-self-signed-certs | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-v06-pd-migration-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-v06-pd-migration-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-74c855b64f-qgwkz |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-6f6gggx |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-x2drp |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-6f6gggx |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-x2drp |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.74:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-v06-threshold-migration-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-v06-threshold-migration-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-v06-threshold-migration-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-threshold-migration-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-threshold-migration-test-kserve-prefill-5fc599dc49 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz |
AddedInterface |
Add eth0 [10.133.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-disagg-sidecar:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-threshold-migration-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-threshold-migration-test-kserve-859798d76c from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-threshold-migration-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-threshold-migration-test-kserve-router-scheduler-9d7fdfbbd from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-threshold-migration-test-kserve-router-scheduler-9d7fdfbbd |
SuccessfulCreate |
Created pod: scheduler-v06-threshold-migration-test-kserve-router-schedzx9nx | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-threshold-migration-test-kserve-859798d76c |
SuccessfulCreate |
Created pod: scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc599dc49 |
SuccessfulCreate |
Created pod: scheduler-v06-threshold-migration-test-kserve-prefill-5fc5dmkx2 | |
kserve-ci-e2e-test |
multus |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5dmkx2 |
AddedInterface |
Add eth0 [10.134.0.76/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5dmkx2 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5dmkx2 |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-role | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5dmkx2 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test0a07e82be2036793543b2d3db2ea0785-scheduler-v0 | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz |
Created |
Created container: main | |
kserve-ci-e2e-test |
multus |
scheduler-v06-threshold-migration-test-kserve-router-schedzx9nx |
AddedInterface |
Add eth0 [10.134.0.77/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedzx9nx |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedzx9nx |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedzx9nx |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
| (x11) | kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-6785946898-6ph2c |
Unhealthy |
Startup probe failed: Get "https://10.132.0.70:8000/health": dial tcp 10.132.0.70:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-route | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
LLMInferenceServiceReady |
LLMInferenceService [prestop-hook-test] is Ready | |
kserve-ci-e2e-test |
replicaset-controller |
prestop-hook-test-kserve-6785946898 |
SuccessfulCreate |
Created pod: prestop-hook-test-kserve-6785946898-2mr2b | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-6785946898-6ph2c |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
multus |
prestop-hook-test-kserve-6785946898-2mr2b |
AddedInterface |
Add eth0 [10.132.0.71/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-6785946898-2mr2b |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:5d63c390841fcd6358d7b4068789845000a8eff3dfe19f0f9b697dde4d31930a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-6785946898-2mr2b |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-6785946898-2mr2b |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-6785946898-2mr2b |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-6785946898-2mr2b |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-6785946898-2mr2b |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
LLMInferenceServiceNotReady |
LLMInferenceService [prestop-hook-test] is no longer Ready because of: MainWorkloadReady, WorkloadsReady | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-6785946898-2mr2b |
Unhealthy |
Startup probe failed: Get "https://10.132.0.71:8000/health": dial tcp 10.132.0.71:8000: connect: connection refused | |
| (x3) | kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/prestop-hook-test-kserve-self-signed-certs |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-v06-threshold-migration-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test0a07e82be2036793543b2d3db2ea0785-scheduler-v0 | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5dmkx2 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-859798d76c-7nxbz |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedzx9nx |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-6785946898-6ph2c |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.70:8000/health": dial tcp 10.132.0.70:8000: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-6785946898-2mr2b |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-cd554b854-6xg7k |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-prestop-hook-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedzx9nx |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
| (x2) | kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-cd554b854-6xg7k |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
rolling-upgrade-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy rolling-upgrade-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/rolling-upgrade-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "rolling-upgrade-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
rolling-upgrade-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set rolling-upgrade-test-kserve-router-scheduler-745dd558f from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
rolling-upgrade-test-kserve-router-scheduler-745dd558f |
SuccessfulCreate |
Created pod: rolling-upgrade-test-kserve-router-scheduler-745dd558f-mdh27 | |
kserve-ci-e2e-test |
replicaset-controller |
rolling-upgrade-test-kserve-54bc76f55b |
SuccessfulCreate |
Created pod: rolling-upgrade-test-kserve-54bc76f55b-5nvsx | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-54bc76f55b-5nvsx |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-54bc76f55b-5nvsx |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-54bc76f55b-5nvsx |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
multus |
rolling-upgrade-test-kserve-54bc76f55b-5nvsx |
AddedInterface |
Add eth0 [10.134.0.79/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Service kserve-ci-e2e-test/rolling-upgrade-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/rolling-upgrade-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Role kserve-ci-e2e-test/rolling-upgrade-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-rolling-upgrade-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/rolling-upgrade-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Service kserve-ci-e2e-test/rolling-upgrade-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
rolling-upgrade-test-kserve |
ScalingReplicaSet |
Scaled up replica set rolling-upgrade-test-kserve-54bc76f55b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-745dd558f-mdh27 |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
rolling-upgrade-test-kserve-router-scheduler-745dd558f-mdh27 |
AddedInterface |
Add eth0 [10.134.0.80/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-745dd558f-mdh27 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-745dd558f-mdh27 |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/rolling-upgrade-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/rolling-upgrade-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Updated |
Updated v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
rolling-upgrade-test-kserve-859df57bcb |
SuccessfulCreate |
Created pod: rolling-upgrade-test-kserve-859df57bcb-95l7h | |
kserve-ci-e2e-test |
deployment-controller |
rolling-upgrade-test-kserve |
ScalingReplicaSet |
Scaled up replica set rolling-upgrade-test-kserve-859df57bcb from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
LLMInferenceServiceReady |
LLMInferenceService [rolling-upgrade-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-95l7h |
Created |
Created container: main | |
kserve-ci-e2e-test |
multus |
rolling-upgrade-test-kserve-859df57bcb-95l7h |
AddedInterface |
Add eth0 [10.133.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-95l7h |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-95l7h |
Started |
Started container main | |
| (x3) | kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs |
kserve-ci-e2e-test |
deployment-controller |
rolling-upgrade-test-kserve |
ScalingReplicaSet |
Scaled down replica set rolling-upgrade-test-kserve-54bc76f55b from 1 to 0 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-rolling-upgrade-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-54bc76f55b-5nvsx |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
replicaset-controller |
rolling-upgrade-test-kserve-54bc76f55b |
SuccessfulDelete |
Deleted pod: rolling-upgrade-test-kserve-54bc76f55b-5nvsx | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-745dd558f-mdh27 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-95l7h |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-745dd558f-mdh27 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
| (x6) | kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-95l7h |
FailedMount |
MountVolume.SetUp failed for volume "tls-certs" : secret "rolling-upgrade-test-kserve-self-signed-certs" not found |