| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc54jckj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc54jckj to ip-10-0-142-99.ec2.internal | ||
kuadrant-system |
kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd to ip-10-0-128-180.ec2.internal | ||
kuadrant-system |
limitador-operator-controller-manager-6f9f468797-5j59b |
Scheduled |
Successfully assigned kuadrant-system/limitador-operator-controller-manager-6f9f468797-5j59b to ip-10-0-128-180.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-54c47cdfc7-p4vzh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-p4vzh to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4rn477 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4rn477 to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-54c47cdfc7-9csvf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-9csvf to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5bccf9c7bf7rct2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5bccf9c7bf7rct2 to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-b4979bc47-j2jk4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-b4979bc47-j2jk4 to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-custom-template-test-kserve-router-scheduler-89dmbzl2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-89dmbzl2 to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt to ip-10-0-128-180.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fj5r7j |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fj5r7j to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-b4979bc47-dll9c |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-b4979bc47-dll9c to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
auth-disabled-test-kserve-router-scheduler-5c94d555f-2jzf7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-disabled-test-kserve-router-scheduler-5c94d555f-2jzf7 to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
lora-single-adapter-test-kserve-6c7646bb6b-7wx5b |
Scheduled |
Successfully assigned kserve-ci-e2e-test/lora-single-adapter-test-kserve-6c7646bb6b-7wx5b to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
prestop-hook-test-kserve-5c7d67c6bc-dzgk6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-5c7d67c6bc-dzgk6 to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-7cd67cfb9bhccbp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-7cd67cfb9bhccbp to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-test-kserve-d4b5cbd7-ntdnx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-d4b5cbd7-ntdnx to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-799f46c59b-8zdl2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-8zdl2 to ip-10-0-128-180.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 to ip-10-0-132-31.ec2.internal | ||
kuadrant-system |
limitador-limitador-ff68ff5cb-ccvfp |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-ff68ff5cb-ccvfp to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85ft6fh6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-85cd85ft6fh6 to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-inline-config-test-kserve-7c6c58cc96-mmp8b |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-mmp8b to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-799f46c59b-tv79z |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-tv79z to ip-10-0-128-180.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-router-scheduler-546967d655-nrcg7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-546967d655-nrcg7 to ip-10-0-142-99.ec2.internal | ||
openshift-ingress |
router-default-7454758546-dtbkw |
Scheduled |
Successfully assigned openshift-ingress/router-default-7454758546-dtbkw to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
rolling-upgrade-test-kserve-router-scheduler-745dd558f-r9qcv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-745dd558f-r9qcv to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
rolling-upgrade-test-kserve-859df57bcb-hjr8m |
Scheduled |
Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-hjr8m to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
rolling-upgrade-test-kserve-54bc76f55b-pmrdl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-pmrdl to ip-10-0-128-180.ec2.internal | ||
kuadrant-system |
limitador-limitador-69574b596d-xfp6q |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-69574b596d-xfp6q to ip-10-0-128-180.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd to ip-10-0-128-180.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-custom-template-test-kserve-5bc7bd6864-bgg6r |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-bgg6r to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q to ip-10-0-128-180.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79t95rn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79t95rn to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-wqjwf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-wqjwf to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-vcqb5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-vcqb5 to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dcbpff |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dcbpff to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb44dmt9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb44dmt9 to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f to ip-10-0-128-180.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-inline-config-test-kserve-router-scheduler-568fc8nwn8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-568fc8nwn8 to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-pd-migration-test-kserve-74c855b64f-5zk24 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-74c855b64f-5zk24 to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6448b6f56-k8nmn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6448b6f56-k8nmn to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schecr5jf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schecr5jf to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schepj8r4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schepj8r4 to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
tls-verification-test-kserve-57c75fd4f5-wsg7t |
Scheduled |
Successfully assigned kserve-ci-e2e-test/tls-verification-test-kserve-57c75fd4f5-wsg7t to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
tls-verification-test-kserve-router-scheduler-59969bd6f5-4v7gg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-59969bd6f5-4v7gg to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schetglm9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schetglm9 to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-799f46c59b-xccwl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-xccwl to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-router-scheduler-548f4klq5x |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-548f4klq5x to ip-10-0-142-99.ec2.internal | ||
kuadrant-system |
authorino-7c77957575-zcvdz |
Scheduled |
Successfully assigned kuadrant-system/authorino-7c77957575-zcvdz to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-test-kserve-router-scheduler-6869bff88sqkk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-6869bff88sqkk to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
auth-enabled-test-kserve-router-scheduler-6f46874798-5nvfk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-6f46874798-5nvfk to ip-10-0-142-99.ec2.internal | ||
kuadrant-system |
authorino-8df697c9f-rq2g8 |
Scheduled |
Successfully assigned kuadrant-system/authorino-8df697c9f-rq2g8 to ip-10-0-142-99.ec2.internal | ||
kuadrant-system |
authorino-b6c89bb85-l94lp |
Scheduled |
Successfully assigned kuadrant-system/authorino-b6c89bb85-l94lp to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
prestop-hook-test-kserve-router-scheduler-6c8475994c-mhqk2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-6c8475994c-mhqk2 to ip-10-0-142-99.ec2.internal | ||
kuadrant-system |
authorino-operator-6d85f6564-5q86f |
Scheduled |
Successfully assigned kuadrant-system/authorino-operator-6d85f6564-5q86f to ip-10-0-128-180.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-8cl8mwz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-8cl8mwz to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel4rnh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel4rnh to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
e2e-pvc-model-download-v8gm9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/e2e-pvc-model-download-v8gm9 to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
prestop-hook-test-kserve-5c7d67c6bc-nm7qd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-5c7d67c6bc-nm7qd to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schev5h4d |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schev5h4d to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-prefill-589f5b6bd7-9mmxn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-589f5b6bd7-9mmxn to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-2-openshift-default-54c789bdc6-44z29 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-44z29 to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c7fd556fb9fphn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c7fd556fb9fphn to ip-10-0-132-31.ec2.internal | ||
kuadrant-system |
kuadrant-console-plugin-85fd4b8b9d-htdmf |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-htdmf to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-2-openshift-default-684dc9b4b9-zbq44 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-zbq44 to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche68br6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche68br6 to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schehdj9v |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schehdj9v to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-c8bdfd4c5-b7t9d |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-c8bdfd4c5-b7t9d to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche6qvh5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche6qvh5 to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche9fnck |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche9fnck to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebgjvn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebgjvn to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schetkz8g |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schetkz8g to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep6gtb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep6gtb to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schew77k4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schew77k4 to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schels7bn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schels7bn to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
lora-multiple-adapters-test-kserve-77c65dc7cf-mfh5p |
Scheduled |
Successfully assigned kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-77c65dc7cf-mfh5p to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
auth-invalid-token-test-kserve-69956d8989-pnbmz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-invalid-token-test-kserve-69956d8989-pnbmz to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-b4685cc89-zfv4b |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-b4685cc89-zfv4b to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-prefill-9dcd56f4c-sqbg5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-9dcd56f4c-sqbg5 to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
auth-enabled-test-kserve-798878c5c7-8z67f |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-enabled-test-kserve-798878c5c7-8z67f to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-799f46c59b-prgpl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-prgpl to ip-10-0-128-180.ec2.internal | ||
openshift-ingress |
openshift-ai-inference-openshift-default-866675cbb8-qnxtj |
Scheduled |
Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-866675cbb8-qnxtj to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-router-scheduler-6668cbdbdh7z6f |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-6668cbdbdh7z6f to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-router-scheduler-546967d655-jljrz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-546967d655-jljrz to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-test-kserve-68cd5c496c-5htr4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-68cd5c496c-5htr4 to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-test-kserve-router-scheduler-859f948bc7-vnnjg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-859f948bc7-vnnjg to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-configmap-ref-test-kserve-744bf59fbd-d7l7h |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-d7l7h to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
auth-disabled-test-kserve-869d748779-67hnj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-disabled-test-kserve-869d748779-67hnj to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
auth-invalid-token-test-kserve-router-scheduler-5649968468lk857 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-invalid-token-test-kserve-router-scheduler-5649968468lk857 to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-workload-svc |
ClusterIPNotAllocated |
Cluster IP [IPv4]: 172.31.102.45 is not allocated; repairing | ||
kserve-ci-e2e-test |
scheduler-configmap-ref-test-kserve-router-scheduler-669ffrln5v |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-669ffrln5v to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6 to ip-10-0-128-180.ec2.internal | ||
kuadrant-system |
dns-operator-controller-manager-65b49595d7-7cst2 |
Scheduled |
Successfully assigned kuadrant-system/dns-operator-controller-manager-65b49595d7-7cst2 to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-f98bfbff-xltsj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-f98bfbff-xltsj to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-f98bfbff-nln7t |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-f98bfbff-nln7t to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m to ip-10-0-128-180.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-threshold-migration-test-kserve-router-schedxrdl5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedxrdl5 to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-54c47cdfc7-mw42d |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-mw42d to ip-10-0-128-180.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-5d9b9b4785-cb2v6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-5d9b9b4785-cb2v6 to ip-10-0-132-31.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs to ip-10-0-128-180.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-pd-migration-test-kserve-router-scheduler-6ffwd5k |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-6ffwd5k to ip-10-0-142-99.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-2jdrt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-2jdrt to ip-10-0-142-99.ec2.internal | ||
openshift-ingress |
istiod-openshift-gateway-94bb8fbfd-wnhkc |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wnhkc to ip-10-0-128-180.ec2.internal | ||
kserve-ci-e2e-test |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc55rhwq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc55rhwq to ip-10-0-132-31.ec2.internal | ||
| (x6) | openshift-ingress |
replicaset-controller |
router-default-7454758546 |
FailedCreate |
Error creating: pods "router-default-7454758546-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
openshift-ingress |
deployment-controller |
router-default |
ScalingReplicaSet |
Scaled up replica set router-default-7454758546 from 0 to 1 | |
openshift-ingress |
service-controller |
router-default |
UnAvailableLoadBalancer |
There are no available nodes for LoadBalancer | |
openshift-ingress |
service-controller |
router-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
service-controller |
router-default |
EnsuredLoadBalancer |
Ensured load balancer | |
| (x16) | openshift-ingress |
replicaset-controller |
router-default-7454758546 |
FailedCreate |
Error creating: pods "router-default-7454758546-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
| (x3) | openshift-ingress |
service-controller |
router-default |
UpdatedLoadBalancer |
Updated load balancer with new hosts |
openshift-ingress |
replicaset-controller |
router-default-7454758546 |
SuccessfulCreate |
Created pod: router-default-7454758546-dtbkw | |
| (x6) | openshift-ingress |
kubelet |
router-default-7454758546-dtbkw |
FailedMount |
MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt |
| (x6) | openshift-ingress |
kubelet |
router-default-7454758546-dtbkw |
FailedMount |
MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found |
openshift-ingress |
kubelet |
router-default-7454758546-dtbkw |
Pulled |
Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0595b1d6de8e08ddb61ce581075357331193db6206d341c15cf213514ef0f693" already present on machine | |
openshift-ingress |
kubelet |
router-default-7454758546-dtbkw |
Started |
Started container router | |
openshift-ingress |
multus |
router-default-7454758546-dtbkw |
AddedInterface |
Add eth0 [10.133.0.9/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
router-default-7454758546-dtbkw |
Created |
Created container: router | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-94bb8fbfd |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-94bb8fbfd-wnhkc | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-wnhkc |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" | |
openshift-ingress |
multus |
istiod-openshift-gateway-94bb8fbfd-wnhkc |
AddedInterface |
Add eth0 [10.134.0.25/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-94bb8fbfd from 0 to 1 | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-wnhkc |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" in 2.619s (2.619s including waiting). Image size: 181034515 bytes. | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-wnhkc |
Started |
Started container discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-wnhkc |
Created |
Created container: discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-wnhkc |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-wnhkc |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
replicaset-controller |
openshift-ai-inference-openshift-default-866675cbb8 |
SuccessfulCreate |
Created pod: openshift-ai-inference-openshift-default-866675cbb8-qnxtj | |
openshift-ingress |
deployment-controller |
openshift-ai-inference-openshift-default |
ScalingReplicaSet |
Scaled up replica set openshift-ai-inference-openshift-default-866675cbb8 from 0 to 1 | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
gateway_labeler_controller |
openshift-ai-inference |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway openshift-ai-inference | |
openshift-ingress |
multus |
openshift-ai-inference-openshift-default-866675cbb8-qnxtj |
AddedInterface |
Add eth0 [10.133.0.36/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-qnxtj |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-qnxtj |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 3.563s (3.563s including waiting). Image size: 181251556 bytes. | |
openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
RequirementsUnknown |
requirements not yet checked | |
openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
multus |
limitador-operator-controller-manager-6f9f468797-5j59b |
AddedInterface |
Add eth0 [10.134.0.26/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-5j59b |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:183bad2a6f5872aea38f54ad507f7e005d6facb02b18769e0407c82799f96a3e" | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
InstallWaiting |
installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
deployment-controller |
limitador-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set limitador-operator-controller-manager-6f9f468797 from 0 to 1 | |
kuadrant-system |
replicaset-controller |
limitador-operator-controller-manager-6f9f468797 |
SuccessfulCreate |
Created pod: limitador-operator-controller-manager-6f9f468797-5j59b | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-5j59b |
Created |
Created container: manager | |
kuadrant-system |
limitador-operator-controller-manager-6f9f468797-5j59b_86443c54-f422-4d58-afc3-7a7f4fd8279d |
3745a16e.kuadrant.io |
LeaderElection |
limitador-operator-controller-manager-6f9f468797-5j59b_86443c54-f422-4d58-afc3-7a7f4fd8279d became leader | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-5j59b |
Started |
Started container manager | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-5j59b |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:183bad2a6f5872aea38f54ad507f7e005d6facb02b18769e0407c82799f96a3e" in 2.256s (2.256s including waiting). Image size: 178538972 bytes. | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
InstallWaiting |
installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
deployment-controller |
kuadrant-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set kuadrant-operator-controller-manager-bb7ddb7d7 from 0 to 1 | |
kuadrant-system |
replicaset-controller |
kuadrant-operator-controller-manager-bb7ddb7d7 |
SuccessfulCreate |
Created pod: kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd | |
kuadrant-system |
multus |
kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:0b77e4a874b620095a0300877aea53e78559a601ce62b194537ed21c2743bbf3" | |
kuadrant-system |
multus |
authorino-operator-6d85f6564-5q86f |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
InstallWaiting |
installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability. | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-5q86f |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:b2cc2c0f0729dad98f970830816e300c0b961ba42491f362295512d886384687" | |
kuadrant-system |
replicaset-controller |
authorino-operator-6d85f6564 |
SuccessfulCreate |
Created pod: authorino-operator-6d85f6564-5q86f | |
kuadrant-system |
deployment-controller |
authorino-operator |
ScalingReplicaSet |
Scaled up replica set authorino-operator-6d85f6564 from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:0b77e4a874b620095a0300877aea53e78559a601ce62b194537ed21c2743bbf3" in 4.293s (4.293s including waiting). Image size: 425661757 bytes. | |
kuadrant-system |
deployment-controller |
dns-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set dns-operator-controller-manager-65b49595d7 from 0 to 1 | |
kuadrant-system |
replicaset-controller |
dns-operator-controller-manager-65b49595d7 |
SuccessfulCreate |
Created pod: dns-operator-controller-manager-65b49595d7-7cst2 | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
InstallWaiting |
installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd |
Started |
Started container manager | |
kuadrant-system |
multus |
dns-operator-controller-manager-65b49595d7-7cst2 |
AddedInterface |
Add eth0 [10.132.0.19/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-7cst2 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ba46f54446ecd3ed1a3d877dcbb7359ff8f2d918827f3411a5cb0781915a65d5" | |
kuadrant-system |
authorino-operator-6d85f6564-5q86f_1611de44-e8e2-4774-89b2-d84df4b49d0b |
aac3a15d.authorino.kuadrant.io |
LeaderElection |
authorino-operator-6d85f6564-5q86f_1611de44-e8e2-4774-89b2-d84df4b49d0b became leader | |
kuadrant-system |
kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd_22ed4780-8c32-4c83-b862-ca4e2a539d45 |
f139389e.kuadrant.io |
LeaderElection |
kuadrant-operator-controller-manager-bb7ddb7d7-vt8bd_22ed4780-8c32-4c83-b862-ca4e2a539d45 became leader | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-5q86f |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:b2cc2c0f0729dad98f970830816e300c0b961ba42491f362295512d886384687" in 2.262s (2.262s including waiting). Image size: 168639631 bytes. | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-5q86f |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-5q86f |
Started |
Started container manager | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-7cst2 |
Started |
Started container manager | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-7cst2 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ba46f54446ecd3ed1a3d877dcbb7359ff8f2d918827f3411a5cb0781915a65d5" in 1.62s (1.62s including waiting). Image size: 190472853 bytes. | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-7cst2 |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-htdmf |
FailedMount |
MountVolume.SetUp failed for volume "plugin-serving-cert" : secret "plugin-serving-cert" not found | |
kuadrant-system |
replicaset-controller |
kuadrant-console-plugin-85fd4b8b9d |
SuccessfulCreate |
Created pod: kuadrant-console-plugin-85fd4b8b9d-htdmf | |
kuadrant-system |
deployment-controller |
kuadrant-console-plugin |
ScalingReplicaSet |
Scaled up replica set kuadrant-console-plugin-85fd4b8b9d from 0 to 1 | |
kuadrant-system |
dns-operator-controller-manager-65b49595d7-7cst2_4d118fa2-8058-4cd9-a35d-8686d6f54009 |
a3f98d6c.kuadrant.io |
LeaderElection |
dns-operator-controller-manager-65b49595d7-7cst2_4d118fa2-8058-4cd9-a35d-8686d6f54009 became leader | |
kuadrant-system |
multus |
kuadrant-console-plugin-85fd4b8b9d-htdmf |
AddedInterface |
Add eth0 [10.133.0.42/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-htdmf |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:6e69f41d3d70b0afa7691a5d2400065d3bcdec2ea82830cf2992b8e69ba06e2a" | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-htdmf |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:6e69f41d3d70b0afa7691a5d2400065d3bcdec2ea82830cf2992b8e69ba06e2a" in 5.37s (5.37s including waiting). Image size: 342502139 bytes. | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-htdmf |
Started |
Started container kuadrant-console-plugin | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-htdmf |
Created |
Created container: kuadrant-console-plugin | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
replicaset-controller |
limitador-limitador-ff68ff5cb |
SuccessfulCreate |
Created pod: limitador-limitador-ff68ff5cb-ccvfp | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-ff68ff5cb from 0 to 1 | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-ccvfp |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" | |
kuadrant-system |
replicaset-controller |
limitador-limitador-69574b596d |
SuccessfulCreate |
Created pod: limitador-limitador-69574b596d-xfp6q | |
kuadrant-system |
multus |
limitador-limitador-ff68ff5cb-ccvfp |
AddedInterface |
Add eth0 [10.132.0.20/23] from ovn-kubernetes | |
kuadrant-system |
replicaset-controller |
authorino-b6c89bb85 |
SuccessfulCreate |
Created pod: authorino-b6c89bb85-l94lp | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-xfp6q |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" | |
kuadrant-system |
replicaset-controller |
authorino-8df697c9f |
SuccessfulCreate |
Created pod: authorino-8df697c9f-rq2g8 | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-8df697c9f from 0 to 1 | |
kuadrant-system |
multus |
limitador-limitador-69574b596d-xfp6q |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-69574b596d from 0 to 1 | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-b6c89bb85 from 0 to 1 | |
kuadrant-system |
multus |
authorino-8df697c9f-rq2g8 |
AddedInterface |
Add eth0 [10.132.0.21/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-8df697c9f-rq2g8 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" | |
kuadrant-system |
multus |
authorino-b6c89bb85-l94lp |
AddedInterface |
Add eth0 [10.133.0.43/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-l94lp |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-l94lp |
Started |
Started container authorino | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-l94lp |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" in 1.702s (1.702s including waiting). Image size: 202706732 bytes. | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-l94lp |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-xfp6q |
Created |
Created container: limitador | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-xfp6q |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" in 3.462s (3.462s including waiting). Image size: 250499765 bytes. | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-xfp6q |
Started |
Started container limitador | |
kuadrant-system |
kubelet |
authorino-8df697c9f-rq2g8 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" in 4.038s (4.038s including waiting). Image size: 202706732 bytes. | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-ccvfp |
Started |
Started container limitador | |
kuadrant-system |
kubelet |
authorino-8df697c9f-rq2g8 |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-8df697c9f-rq2g8 |
Started |
Started container authorino | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-ccvfp |
Created |
Created container: limitador | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-ccvfp |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" in 5.075s (5.075s including waiting). Image size: 250499765 bytes. | |
kuadrant-system |
replicaset-controller |
authorino-b6c89bb85 |
SuccessfulDelete |
Deleted pod: authorino-b6c89bb85-l94lp | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-b6c89bb85 from 1 to 0 | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-l94lp |
Killing |
Stopping container authorino | |
kuadrant-system |
replicaset-controller |
limitador-limitador-ff68ff5cb |
SuccessfulDelete |
Deleted pod: limitador-limitador-ff68ff5cb-ccvfp | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled down replica set limitador-limitador-ff68ff5cb from 1 to 0 | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-ccvfp |
Killing |
Stopping container limitador | |
kuadrant-system |
replicaset-controller |
authorino-7c77957575 |
SuccessfulCreate |
Created pod: authorino-7c77957575-zcvdz | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-7c77957575 from 0 to 1 | |
kuadrant-system |
kubelet |
authorino-7c77957575-zcvdz |
Started |
Started container authorino | |
kuadrant-system |
kubelet |
authorino-7c77957575-zcvdz |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-7c77957575-zcvdz |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" in 790ms (790ms including waiting). Image size: 202706732 bytes. | |
kuadrant-system |
kubelet |
authorino-7c77957575-zcvdz |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" | |
kuadrant-system |
multus |
authorino-7c77957575-zcvdz |
AddedInterface |
Add eth0 [10.132.0.22/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-8df697c9f from 1 to 0 | |
kuadrant-system |
kubelet |
authorino-8df697c9f-rq2g8 |
Killing |
Stopping container authorino | |
kuadrant-system |
replicaset-controller |
authorino-8df697c9f |
SuccessfulDelete |
Deleted pod: authorino-8df697c9f-rq2g8 | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-54c47cdfc7-9csvf | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-799f46c59b-xccwl | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-xccwl |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-799f46c59b-xccwl |
AddedInterface |
Add eth0 [10.132.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-9csvf |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-54c47cdfc7-9csvf |
AddedInterface |
Add eth0 [10.132.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-xccwl |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-xccwl |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-9csvf |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 2.748s (2.748s including waiting). Image size: 181251556 bytes. | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-xccwl |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 2.957s (2.957s including waiting). Image size: 181251556 bytes. | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-799f46c59b-xccwl | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-xccwl |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5 |
SuccessfulCreate |
Created pod: gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc55rhwq | |
kserve-ci-e2e-test |
deployment-controller |
gw-section-name-router-with-gat-2f0a622e-kserve |
ScalingReplicaSet |
Scaled up replica set gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.Secret kserve-ci-e2e-test/gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc55rhwq |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
kserve-ci-e2e-test |
multus |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc55rhwq |
AddedInterface |
Add eth0 [10.133.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc55rhwq |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc55rhwq |
Created |
Created container: main | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-799f46c59b-tv79z | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc55rhwq |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.024s (1.024s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-tv79z |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-799f46c59b-tv79z |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-tv79z |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 2.758s (2.758s including waiting). Image size: 181251556 bytes. | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
precise-prefix-cache-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy precise-prefix-cache-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "precise-prefix-cache-test-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-tv79z |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-tv79z |
Created |
Created container: istio-proxy | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-9csvf |
Created |
Created container: istio-proxy |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-9csvf |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-9csvf |
Started |
Started container istio-proxy |
| (x5) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-tv79z |
Unhealthy |
Startup probe failed: Get "http://10.134.0.31:15021/healthz/ready": dial tcp 10.134.0.31:15021: connect: connection refused |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-54c47cdfc7-9csvf | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-9csvf |
Killing |
Stopping container istio-proxy | |
| (x3) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-9csvf |
Unhealthy |
Startup probe failed: Get "http://10.132.0.26:15021/healthz/ready": dial tcp 10.132.0.26:15021: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Role kserve-ci-e2e-test/precise-prefix-cache-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/precise-prefix-cache-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
precise-prefix-cache-test-kserve |
ScalingReplicaSet |
Scaled up replica set precise-prefix-cache-test-kserve-b4979bc47 from 0 to 2 | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-b4979bc47 |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-b4979bc47-j2jk4 | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-b4979bc47 |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-b4979bc47-dll9c | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-b4979bc47-dll9c |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
AddedInterface |
Add eth0 [10.132.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-epp-service | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-b4979bc47-dll9c |
AddedInterface |
Add eth0 [10.133.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-b4979bc47-dll9c |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-b4979bc47-dll9c |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
precise-prefix-cache-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set precise-prefix-cache-test-kserve-router-scheduler-7b4b884c4 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884c4 |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/precise-prefix-cache-test-epp-rb | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-b4979bc47-j2jk4 |
AddedInterface |
Add eth0 [10.132.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-b4979bc47-j2jk4 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc55rhwq |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-b4979bc47-dll9c |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" in 3.587s (3.587s including waiting). Image size: 301882321 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-b4979bc47-j2jk4 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-b4979bc47-j2jk4 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" in 4.013s (4.013s including waiting). Image size: 301882321 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-b4979bc47-j2jk4 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-b4979bc47-dll9c |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-b4979bc47-dll9c |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
Pulling |
Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-route | |
kserve-ci-e2e-test |
replicaset-controller |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b |
SuccessfulCreate |
Created pod: gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.Secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
gw-section-name-router-with-gat-f1d92d0f-kserve |
ScalingReplicaSet |
Scaled up replica set gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b from 0 to 1 | |
kserve-ci-e2e-test |
multus |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6 |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
Pulling |
Pulling image "quay.io/opendatahub/llm-d-kv-cache:v0.8.0" | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-b4979bc47-j2jk4 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" in 2.632s (2.632s including waiting). Image size: 179512283 bytes. | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.024s (1.024s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-54c47cdfc7-p4vzh | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-b4979bc47-j2jk4 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-b4979bc47-j2jk4 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 2.325s (2.325s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-b4979bc47-j2jk4 |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-54c47cdfc7-p4vzh |
AddedInterface |
Add eth0 [10.132.0.29/23] from ovn-kubernetes | |
| (x2) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-qnxtj |
Created |
Created container: istio-proxy |
| (x2) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-qnxtj |
Started |
Started container istio-proxy |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-qnxtj |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-tv79z |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-799f46c59b-tv79z | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route | |
| (x5) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-qnxtj |
ProbeError |
Startup probe error: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused body: |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/precise-prefix-cache-test-kserve-shadow-svc |
| (x5) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-866675cbb8-qnxtj |
Unhealthy |
Startup probe failed: Get "http://10.133.0.36:15021/healthz/ready": dial tcp 10.133.0.36:15021: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc55rhwq |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.45:8000/health": dial tcp 10.133.0.45:8000: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Role kserve-ci-e2e-test/auth-enabled-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-enabled-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/auth-enabled-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Secret kserve-ci-e2e-test/auth-enabled-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-enabled-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-enabled-test-epp-auth-rb | |
kserve-ci-e2e-test |
deployment-controller |
auth-enabled-test-kserve |
ScalingReplicaSet |
Scaled up replica set auth-enabled-test-kserve-798878c5c7 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
auth-enabled-test-kserve-router-scheduler-6f46874798 |
SuccessfulCreate |
Created pod: auth-enabled-test-kserve-router-scheduler-6f46874798-5nvfk | |
kserve-ci-e2e-test |
replicaset-controller |
auth-enabled-test-kserve-798878c5c7 |
SuccessfulCreate |
Created pod: auth-enabled-test-kserve-798878c5c7-8z67f | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/auth-enabled-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-enabled-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
auth-enabled-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set auth-enabled-test-kserve-router-scheduler-6f46874798 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-798878c5c7-8z67f |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
multus |
auth-enabled-test-kserve-798878c5c7-8z67f |
AddedInterface |
Add eth0 [10.133.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-798878c5c7-8z67f |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-798878c5c7-8z67f |
Created |
Created container: storage-initializer | |
| (x6) | kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b74wh6 |
FailedMount |
MountVolume.SetUp failed for volume "tls-certs" : secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-798878c5c7-8z67f |
Pulling |
Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/auth-enabled-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/auth-enabled-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-enabled-test-kserve-shadow-svc |
kserve-ci-e2e-test |
multus |
auth-enabled-test-kserve-router-scheduler-6f46874798-5nvfk |
AddedInterface |
Add eth0 [10.132.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
Pulled |
Successfully pulled image "quay.io/opendatahub/llm-d-kv-cache:v0.8.0" in 37.838s (37.838s including waiting). Image size: 2935159967 bytes. | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6f46874798-5nvfk |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6f46874798-5nvfk |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6f46874798-5nvfk |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6f46874798-5nvfk |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6f46874798-5nvfk |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6f46874798-5nvfk |
Created |
Created container: main | |
| (x4) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
BackOff |
Back-off restarting failed container main in pod precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7_kserve-ci-e2e-test(3685774b-11b2-49d5-9395-84ad14bd1823) |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-798878c5c7-8z67f |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-798878c5c7-8z67f |
Pulled |
Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" in 27.008s (27.008s including waiting). Image size: 3531177328 bytes. | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-798878c5c7-8z67f |
Created |
Created container: main | |
| (x3) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
Created |
Created container: main |
| (x2) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine |
| (x3) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
Started |
Started container main |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
Unhealthy |
Liveness probe failed: timeout: failed to connect service "10.132.0.28:9003" within 1s: context deadline exceeded | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
LLMInferenceServiceReady |
LLMInferenceService [precise-prefix-cache-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-b4979bc47-j2jk4 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-b4979bc47-dll9c |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
| (x2) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-7b4b884cw59s7 |
Unhealthy |
Readiness probe failed: Get "http://10.132.0.28:8082/healthz": dial tcp 10.132.0.28:8082: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-b4979bc47-j2jk4 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.27:8000/health": dial tcp 10.132.0.27:8000: connect: connection refused | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-router-managed-test-llm-e45d1f79 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-e45d1f79-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-e45d1f79-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-router-managed-test-llm-e45d1f79-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879 |
SuccessfulCreate |
Created pod: llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schehdj9v |
Created |
Created container: main | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler-7c9f98478b |
SuccessfulCreate |
Created pod: llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schehdj9v | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testef4d2875be14b30dc1561ed84d0d4bde-llmisvc-rout | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-service | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schehdj9v |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schehdj9v |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schehdj9v |
AddedInterface |
Add eth0 [10.132.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler-7c9f98478b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-shadow-svc |
| (x10) | kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-798878c5c7-8z67f |
Unhealthy |
Startup probe failed: Get "https://10.133.0.47:8000/health": dial tcp 10.133.0.47:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-router-managed-test-llm-e45d1f79] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879qjp5f |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testef4d2875be14b30dc1561ed84d0d4bde-llmisvc-rout | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schehdj9v |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
LLMInferenceServiceReady |
LLMInferenceService [auth-enabled-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-enabled-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-798878c5c7-8z67f |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6f46874798-5nvfk |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schehdj9v |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
| (x2) | kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6f46874798-5nvfk |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb44dmt9 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-router-managed-test-llm-5b1e8f15 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-5b1e8f15-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-5b1e8f15-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-rb | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4 |
SuccessfulCreate |
Created pod: llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb44dmt9 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test7f54e84970003a6e7372bdbcb574f7ed-llmisvc-rout | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve | |
kserve-ci-e2e-test |
multus |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb44dmt9 |
AddedInterface |
Add eth0 [10.132.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler-6586f4d6cc from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler-6586f4d6cc |
SuccessfulCreate |
Created pod: llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schels7bn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-service | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb44dmt9 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb44dmt9 |
Started |
Started container main | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-router-managed-test-llm-5b1e8f15-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schels7bn |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schels7bn |
AddedInterface |
Add eth0 [10.132.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schels7bn |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schels7bn |
Created |
Created container: main | |
kserve-ci-e2e-test |
replicaset-controller |
auth-invalid-token-test-kserve-69956d8989 |
SuccessfulCreate |
Created pod: auth-invalid-token-test-kserve-69956d8989-pnbmz | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Secret kserve-ci-e2e-test/auth-invalid-token-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-invalid-token-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/auth-invalid-token-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-invalid-token-test-kserve-workload-svc | |
kserve-ci-e2e-test |
deployment-controller |
auth-invalid-token-test-kserve |
ScalingReplicaSet |
Scaled up replica set auth-invalid-token-test-kserve-69956d8989 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-invalid-token-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Role kserve-ci-e2e-test/auth-invalid-token-test-epp-role | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-69956d8989-pnbmz |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-5649968468lk857 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
auth-invalid-token-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set auth-invalid-token-test-kserve-router-scheduler-5649968468 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-invalid-token-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-invalid-token-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/auth-invalid-token-test-epp-rb | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-5649968468lk857 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
multus |
auth-invalid-token-test-kserve-router-scheduler-5649968468lk857 |
AddedInterface |
Add eth0 [10.133.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
auth-invalid-token-test-kserve-69956d8989-pnbmz |
AddedInterface |
Add eth0 [10.133.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
auth-invalid-token-test-kserve-router-scheduler-5649968468 |
SuccessfulCreate |
Created pod: auth-invalid-token-test-kserve-router-scheduler-5649968468lk857 | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-69956d8989-pnbmz |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-5649968468lk857 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-69956d8989-pnbmz |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-5649968468lk857 |
Pulling |
Pulling image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-69956d8989-pnbmz |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-5649968468lk857 |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" in 2.766s (2.766s including waiting). Image size: 179512283 bytes. | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-5649968468lk857 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-69956d8989-pnbmz |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-5649968468lk857 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-69956d8989-pnbmz |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/auth-invalid-token-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/auth-invalid-token-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-invalid-token-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-router-managed-test-llm-5b1e8f15] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler-69655bc8c5 |
SuccessfulCreate |
Created pod: llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebgjvn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-rb | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-service | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-role | |
kserve-ci-e2e-test |
multus |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebgjvn |
AddedInterface |
Add eth0 [10.132.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebgjvn |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testb7025ca4d8a6f8f5b2fd08b5581d2678-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd |
SuccessfulCreate |
Created pod: llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q |
Started |
Started container main | |
kserve-ci-e2e-test |
deployment-controller |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler-69655bc8c5 from 0 to 1 | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebgjvn |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebgjvn |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testb7025ca4d8a6f8f5b2fd08b5581d2678-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-a50492e9] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebgjvn |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddj4z6q |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schebgjvn |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schels7bn |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb44dmt9 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test7f54e84970003a6e7372bdbcb574f7ed-llmisvc-rout | |
| (x2) | kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schels7bn |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x11) | kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-69956d8989-pnbmz |
Unhealthy |
Startup probe failed: Get "https://10.133.0.48:8000/health": dial tcp 10.133.0.48:8000: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb44dmt9 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.32:8000/health": dial tcp 10.132.0.32:8000: connect: connection refused | |
kserve-ci-e2e-test |
multus |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-vcqb5 |
AddedInterface |
Add eth0 [10.132.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler-595f78db49 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-router-managed-test-llm-4b931143 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-4b931143-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-4b931143-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-router-managed-test-llm-4b931143-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56 |
SuccessfulCreate |
Created pod: llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-vcqb5 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-vcqb5 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-vcqb5 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-vcqb5 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test8ac8e3d2264ccb939eb021b0b835847c-llmisvc-rout | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep6gtb |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-service | |
kserve-ci-e2e-test |
multus |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep6gtb |
AddedInterface |
Add eth0 [10.132.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-rb | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler-595f78db49 |
SuccessfulCreate |
Created pod: llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep6gtb | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep6gtb |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep6gtb |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
LLMInferenceServiceReady |
LLMInferenceService [auth-invalid-token-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-invalid-token-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-69956d8989-pnbmz |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-5649968468lk857 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-5649968468lk857 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-69956d8989-pnbmz |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.48:8000/health": dial tcp 10.133.0.48:8000: connect: connection refused | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
auth-disabled-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy auth-disabled-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/auth-disabled-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "auth-disabled-test-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
auth-disabled-test-kserve |
ScalingReplicaSet |
Scaled up replica set auth-disabled-test-kserve-869d748779 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-disabled-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-disabled-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/auth-disabled-test-epp-sa | |
kserve-ci-e2e-test |
replicaset-controller |
auth-disabled-test-kserve-869d748779 |
SuccessfulCreate |
Created pod: auth-disabled-test-kserve-869d748779-67hnj | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Role kserve-ci-e2e-test/auth-disabled-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Secret kserve-ci-e2e-test/auth-disabled-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-disabled-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/auth-disabled-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-disabled-test-epp-service | |
kserve-ci-e2e-test |
multus |
auth-disabled-test-kserve-869d748779-67hnj |
AddedInterface |
Add eth0 [10.133.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-869d748779-67hnj |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-869d748779-67hnj |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-869d748779-67hnj |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-disabled-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
deployment-controller |
auth-disabled-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set auth-disabled-test-kserve-router-scheduler-5c94d555f from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
auth-disabled-test-kserve-router-scheduler-5c94d555f |
SuccessfulCreate |
Created pod: auth-disabled-test-kserve-router-scheduler-5c94d555f-2jzf7 | |
kserve-ci-e2e-test |
multus |
auth-disabled-test-kserve-router-scheduler-5c94d555f-2jzf7 |
AddedInterface |
Add eth0 [10.133.0.51/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-5c94d555f-2jzf7 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-5c94d555f-2jzf7 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-5c94d555f-2jzf7 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-5c94d555f-2jzf7 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-5c94d555f-2jzf7 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-5c94d555f-2jzf7 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-router-managed-test-llm-4b931143] is Ready | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-869d748779-67hnj |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-869d748779-67hnj |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-869d748779-67hnj |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/auth-disabled-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-disabled-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/auth-disabled-test-kserve-route | |
| (x15) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test76d7f532acb694e4a7bcef75d32cd8a1-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler-6db55854f4 |
SuccessfulCreate |
Created pod: llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schecr5jf | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f |
SuccessfulCreate |
Created pod: llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler-6db55854f4 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schecr5jf |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schecr5jf |
Created |
Created container: main | |
kserve-ci-e2e-test |
multus |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schecr5jf |
AddedInterface |
Add eth0 [10.132.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schecr5jf |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-4f8c0978] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test76d7f532acb694e4a7bcef75d32cd8a1-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98fcrnvd |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schecr5jf |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schecr5jf |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test8ac8e3d2264ccb939eb021b0b835847c-llmisvc-rout | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-vcqb5 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep6gtb |
Killing |
Stopping container main | |
| (x11) | kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-869d748779-67hnj |
Unhealthy |
Startup probe failed: Get "https://10.133.0.50:8000/health": dial tcp 10.133.0.50:8000: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schep6gtb |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
LLMInferenceServiceReady |
LLMInferenceService [auth-disabled-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6448b6f56 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6448b6f56-k8nmn | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6448b6f56 from 0 to 1 | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-service | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler-686fbcf988 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schew77k4 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test5216bfd716f919dc046bc693ceb22e41-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-workload-svc | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler-686fbcf988 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schew77k4 |
AddedInterface |
Add eth0 [10.132.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schew77k4 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schew77k4 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schew77k4 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6448b6f56-k8nmn |
AddedInterface |
Add eth0 [10.133.0.52/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6448b6f56-k8nmn |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6448b6f56-k8nmn |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6448b6f56-k8nmn |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schew77k4 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schew77k4 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schew77k4 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-disabled-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-869d748779-67hnj |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-5c94d555f-2jzf7 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6448b6f56-k8nmn |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6448b6f56-k8nmn |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6448b6f56-k8nmn |
Started |
Started container main | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs | |
| (x2) | kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-5c94d555f-2jzf7 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-869d748779-67hnj |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.50:8000/health": dial tcp 10.133.0.50:8000: connect: connection refused | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-799f46c59b-8zdl2 |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-8zdl2 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-799f46c59b-8zdl2 | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-8zdl2 |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-799f46c59b-8zdl2 | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-8zdl2 |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-8zdl2 |
Killing |
Stopping container istio-proxy | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-p4vzh |
Created |
Created container: istio-proxy |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-p4vzh |
Started |
Started container istio-proxy |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-p4vzh |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-e95b1dc1] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs | |
| (x5) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-p4vzh |
Unhealthy |
Startup probe failed: Get "http://10.132.0.29:15021/healthz/ready": dial tcp 10.132.0.29:15021: connect: connection refused |
| (x7) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6448b6f56-k8nmn |
Unhealthy |
Startup probe failed: Get "https://10.133.0.52:8000/health": dial tcp 10.133.0.52:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-with-7ca60146] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test5216bfd716f919dc046bc693ceb22e41-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6448b6f56-k8nmn |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schew77k4 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schew77k4 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test05addb65ba05195619f26ef266e8fc04-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-c8bdfd4c5-b7t9d |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-c8bdfd4c5 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-c8bdfd4c5-b7t9d |
AddedInterface |
Add eth0 [10.133.0.53/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-c8bdfd4c5-b7t9d |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel4rnh |
AddedInterface |
Add eth0 [10.132.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler-58787c8b6c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler-58787c8b6c |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel4rnh | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-c8bdfd4c5 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-c8bdfd4c5-b7t9d | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-rb | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-c8bdfd4c5-b7t9d |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel4rnh |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel4rnh |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel4rnh |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel4rnh |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel4rnh |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel4rnh |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-c8bdfd4c5-b7t9d |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-c8bdfd4c5-b7t9d |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-c8bdfd4c5-b7t9d |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-shadow-svc |
| (x8) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-c8bdfd4c5-b7t9d |
Unhealthy |
Startup probe failed: Get "https://10.133.0.53:8000/health": dial tcp 10.133.0.53:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test05addb65ba05195619f26ef266e8fc04-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-with-ba4d693a] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-c8bdfd4c5-b7t9d |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel4rnh |
Killing |
Stopping container main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schel4rnh |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-c8bdfd4c5-b7t9d |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.53:8000/health": dial tcp 10.133.0.53:8000: connect: connection refused | |
kserve-ci-e2e-test |
job-controller |
e2e-pvc-model-download |
SuccessfulCreate |
Created pod: e2e-pvc-model-download-v8gm9 | |
kserve-ci-e2e-test |
ebs.csi.aws.com_aws-ebs-csi-driver-controller-7b88b554b4-pdrxj_7324cf68-1b94-480e-984f-2f77ea955896 |
e2e-pvc-model-storage |
Provisioning |
External provisioner is provisioning volume for claim "kserve-ci-e2e-test/e2e-pvc-model-storage" | |
kserve-ci-e2e-test |
persistentvolume-controller |
e2e-pvc-model-storage |
WaitForFirstConsumer |
waiting for first consumer to be created before binding | |
| (x3) | kserve-ci-e2e-test |
persistentvolume-controller |
e2e-pvc-model-storage |
ExternalProvisioning |
Waiting for a volume to be created either by the external provisioner 'ebs.csi.aws.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. |
kserve-ci-e2e-test |
ebs.csi.aws.com_aws-ebs-csi-driver-controller-7b88b554b4-pdrxj_7324cf68-1b94-480e-984f-2f77ea955896 |
e2e-pvc-model-storage |
ProvisioningSucceeded |
Successfully provisioned volume pvc-816e24b0-2442-4458-a346-0c49c6eaace7 | |
kserve-ci-e2e-test |
attachdetach-controller |
e2e-pvc-model-download-v8gm9 |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-816e24b0-2442-4458-a346-0c49c6eaace7" | |
kserve-ci-e2e-test |
kubelet |
e2e-pvc-model-download-v8gm9 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
e2e-pvc-model-download-v8gm9 |
AddedInterface |
Add eth0 [10.133.0.54/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
e2e-pvc-model-download-v8gm9 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
e2e-pvc-model-download-v8gm9 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
job-controller |
e2e-pvc-model-download |
Completed |
Job completed | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-pvc-router-manage-59b9d263 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-59b9d263-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-59b9d263-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-pvc-router-manage-59b9d263-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d |
SuccessfulCreate |
Created pod: llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dcbpff | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv8bf079eb6eda4debfb4ef5bb7817824c-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler-6c65b6df8d |
SuccessfulCreate |
Created pod: llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche6qvh5 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-role | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche6qvh5 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche6qvh5 |
Created |
Created container: main | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler-6c65b6df8d from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche6qvh5 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche6qvh5 |
AddedInterface |
Add eth0 [10.132.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testc9569cf4801efc0ed27b2f25ffaee875-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-sa | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche6qvh5 |
FailedAttachVolume |
Multi-Attach error for volume "pvc-816e24b0-2442-4458-a346-0c49c6eaace7" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dcbpff | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dcbpff |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-816e24b0-2442-4458-a346-0c49c6eaace7" | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dcbpff |
AddedInterface |
Add eth0 [10.133.0.55/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dcbpff |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dcbpff |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dcbpff |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-shadow-svc |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv8bf079eb6eda4debfb4ef5bb7817824c-kserve-self-signed-certs |
| (x2) | kserve-ci-e2e-test |
GatewayAuthBootstrap |
router-gateway-1 |
ReconcileError |
Failed to delete gateway PodMonitor: failed to delete PodMonitor: podmonitors.monitoring.coreos.com "router-gateway-1-metrics" not found |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4l6x9m |
Killing |
Stopping container main | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-87882a8e |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5bccf9c7bf from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5bccf9c7bf |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5bccf9c7bf7rct2 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5bccf9c7bf7rct2 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test21fe6730fe484f3a92b1a16afe1bac8f-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5bccf9c7bf7rct2 |
AddedInterface |
Add eth0 [10.133.0.56/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-sa | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5bccf9c7bf7rct2 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler-58dc5f6d78 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-role | |
kserve-ci-e2e-test |
multus |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche9fnck |
AddedInterface |
Add eth0 [10.132.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-rb | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5bccf9c7bf7rct2 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler-58dc5f6d78 |
SuccessfulCreate |
Created pod: llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche9fnck | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche9fnck |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche9fnck |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche9fnck |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche9fnck |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche9fnck |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche9fnck |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5bccf9c7bf7rct2 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5bccf9c7bf7rct2 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5bccf9c7bf7rct2 |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-shadow-svc |
| (x11) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dcbpff |
Unhealthy |
Startup probe failed: Get "https://10.133.0.55:8000/health": dial tcp 10.133.0.55:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-pvc-router-manage-59b9d263] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche6qvh5 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testc9569cf4801efc0ed27b2f25ffaee875-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dcbpff |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche6qvh5 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-pvc-router-manage-e8706282 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-e8706282-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-e8706282-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvb19f98874e050eec8ca94d49676113f0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler-77688f7d79 |
SuccessfulCreate |
Created pod: llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schetkz8g | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schetkz8g |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testf5d060a5eb39a04e074b78907a1556a6-llmisvc-mode | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79497db4cc |
SuccessfulCreate |
Created pod: llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79t95rn | |
kserve-ci-e2e-test |
deployment-controller |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler-77688f7d79 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve | |
kserve-ci-e2e-test |
multus |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schetkz8g |
AddedInterface |
Add eth0 [10.132.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-prefill | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schetkz8g |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schetkz8g |
Started |
Started container main | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468 |
SuccessfulCreate |
Created pod: llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-wqjwf | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-rb | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79497db4cc from 0 to 1 | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-wqjwf |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-816e24b0-2442-4458-a346-0c49c6eaace7" | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schetkz8g |
FailedAttachVolume |
Multi-Attach error for volume "pvc-816e24b0-2442-4458-a346-0c49c6eaace7" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-wqjwf, llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79t95rn | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79t95rn |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-816e24b0-2442-4458-a346-0c49c6eaace7" | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-wqjwf |
Pulling |
Pulling image "quay.io/opendatahub/odh-llm-d-router-disagg-sidecar:v0.9.0" | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-wqjwf |
AddedInterface |
Add eth0 [10.133.0.57/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79t95rn |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79t95rn |
AddedInterface |
Add eth0 [10.133.0.58/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79t95rn |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79t95rn |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-wqjwf |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-wqjwf |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-wqjwf |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-disagg-sidecar:v0.9.0" in 1.825s (1.825s including waiting). Image size: 166803393 bytes. | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-wqjwf |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-wqjwf |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-wqjwf |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-route | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-shadow-svc |
| (x11) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5bccf9c7bf7rct2 |
Unhealthy |
Startup probe failed: Get "https://10.133.0.56:8000/health": dial tcp 10.133.0.56:8000: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvb19f98874e050eec8ca94d49676113f0-kserve-self-signed-certs |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-87882a8e] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5bccf9c7bf7rct2 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test21fe6730fe484f3a92b1a16afe1bac8f-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche9fnck |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche9fnck |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-5bccf9c7bf7rct2 |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.56:8000/health": dial tcp 10.133.0.56:8000: connect: connection refused | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
custom-route-timeout-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-test-kserve-router-scheduler-6869bff8d5 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-test-kserve-d4b5cbd7 |
SuccessfulCreate |
Created pod: custom-route-timeout-test-kserve-d4b5cbd7-ntdnx | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-d4b5cbd7-ntdnx |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-d4b5cbd7-ntdnx |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-d4b5cbd7-ntdnx |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-test-kserve-d4b5cbd7-ntdnx |
AddedInterface |
Add eth0 [10.133.0.59/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-test-kserve-router-scheduler-6869bff88sqkk |
AddedInterface |
Add eth0 [10.132.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-6869bff88sqkk |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-6869bff88sqkk |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-6869bff88sqkk |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-test-kserve-router-scheduler-6869bff8d5 |
SuccessfulCreate |
Created pod: custom-route-timeout-test-kserve-router-scheduler-6869bff88sqkk | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-test-kserve |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-test-kserve-d4b5cbd7 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Role kserve-ci-e2e-test/custom-route-timeout-test-epp-role | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-6869bff88sqkk |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-6869bff88sqkk |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-6869bff88sqkk |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-d4b5cbd7-ntdnx |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-d4b5cbd7-ntdnx |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-d4b5cbd7-ntdnx |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-test-kserve-shadow-svc |
| (x16) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79t95rn |
Unhealthy |
Startup probe failed: Get "https://10.133.0.58:8000/health": dial tcp 10.133.0.58:8000: connect: connection refused |
| (x16) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-wqjwf |
Unhealthy |
Startup probe failed: Get "https://10.133.0.57:8001/health": dial tcp 10.133.0.57:8001: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-pvc-router-manage-e8706282] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schetkz8g |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-wqjwf |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-bbf66b468-wqjwf |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testf5d060a5eb39a04e074b78907a1556a6-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79t95rn |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-schetkz8g |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
| (x13) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-d4b5cbd7-ntdnx |
Unhealthy |
Startup probe failed: Get "https://10.133.0.59:8000/health": dial tcp 10.133.0.59:8000: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79t95rn |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.58:8000/health": dial tcp 10.133.0.58:8000: connect: connection refused | |
| (x9) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-pvc-router-manage-2577e794 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-2577e794-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-2577e794-kserve-route" not found |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
SuccessfulCreate |
create Pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 in StatefulSet llmisvc-model-pvc-router-manage-2577e794-kserve-mn successful | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
GroupsProgressing |
Created leader statefulset llmisvc-model-pvc-router-manage-2577e794-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-scc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
GroupsProgressing |
Created worker statefulset for leader pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-sa | |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schepj8r4 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schepj8r4 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schepj8r4 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schepj8r4 |
AddedInterface |
Add eth0 [10.132.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler-794465cd98 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler-794465cd98 |
SuccessfulCreate |
Created pod: llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schepj8r4 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test37591b20e96e9663d45a730d03070f1e-llmisvc-mode | |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
GroupsProgressing |
Replicas are progressing, with 0 groups ready of total 1 groups |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
CreatingRevision |
Creating revision with key 686d468674 for a newly created LeaderWorkerSet | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
SuccessfulCreate |
create Pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 in StatefulSet llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 successful | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schepj8r4 |
FailedAttachVolume |
Multi-Attach error for volume "pvc-816e24b0-2442-4458-a346-0c49c6eaace7" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0, llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-816e24b0-2442-4458-a346-0c49c6eaace7" | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
LLMInferenceServiceReady |
LLMInferenceService [custom-route-timeout-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
AddedInterface |
Add eth0 [10.133.0.61/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
AddedInterface |
Add eth0 [10.133.0.60/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-route | |
| (x8) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Created |
Created container: main | |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-d4b5cbd7-ntdnx |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-6869bff88sqkk |
Killing |
Stopping container main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-6869bff88sqkk |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x4) | kserve-ci-e2e-test |
gateway_labeler_controller |
router-gateway-1 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway router-gateway-1 |
| (x4) | kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-1-openshift-default-799f46c59b from 0 to 1 |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-799f46c59b-prgpl | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-prgpl |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-799f46c59b-prgpl |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-prgpl |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-prgpl |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-p4vzh |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-54c47cdfc7-p4vzh | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-54c47cdfc7-mw42d | |
| (x2) | kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled down replica set router-gateway-1-openshift-default-54c47cdfc7 from 1 to 0 |
| (x3) | kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-1-openshift-default-54c47cdfc7 from 0 to 1 |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-mw42d |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-54c47cdfc7-mw42d |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-mw42d |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-mw42d |
Started |
Started container istio-proxy | |
| (x5) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-mw42d |
Unhealthy |
Startup probe failed: Get "http://10.134.0.39:15021/healthz/ready": dial tcp 10.134.0.39:15021: connect: connection refused |
| (x4) | kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled down replica set router-gateway-1-openshift-default-799f46c59b from 1 to 0 |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-799f46c59b-prgpl | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-prgpl |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Role kserve-ci-e2e-test/router-with-refs-test-epp-role | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-test-kserve-68cd5c496c |
SuccessfulCreate |
Created pod: router-with-refs-test-kserve-68cd5c496c-5htr4 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-test-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-test-kserve-router-scheduler-859f948bc7 |
SuccessfulCreate |
Created pod: router-with-refs-test-kserve-router-scheduler-859f948bc7-vnnjg | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-68cd5c496c-5htr4 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-68cd5c496c-5htr4 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-test-epp-rb | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-test-kserve |
ScalingReplicaSet |
Scaled up replica set router-with-refs-test-kserve-68cd5c496c from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set router-with-refs-test-kserve-router-scheduler-859f948bc7 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-68cd5c496c-5htr4 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
multus |
router-with-refs-test-kserve-68cd5c496c-5htr4 |
AddedInterface |
Add eth0 [10.133.0.62/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
router-with-refs-test-kserve-router-scheduler-859f948bc7-vnnjg |
AddedInterface |
Add eth0 [10.132.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-859f948bc7-vnnjg |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-859f948bc7-vnnjg |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-859f948bc7-vnnjg |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-859f948bc7-vnnjg |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-859f948bc7-vnnjg |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-859f948bc7-vnnjg |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
| (x5) | kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-68cd5c496c-5htr4 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-68cd5c496c-5htr4 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-68cd5c496c-5htr4 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs | |
| (x14) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Unhealthy |
Startup probe failed: Get "https://10.133.0.60:8000/health": dial tcp 10.133.0.60:8000: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
AllGroupsReady |
All replicas are ready, with 1 groups ready of total 1 groups |
| (x12) | kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-68cd5c496c-5htr4 |
Unhealthy |
Startup probe failed: Get "https://10.133.0.62:8000/health": dial tcp 10.133.0.62:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
LLMInferenceServiceReady |
LLMInferenceService [router-with-refs-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-68cd5c496c-5htr4 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-859f948bc7-vnnjg |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-859f948bc7-vnnjg |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-68cd5c496c-5htr4 |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.62:8000/health": dial tcp 10.133.0.62:8000: connect: connection refused | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-50bc673d |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-8c6bb85d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-8c6bb85d |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-8cl8mwz | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-50bc673d-kserve-7cd67cfb9b from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-7cd67cfb9b |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-50bc673d-kserve-7cd67cfb9bhccbp | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche68br6 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-7cd67cfb9bhccbp |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-7cd67cfb9bhccbp |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
multus |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche68br6 |
AddedInterface |
Add eth0 [10.132.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-7cd67cfb9bhccbp |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche68br6 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche68br6 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test00d7278d8a22c4e39146a6b0eb840f45-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-epp-sa | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-8cl8mwz |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-7cd67cfb9bhccbp |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler-6f8cf8775b |
SuccessfulCreate |
Created pod: llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche68br6 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-8cl8mwz |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-7cd67cfb9bhccbp |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-8cl8mwz |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-7cd67cfb9bhccbp |
AddedInterface |
Add eth0 [10.133.0.63/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-8cl8mwz |
AddedInterface |
Add eth0 [10.133.0.64/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler-6f8cf8775b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-7cd67cfb9bhccbp |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-disagg-sidecar:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche68br6 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche68br6 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche68br6 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-7cd67cfb9bhccbp |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-7cd67cfb9bhccbp |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-8cl8mwz |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-8cl8mwz |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-8cl8mwz |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-7cd67cfb9bhccbp |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-pvc-router-manage-2577e794] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route | |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schepj8r4 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test37591b20e96e9663d45a730d03070f1e-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
FailedToRetrieveImagePullSecret |
Unable to retrieve some image pull secrets (llmisvc-model-pvc-router-manage-2577e7-b09f84b1-dockercfg-r5srj); attempting to pull the image may not succeed. | |
| (x2) | kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-schepj8r4 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.60:8000/health": dial tcp 10.133.0.60:8000: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Killing |
Stopping container main | |
| (x6) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
FailedMount |
MountVolume.SetUp failed for volume "tls-certs" : secret "llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-criticality |
UpdateFailed |
Failed to update status for LLMInferenceService "conv-test-criticality": Operation cannot be fulfilled on llminferenceservices.serving.kserve.io "conv-test-criticality": the object has been modified; please apply your changes to the latest version and try again | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-lora-crit |
UpdateFailed |
Failed to update status for LLMInferenceService "conv-test-lora-crit": llminferenceservices.serving.kserve.io "conv-test-lora-crit" not found | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-round-trip |
UpdateFailed |
Failed to update status for LLMInferenceService "conv-test-round-trip": llminferenceservices.serving.kserve.io "conv-test-round-trip" not found | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-f98bfbff |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-f98bfbff-xltsj | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-f98bfbff from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-stop-feature-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Role kserve-ci-e2e-test/stop-feature-test-epp-role | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-router-scheduler-546967d655 |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-router-scheduler-546967d655-jljrz | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-router-scheduler-546967d655-jljrz |
AddedInterface |
Add eth0 [10.132.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-f98bfbff-xltsj |
AddedInterface |
Add eth0 [10.133.0.65/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-546967d655-jljrz |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-f98bfbff-xltsj |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-f98bfbff-xltsj |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-546967d655-jljrz |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-546967d655-jljrz |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-f98bfbff-xltsj |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/stop-feature-test-epp-rb | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-router-scheduler-546967d655 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-546967d655-jljrz |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-546967d655-jljrz |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-546967d655-jljrz |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-f98bfbff-xltsj |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-f98bfbff-xltsj |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-f98bfbff-xltsj |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/stop-feature-test-kserve-shadow-svc |
| (x18) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-8cl8mwz |
Unhealthy |
Startup probe failed: Get "https://10.133.0.64:8000/health": dial tcp 10.133.0.64:8000: connect: connection refused |
| (x18) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-7cd67cfb9bhccbp |
Unhealthy |
Startup probe failed: Get "https://10.133.0.63:8001/health": dial tcp 10.133.0.63:8001: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-50bc673d] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test00d7278d8a22c4e39146a6b0eb840f45-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche68br6 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-7cd67cfb9bhccbp |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-7cd67cfb9bhccbp |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-8cl8mwz |
Killing |
Stopping container main | |
| (x15) | kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-f98bfbff-xltsj |
Unhealthy |
Startup probe failed: Get "https://10.133.0.65:8000/health": dial tcp 10.133.0.65:8000: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche68br6 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Error |
Reconciliation failed: failed to reconcile networking: failed to reconcile scheduler: failed to build expected scheduler deployment: failed to attach model artifacts to scheduler deployment: secrets "stop-feature-test-epp-sa-dockercfg-8hpdf" not found | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-f98bfbff-xltsj |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
LLMInferenceServiceNotReady |
LLMInferenceService [stop-feature-test] is no longer Ready because of: MainWorkloadReady, PrefillWorkerWorkloadReady, PrefillWorkloadReady, RouterReady, SchedulerWorkloadReady, WorkerWorkloadReady, WorkloadsReady | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-546967d655-jljrz |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.InferencePool kserve-ci-e2e-test/stop-feature-test-inference-pool | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
custom-route-timeout-pd-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-pd-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-pd-test-kserve-route" not found |
| (x2) | kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-546967d655-jljrz |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-5d9b9b4785 |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-5d9b9b4785-cb2v6 | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-prefill-589f5b6bd7 |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-prefill-589f5b6bd7-9mmxn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Role kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-role | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-5d9b9b4785 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-prefill-589f5b6bd7 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-router-scheduler-548f47ccd8 |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-router-scheduler-548f4klq5x | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-589f5b6bd7-9mmxn |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-router-scheduler-548f47ccd8 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-router-scheduler-548f4klq5x |
AddedInterface |
Add eth0 [10.132.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-548f4klq5x |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-548f4klq5x |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-548f4klq5x |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-prefill-589f5b6bd7-9mmxn |
AddedInterface |
Add eth0 [10.133.0.67/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-589f5b6bd7-9mmxn |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-5d9b9b4785-cb2v6 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-5d9b9b4785-cb2v6 |
AddedInterface |
Add eth0 [10.133.0.66/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-5d9b9b4785-cb2v6 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-disagg-sidecar:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-5d9b9b4785-cb2v6 |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-589f5b6bd7-9mmxn |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-5d9b9b4785-cb2v6 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-5d9b9b4785-cb2v6 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-5d9b9b4785-cb2v6 |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-548f4klq5x |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-548f4klq5x |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-548f4klq5x |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-589f5b6bd7-9mmxn |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-5d9b9b4785-cb2v6 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-5d9b9b4785-cb2v6 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
| (x25) | kserve-ci-e2e-test |
OpenDataHubModelController |
stop-feature-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy stop-feature-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "stop-feature-test-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-5d9b9b4785-cb2v6 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-589f5b6bd7-9mmxn |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-589f5b6bd7-9mmxn |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-f98bfbff-nln7t |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-f98bfbff from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-f98bfbff |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-f98bfbff-nln7t | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-f98bfbff-nln7t |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-f98bfbff-nln7t |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-f98bfbff-nln7t |
AddedInterface |
Add eth0 [10.133.0.68/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-router-scheduler-546967d655 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-router-scheduler-546967d655 |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-router-scheduler-546967d655-nrcg7 | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-546967d655-nrcg7 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-546967d655-nrcg7 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-router-scheduler-546967d655-nrcg7 |
AddedInterface |
Add eth0 [10.132.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-546967d655-nrcg7 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-546967d655-nrcg7 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-546967d655-nrcg7 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-546967d655-nrcg7 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-f98bfbff-nln7t |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-f98bfbff-nln7t |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-f98bfbff-nln7t |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-shadow-svc |
| (x19) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-589f5b6bd7-9mmxn |
Unhealthy |
Startup probe failed: Get "https://10.133.0.67:8000/health": dial tcp 10.133.0.67:8000: connect: connection refused |
| (x19) | kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-f98bfbff-nln7t |
Unhealthy |
Startup probe failed: Get "https://10.133.0.68:8000/health": dial tcp 10.133.0.68:8000: connect: connection refused |
| (x20) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-5d9b9b4785-cb2v6 |
Unhealthy |
Startup probe failed: Get "https://10.133.0.66:8001/health": dial tcp 10.133.0.66:8001: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
LLMInferenceServiceReady |
LLMInferenceService [custom-route-timeout-pd-test] is Ready | |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
LLMInferenceServiceReady |
LLMInferenceService [stop-feature-test] is Ready |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-546967d655-nrcg7 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-f98bfbff-nln7t |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-5d9b9b4785-cb2v6 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-589f5b6bd7-9mmxn |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-548f4klq5x |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-5d9b9b4785-cb2v6 |
Killing |
Stopping container llm-d-routing-sidecar | |
| (x2) | kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-546967d655-nrcg7 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-f98bfbff-nln7t |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.68:8000/health": dial tcp 10.133.0.68:8000: connect: connection refused | |
| (x2) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-548f4klq5x |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.Service kserve-ci-e2e-test/lora-single-adapter-test-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
lora-single-adapter-test-kserve-6c7646bb6b |
SuccessfulCreate |
Created pod: lora-single-adapter-test-kserve-6c7646bb6b-7wx5b | |
kserve-ci-e2e-test |
deployment-controller |
lora-single-adapter-test-kserve |
ScalingReplicaSet |
Scaled up replica set lora-single-adapter-test-kserve-6c7646bb6b from 0 to 1 | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
lora-single-adapter-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy lora-single-adapter-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/lora-single-adapter-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "lora-single-adapter-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.Secret kserve-ci-e2e-test/lora-single-adapter-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/lora-single-adapter-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/lora-single-adapter-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/lora-single-adapter-test-kserve-workload-svc | |
kserve-ci-e2e-test |
multus |
lora-single-adapter-test-kserve-6c7646bb6b-7wx5b |
AddedInterface |
Add eth0 [10.133.0.69/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-6c7646bb6b-7wx5b |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-6c7646bb6b-7wx5b |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-6c7646bb6b-7wx5b |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-2-openshift-default-54c789bdc6 |
SuccessfulCreate |
Created pod: router-gateway-2-openshift-default-54c789bdc6-44z29 | |
kserve-ci-e2e-test |
multus |
router-gateway-2-openshift-default-54c789bdc6-44z29 |
AddedInterface |
Add eth0 [10.132.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-44z29 |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
gateway_labeler_controller |
router-gateway-2 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway router-gateway-2 | |
kserve-ci-e2e-test |
service-controller |
router-gateway-2-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-2-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-2-openshift-default-54c789bdc6 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-6c7646bb6b-7wx5b |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-6c7646bb6b-7wx5b |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-44z29 |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-44z29 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-6c7646bb6b-7wx5b |
Started |
Started container main | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-2-openshift-default-684dc9b4b9 |
SuccessfulCreate |
Created pod: router-gateway-2-openshift-default-684dc9b4b9-zbq44 | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-2-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-2-openshift-default-684dc9b4b9 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
router-gateway-2-openshift-default-684dc9b4b9-zbq44 |
AddedInterface |
Add eth0 [10.132.0.51/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
service-controller |
router-gateway-2-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-2-openshift-default-54c789bdc6 |
SuccessfulDelete |
Deleted pod: router-gateway-2-openshift-default-54c789bdc6-44z29 | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-44z29 |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-2-openshift-default |
ScalingReplicaSet |
Scaled down replica set router-gateway-2-openshift-default-54c789bdc6 from 1 to 0 | |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/lora-single-adapter-test-kserve-self-signed-certs |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-zbq44 |
Started |
Started container istio-proxy |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-zbq44 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-zbq44 |
Created |
Created container: istio-proxy |
| (x5) | kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-zbq44 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.51:15021/healthz/ready": dial tcp 10.132.0.51:15021: connect: connection refused |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-b4685cc89 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-pd-test-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-b4685cc89 |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-b4685cc89-zfv4b | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Role kserve-ci-e2e-test/router-with-refs-pd-test-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-pd-test-kserve-rb | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-prefill-9dcd56f4c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-prefill-9dcd56f4c |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-prefill-9dcd56f4c-sqbg5 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-b4685cc89-zfv4b |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-disagg-sidecar:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-b4685cc89-zfv4b |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-9dcd56f4c-sqbg5 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-9dcd56f4c-sqbg5 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-prefill-9dcd56f4c-sqbg5 |
AddedInterface |
Add eth0 [10.133.0.71/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-router-scheduler-6668cbdbd4 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-router-scheduler-6668cbdbd4 |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-router-scheduler-6668cbdbdh7z6f | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-b4685cc89-zfv4b |
AddedInterface |
Add eth0 [10.133.0.70/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-9dcd56f4c-sqbg5 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-b4685cc89-zfv4b |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-b4685cc89-zfv4b |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-6668cbdbdh7z6f |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-b4685cc89-zfv4b |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-6668cbdbdh7z6f |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-6668cbdbdh7z6f |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-router-scheduler-6668cbdbdh7z6f |
AddedInterface |
Add eth0 [10.132.0.52/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-b4685cc89-zfv4b |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
| (x9) | kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-pd-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-6668cbdbdh7z6f |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-6668cbdbdh7z6f |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-6668cbdbdh7z6f |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-9dcd56f4c-sqbg5 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-9dcd56f4c-sqbg5 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-9dcd56f4c-sqbg5 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-b4685cc89-zfv4b |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-b4685cc89-zfv4b |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-b4685cc89-zfv4b |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs | |
| (x8) | kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-6c7646bb6b-7wx5b |
Unhealthy |
Startup probe failed: Get "https://10.133.0.69:8000/health": dial tcp 10.133.0.69:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-single-adapter-test |
LLMInferenceServiceReady |
LLMInferenceService [lora-single-adapter-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-6c7646bb6b-7wx5b |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
lora-single-adapter-test-kserve-6c7646bb6b-7wx5b |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.69:8000/health": dial tcp 10.133.0.69:8000: connect: connection refused | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.Secret kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-self-signed-certs | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
lora-multiple-adapters-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy lora-multiple-adapters-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "lora-multiple-adapters-test-kserve-route" not found |
kserve-ci-e2e-test |
replicaset-controller |
lora-multiple-adapters-test-kserve-77c65dc7cf |
SuccessfulCreate |
Created pod: lora-multiple-adapters-test-kserve-77c65dc7cf-mfh5p | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-77c65dc7cf-mfh5p |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-77c65dc7cf-mfh5p |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.Service kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/lora-multiple-adapters-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
lora-multiple-adapters-test-kserve |
ScalingReplicaSet |
Scaled up replica set lora-multiple-adapters-test-kserve-77c65dc7cf from 0 to 1 | |
kserve-ci-e2e-test |
multus |
lora-multiple-adapters-test-kserve-77c65dc7cf-mfh5p |
AddedInterface |
Add eth0 [10.133.0.72/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-77c65dc7cf-mfh5p |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-77c65dc7cf-mfh5p |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-77c65dc7cf-mfh5p |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-77c65dc7cf-mfh5p |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-self-signed-certs | |
| (x18) | kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-9dcd56f4c-sqbg5 |
Unhealthy |
Startup probe failed: Get "https://10.133.0.71:8000/health": dial tcp 10.133.0.71:8000: connect: connection refused |
| (x18) | kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-b4685cc89-zfv4b |
Unhealthy |
Startup probe failed: Get "https://10.133.0.70:8001/health": dial tcp 10.133.0.70:8001: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
LLMInferenceServiceReady |
LLMInferenceService [router-with-refs-pd-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-b4685cc89-zfv4b |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-b4685cc89-zfv4b |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-6668cbdbdh7z6f |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
GatewayAuthBootstrap |
router-gateway-2 |
ReconcileError |
Failed to delete gateway PodMonitor: failed to delete PodMonitor: podmonitors.monitoring.coreos.com "router-gateway-2-metrics" not found | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-9dcd56f4c-sqbg5 |
Killing |
Stopping container main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-6668cbdbdh7z6f |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvd10b93c8eba12f87c3a350a5cae2ee0c-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-workload-svc | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-3c960099 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-3c960099-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-3c960099-kserve-route" not found |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c7fd556fb |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c7fd556fb9fphn | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-3c960099-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c7fd556fb from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c7fd556fb9fphn |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c7fd556fb9fphn |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c7fd556fb9fphn |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c7fd556fb9fphn |
AddedInterface |
Add eth0 [10.133.0.73/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c7fd556fb9fphn |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c7fd556fb9fphn |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c7fd556fb9fphn |
Started |
Started container main | |
| (x8) | kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-77c65dc7cf-mfh5p |
Unhealthy |
Startup probe failed: Get "https://10.133.0.72:8000/health": dial tcp 10.133.0.72:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvd10b93c8eba12f87c3a350a5cae2ee0c-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
lora-multiple-adapters-test |
LLMInferenceServiceReady |
LLMInferenceService [lora-multiple-adapters-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-77c65dc7cf-mfh5p |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
lora-multiple-adapters-test-kserve-77c65dc7cf-mfh5p |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.72:8000/health": dial tcp 10.133.0.72:8000: connect: connection refused | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
tls-verification-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy tls-verification-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/tls-verification-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "tls-verification-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/tls-verification-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-tls-verification-test-epp-auth-rb | |
kserve-ci-e2e-test |
replicaset-controller |
tls-verification-test-kserve-57c75fd4f5 |
SuccessfulCreate |
Created pod: tls-verification-test-kserve-57c75fd4f5-wsg7t | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Service kserve-ci-e2e-test/tls-verification-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Secret kserve-ci-e2e-test/tls-verification-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/tls-verification-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
tls-verification-test-kserve |
ScalingReplicaSet |
Scaled up replica set tls-verification-test-kserve-57c75fd4f5 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/tls-verification-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Role kserve-ci-e2e-test/tls-verification-test-epp-role | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-59969bd6f5-4v7gg |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
tls-verification-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set tls-verification-test-kserve-router-scheduler-59969bd6f5 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-57c75fd4f5-wsg7t |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-59969bd6f5-4v7gg |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-59969bd6f5-4v7gg |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-57c75fd4f5-wsg7t |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
tls-verification-test-kserve-router-scheduler-59969bd6f5 |
SuccessfulCreate |
Created pod: tls-verification-test-kserve-router-scheduler-59969bd6f5-4v7gg | |
kserve-ci-e2e-test |
multus |
tls-verification-test-kserve-57c75fd4f5-wsg7t |
AddedInterface |
Add eth0 [10.133.0.74/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
tls-verification-test-kserve-router-scheduler-59969bd6f5-4v7gg |
AddedInterface |
Add eth0 [10.132.0.53/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-57c75fd4f5-wsg7t |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
Created v1.Service kserve-ci-e2e-test/tls-verification-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-59969bd6f5-4v7gg |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-59969bd6f5-4v7gg |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-59969bd6f5-4v7gg |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-57c75fd4f5-wsg7t |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-57c75fd4f5-wsg7t |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-57c75fd4f5-wsg7t |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/tls-verification-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/tls-verification-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/tls-verification-test-kserve-shadow-svc |
| (x13) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c7fd556fb9fphn |
Unhealthy |
Startup probe failed: Get "https://10.133.0.73:8000/health": dial tcp 10.133.0.73:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-3c960099] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c7fd556fb9fphn |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c7fd556fb9fphn |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.73:8000/health": dial tcp 10.133.0.73:8000: connect: connection refused | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
AddedInterface |
Add eth0 [10.133.0.76/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
SuccessfulCreate |
create Pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 in StatefulSet llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 successful | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
AddedInterface |
Add eth0 [10.133.0.75/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schetglm9 |
AddedInterface |
Add eth0 [10.132.0.54/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler-79848c949b from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler-79848c949b |
SuccessfulCreate |
Created pod: llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schetglm9 | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
CreatingRevision |
Creating revision with key 5667d6c4d8 for a newly created LeaderWorkerSet | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
GroupsProgressing |
Created leader statefulset llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn | |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
GroupsProgressing |
Replicas are progressing, with 0 groups ready of total 1 groups |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test386bd5808c5c450f11fd8632e1f821fb-llmisvc-mode | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
SuccessfulCreate |
create Pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 in StatefulSet llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn successful | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
GroupsProgressing |
Created worker statefulset for leader pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-scc | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schetglm9 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schetglm9 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schetglm9 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schetglm9 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schetglm9 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schetglm9 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs | |
| (x8) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-shadow-svc |
| (x11) | kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-57c75fd4f5-wsg7t |
Unhealthy |
Startup probe failed: Get "https://10.133.0.74:8000/health": dial tcp 10.133.0.74:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
LLMInferenceServiceReady |
LLMInferenceService [tls-verification-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-57c75fd4f5-wsg7t |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-59969bd6f5-4v7gg |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
tls-verification-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-tls-verification-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-router-scheduler-59969bd6f5-4v7gg |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
kubelet |
tls-verification-test-kserve-57c75fd4f5-wsg7t |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.74:8000/health": dial tcp 10.133.0.74:8000: connect: connection refused | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Service kserve-ci-e2e-test/prestop-hook-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Role kserve-ci-e2e-test/prestop-hook-test-epp-role | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c7d67c6bc-nm7qd |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c7d67c6bc-nm7qd |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c7d67c6bc-nm7qd |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/prestop-hook-test-epp-rb | |
kserve-ci-e2e-test |
multus |
prestop-hook-test-kserve-5c7d67c6bc-nm7qd |
AddedInterface |
Add eth0 [10.133.0.77/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-prestop-hook-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/prestop-hook-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Service kserve-ci-e2e-test/prestop-hook-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/prestop-hook-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
Created v1.Secret kserve-ci-e2e-test/prestop-hook-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
prestop-hook-test-kserve |
ScalingReplicaSet |
Scaled up replica set prestop-hook-test-kserve-5c7d67c6bc from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
prestop-hook-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set prestop-hook-test-kserve-router-scheduler-6c8475994c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
prestop-hook-test-kserve-router-scheduler-6c8475994c |
SuccessfulCreate |
Created pod: prestop-hook-test-kserve-router-scheduler-6c8475994c-mhqk2 | |
kserve-ci-e2e-test |
replicaset-controller |
prestop-hook-test-kserve-5c7d67c6bc |
SuccessfulCreate |
Created pod: prestop-hook-test-kserve-5c7d67c6bc-nm7qd | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-6c8475994c-mhqk2 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
prestop-hook-test-kserve-router-scheduler-6c8475994c-mhqk2 |
AddedInterface |
Add eth0 [10.132.0.55/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-6c8475994c-mhqk2 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-6c8475994c-mhqk2 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-6c8475994c-mhqk2 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-6c8475994c-mhqk2 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-6c8475994c-mhqk2 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c7d67c6bc-nm7qd |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c7d67c6bc-nm7qd |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c7d67c6bc-nm7qd |
Created |
Created container: main | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/prestop-hook-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/prestop-hook-test-kserve-route | |
| (x14) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Unhealthy |
Startup probe failed: Get "https://10.133.0.75:8000/health": dial tcp 10.133.0.75:8000: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
AllGroupsReady |
All replicas are ready, with 1 groups ready of total 1 groups |
| (x11) | kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c7d67c6bc-nm7qd |
Unhealthy |
Startup probe failed: Get "https://10.133.0.77:8000/health": dial tcp 10.133.0.77:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
LLMInferenceServiceReady |
LLMInferenceService [prestop-hook-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c7d67c6bc-dzgk6 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:86207d1cba5aecf8e7b5bca617ed35061e54e289c7778b383f47cc8d53214f1a" already present on machine | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c7d67c6bc-dzgk6 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
prestop-hook-test-kserve-5c7d67c6bc |
SuccessfulCreate |
Created pod: prestop-hook-test-kserve-5c7d67c6bc-dzgk6 | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c7d67c6bc-nm7qd |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
multus |
prestop-hook-test-kserve-5c7d67c6bc-dzgk6 |
AddedInterface |
Add eth0 [10.133.0.78/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c7d67c6bc-dzgk6 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c7d67c6bc-dzgk6 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c7d67c6bc-dzgk6 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c7d67c6bc-dzgk6 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c7d67c6bc-dzgk6 |
Unhealthy |
Startup probe failed: Get "https://10.133.0.78:8000/health": dial tcp 10.133.0.78:8000: connect: connection refused | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
LLMInferenceServiceNotReady |
LLMInferenceService [prestop-hook-test] is no longer Ready because of: MainWorkloadReady, WorkloadsReady | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c7d67c6bc-nm7qd |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.77:8000/health": dial tcp 10.133.0.77:8000: connect: connection refused | |
| (x3) | kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/prestop-hook-test-kserve-self-signed-certs |
kserve-ci-e2e-test |
LLMInferenceServiceController |
prestop-hook-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-prestop-hook-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-5c7d67c6bc-dzgk6 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-6c8475994c-mhqk2 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-dc21cb14] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test386bd5808c5c450f11fd8632e1f821fb-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schetglm9 |
Killing |
Stopping container main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
prestop-hook-test-kserve-router-scheduler-6c8475994c-mhqk2 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
| (x2) | kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schetglm9 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.75:8000/health": dial tcp 10.133.0.75:8000: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-inline-config-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-inline-config-test-kserve-7c6c58cc96 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-inline-config-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-inline-config-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-inline-config-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-inline-config-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-inline-config-test-kserve-7c6c58cc96 |
SuccessfulCreate |
Created pod: scheduler-inline-config-test-kserve-7c6c58cc96-mmp8b | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-inline-config-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-568fc8nwn8 |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
scheduler-inline-config-test-kserve-7c6c58cc96-mmp8b |
AddedInterface |
Add eth0 [10.132.0.56/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-mmp8b |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-mmp8b |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
scheduler-inline-config-test-kserve-router-scheduler-568fc8nwn8 |
AddedInterface |
Add eth0 [10.132.0.57/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-568fc8nwn8 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-568fc8nwn8 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-mmp8b |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-inline-config-test-kserve-router-scheduler-568fc9df99 |
SuccessfulCreate |
Created pod: scheduler-inline-config-test-kserve-router-scheduler-568fc8nwn8 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-inline-config-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-inline-config-test-kserve-router-scheduler-568fc9df99 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-inline-config-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-inline-config-test-kserve-shadow-svc |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
rolling-upgrade-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy rolling-upgrade-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/rolling-upgrade-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "rolling-upgrade-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/rolling-upgrade-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-rolling-upgrade-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Role kserve-ci-e2e-test/rolling-upgrade-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/rolling-upgrade-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
replicaset-controller |
rolling-upgrade-test-kserve-54bc76f55b |
SuccessfulCreate |
Created pod: rolling-upgrade-test-kserve-54bc76f55b-pmrdl | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Service kserve-ci-e2e-test/rolling-upgrade-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Service kserve-ci-e2e-test/rolling-upgrade-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
Created v1.Secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
rolling-upgrade-test-kserve |
ScalingReplicaSet |
Scaled up replica set rolling-upgrade-test-kserve-54bc76f55b from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
rolling-upgrade-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set rolling-upgrade-test-kserve-router-scheduler-745dd558f from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
rolling-upgrade-test-kserve-router-scheduler-745dd558f |
SuccessfulCreate |
Created pod: rolling-upgrade-test-kserve-router-scheduler-745dd558f-r9qcv | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-745dd558f-r9qcv |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-745dd558f-r9qcv |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-745dd558f-r9qcv |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
multus |
rolling-upgrade-test-kserve-router-scheduler-745dd558f-r9qcv |
AddedInterface |
Add eth0 [10.133.0.79/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-54bc76f55b-pmrdl |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-54bc76f55b-pmrdl |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-54bc76f55b-pmrdl |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
multus |
rolling-upgrade-test-kserve-54bc76f55b-pmrdl |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-inline-config-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/rolling-upgrade-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/rolling-upgrade-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-568fc8nwn8 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-mmp8b |
Killing |
Stopping container main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-568fc8nwn8 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-mmp8b |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.56:8000/health": dial tcp 10.132.0.56:8000: connect: connection refused | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-workload-svc | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4 |
SuccessfulCreate |
Created pod: llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4rn477 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler-6cc69fd994 |
SuccessfulCreate |
Created pod: llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schev5h4d | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-rb | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler-6cc69fd994 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test80f99418f0f3eb4c80f02e6144a6d4f2-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-sa | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4rn477 |
Created |
Created container: main | |
kserve-ci-e2e-test |
multus |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4rn477 |
AddedInterface |
Add eth0 [10.132.0.58/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schev5h4d |
AddedInterface |
Add eth0 [10.132.0.59/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4rn477 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schev5h4d |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schev5h4d |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schev5h4d |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4rn477 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
LLMInferenceServiceReady |
LLMInferenceService [rolling-upgrade-test] is Ready | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
rolling-upgrade-test-kserve-859df57bcb |
SuccessfulCreate |
Created pod: rolling-upgrade-test-kserve-859df57bcb-hjr8m | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Updated |
Updated v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
rolling-upgrade-test-kserve |
ScalingReplicaSet |
Scaled up replica set rolling-upgrade-test-kserve-859df57bcb from 0 to 1 | |
kserve-ci-e2e-test |
multus |
rolling-upgrade-test-kserve-859df57bcb-hjr8m |
AddedInterface |
Add eth0 [10.133.0.80/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-hjr8m |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-hjr8m |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-hjr8m |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-54bc76f55b-pmrdl |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
rolling-upgrade-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-rolling-upgrade-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-745dd558f-r9qcv |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-hjr8m |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-router-scheduler-745dd558f-r9qcv |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schev5h4d |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-4c1ba212] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test80f99418f0f3eb4c80f02e6144a6d4f2-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4rn477 |
Killing |
Stopping container main | |
| (x6) | kserve-ci-e2e-test |
kubelet |
rolling-upgrade-test-kserve-859df57bcb-hjr8m |
FailedMount |
MountVolume.SetUp failed for volume "tls-certs" : secret "rolling-upgrade-test-kserve-self-signed-certs" not found |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schev5h4d |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-configmap-ref-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-configmap-ref-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-configmap-ref-test-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
scheduler-configmap-ref-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-configmap-ref-test-kserve-744bf59fbd from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-service | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-configmap-ref-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-configmap-ref-test-kserve-router-scheduler-669fffdcd9 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-configmap-ref-test-kserve-744bf59fbd |
SuccessfulCreate |
Created pod: scheduler-configmap-ref-test-kserve-744bf59fbd-d7l7h | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-role | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-configmap-ref-test-kserve-router-scheduler-669fffdcd9 |
SuccessfulCreate |
Created pod: scheduler-configmap-ref-test-kserve-router-scheduler-669ffrln5v | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-669ffrln5v |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-d7l7h |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
scheduler-configmap-ref-test-kserve-744bf59fbd-d7l7h |
AddedInterface |
Add eth0 [10.132.0.60/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
scheduler-configmap-ref-test-kserve-router-scheduler-669ffrln5v |
AddedInterface |
Add eth0 [10.132.0.61/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-d7l7h |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-d7l7h |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-669ffrln5v |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-669ffrln5v |
Started |
Started container main | |
| (x5) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-workload-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Error |
Reconciliation failed: failed to reconcile workload: failed to reconcile self-signed certificates secret: failed to reconcile self-signed TLS certificate: failed to get defaults for v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs: context canceled | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
UpdateFailed |
Failed to update status for LLMInferenceService "scheduler-configmap-ref-test": context canceled | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-shadow-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-configmap-ref-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-d7l7h |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-669ffrln5v |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-669ffrln5v |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-custom-template-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-custom-template-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-custom-template-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-custom-template-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-custom-template-test-epp-auth-rb | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-custom-template-test-kserve-5bc7bd6864 |
SuccessfulCreate |
Created pod: scheduler-custom-template-test-kserve-5bc7bd6864-bgg6r | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-custom-template-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-custom-template-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-custom-template-test-kserve-5bc7bd6864 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-custom-template-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-custom-template-test-kserve-router-scheduler-89d9b575b from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-custom-template-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-custom-template-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-custom-template-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-custom-template-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-custom-template-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-bgg6r |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-custom-template-test-kserve-router-scheduler-89d9b575b |
SuccessfulCreate |
Created pod: scheduler-custom-template-test-kserve-router-scheduler-89dmbzl2 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-custom-template-test-epp-role | |
kserve-ci-e2e-test |
multus |
scheduler-custom-template-test-kserve-5bc7bd6864-bgg6r |
AddedInterface |
Add eth0 [10.132.0.62/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
scheduler-custom-template-test-kserve-router-scheduler-89dmbzl2 |
AddedInterface |
Add eth0 [10.132.0.63/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-89dmbzl2 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-89dmbzl2 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-89dmbzl2 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-bgg6r |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-bgg6r |
Created |
Created container: main | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-ha-replicas-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-ha-replicas-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-ha-replicas-test-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
scheduler-ha-replicas-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-ha-replicas-test-kserve-5c5cfcf776 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-service | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-ha-replicas-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fcfc from 0 to 2 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-rb | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85ft6fh6 |
AddedInterface |
Add eth0 [10.132.0.64/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt |
Created |
Created container: main | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fj5r7j |
AddedInterface |
Add eth0 [10.133.0.82/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fcfc |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-85cd85ft6fh6 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fcfc |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fj5r7j | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-5c5cfcf776 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85ft6fh6 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85ft6fh6 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fj5r7j |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fj5r7j |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fj5r7j |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85ft6fh6 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-custom-template-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-custom-template-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-custom-template-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-custom-template-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-custom-template-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-ha-replicas-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-bgg6r |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-89dmbzl2 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-vj8mt |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fj5r7j |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85ft6fh6 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-89dmbzl2 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
| (x6) | kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85fj5r7j |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85ft6fh6 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-85cd85ft6fh6 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-bgg6r |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.62:8000/health": dial tcp 10.132.0.62:8000: connect: connection refused | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-pd-migration-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-rb | |
kserve-ci-e2e-test |
multus |
scheduler-v06-pd-migration-test-kserve-74c855b64f-5zk24 |
AddedInterface |
Add eth0 [10.133.0.83/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-v06-pd-migration-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-pd-migration-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-pd-migration-test-kserve-74c855b64f |
SuccessfulCreate |
Created pod: scheduler-v06-pd-migration-test-kserve-74c855b64f-5zk24 | |
kserve-ci-e2e-test |
multus |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-2jdrt |
AddedInterface |
Add eth0 [10.132.0.65/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847 |
SuccessfulCreate |
Created pod: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-2jdrt | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-pd-migration-test-kserve-router-scheduler-6fc5d87465 |
SuccessfulCreate |
Created pod: scheduler-v06-pd-migration-test-kserve-router-scheduler-6ffwd5k | |
| (x9) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-v06-pd-migration-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-v06-pd-migration-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-v06-pd-migration-test-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-pd-migration-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-pd-migration-test-kserve-74c855b64f from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-pd-migration-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-pd-migration-test-kserve-router-scheduler-6fc5d87465 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-74c855b64f-5zk24 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-74c855b64f-5zk24 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-6ffwd5k |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
multus |
scheduler-v06-pd-migration-test-kserve-router-scheduler-6ffwd5k |
AddedInterface |
Add eth0 [10.132.0.66/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-2jdrt |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-2jdrt |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-2jdrt |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-74c855b64f-5zk24 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-disagg-sidecar:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-6ffwd5k |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-74c855b64f-5zk24 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-6ffwd5k |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-74c855b64f-5zk24 |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-74c855b64f-5zk24 |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-shadow-svc |
| (x14) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-v06-threshold-migration-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-v06-threshold-migration-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-v06-threshold-migration-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test0a07e82be2036793543b2d3db2ea0785-scheduler-v0 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
multus |
scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-threshold-migration-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-threshold-migration-test-kserve-859798d76c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-threshold-migration-test-kserve-859798d76c |
SuccessfulCreate |
Created pod: scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs | |
kserve-ci-e2e-test |
multus |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc54jckj |
AddedInterface |
Add eth0 [10.132.0.67/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc599dc49 |
SuccessfulCreate |
Created pod: scheduler-v06-threshold-migration-test-kserve-prefill-5fc54jckj | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-threshold-migration-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-threshold-migration-test-kserve-router-scheduler-9d7fdfbbd from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-threshold-migration-test-kserve-router-scheduler-9d7fdfbbd |
SuccessfulCreate |
Created pod: scheduler-v06-threshold-migration-test-kserve-router-schedxrdl5 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-threshold-migration-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-threshold-migration-test-kserve-prefill-5fc599dc49 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedxrdl5 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs |
Pulling |
Pulling image "quay.io/opendatahub/odh-llm-d-router-disagg-sidecar:v0.9.0" | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc54jckj |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc54jckj |
Created |
Created container: main | |
kserve-ci-e2e-test |
multus |
scheduler-v06-threshold-migration-test-kserve-router-schedxrdl5 |
AddedInterface |
Add eth0 [10.133.0.84/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedxrdl5 |
Pulled |
Container image "quay.io/opendatahub/odh-llm-d-router-endpoint-picker:v0.9.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc54jckj |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedxrdl5 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs |
Pulled |
Successfully pulled image "quay.io/opendatahub/odh-llm-d-router-disagg-sidecar:v0.9.0" in 2.583s (2.583s including waiting). Image size: 166803393 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-v06-pd-migration-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-route | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-v06-threshold-migration-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc54jckj |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedxrdl5 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test0a07e82be2036793543b2d3db2ea0785-scheduler-v0 | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedxrdl5 |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-859798d76c-b9zvs |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.42:8001/health": dial tcp 10.134.0.42:8001: connect: connection refused |