| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
router-with-refs-test-kserve-69686d4fbd-mlmqd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-69686d4fbd-mlmqd to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
e2e-pvc-model-download-z62nj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/e2e-pvc-model-download-z62nj to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-pd-migration-test-kserve-5c87756974-bgqq5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-bgqq5 to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-wgdh2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-wgdh2 to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-pd-migration-test-kserve-router-scheduler-59qr7w8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-59qr7w8 to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-zhckd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-zhckd to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5ws27c |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc5ws27c to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-v06-threshold-migration-test-kserve-router-schedwqxc2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-schedwqxc2 to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-6c69b69b5d-v4g66 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6c69b69b5d-v4g66 to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-test-kserve-router-scheduler-5f76b9b8j8dlr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5f76b9b8j8dlr to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
auth-disabled-test-kserve-router-scheduler-69fc65b9c7-zrdff |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-disabled-test-kserve-router-scheduler-69fc65b9c7-zrdff to ip-10-0-134-202.ec2.internal | ||
kuadrant-system |
authorino-7c77957575-k7wx6 |
Scheduled |
Successfully assigned kuadrant-system/authorino-7c77957575-k7wx6 to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-wwzw9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-wwzw9 to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79m2299 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79m2299 to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvxrb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvxrb to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-6c69b69b5d-kwcd6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-6c69b69b5d-kwcd6 to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dptxbh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dptxbh to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheffxrb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheffxrb to ip-10-0-131-165.ec2.internal | ||
kuadrant-system |
authorino-8df697c9f-shs9j |
Scheduled |
Successfully assigned kuadrant-system/authorino-8df697c9f-shs9j to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesstzr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesstzr to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6c8c6d4bd8-v7x5l |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6c8c6d4bd8-v7x5l to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schev6vd7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schev6vd7 to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schebs46r |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schebs46r to ip-10-0-131-165.ec2.internal | ||
openshift-ingress |
istiod-openshift-gateway-94bb8fbfd-x2st2 |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-94bb8fbfd-x2st2 to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dnhjpk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dnhjpk to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5855cf58bb5ggkx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5855cf58bb5ggkx to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-test-kserve-5f665ff7fb-2ltj8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-5f665ff7fb-2ltj8 to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche72cwk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche72cwk to ip-10-0-134-202.ec2.internal | ||
kuadrant-system |
authorino-b6c89bb85-kw7ft |
Scheduled |
Successfully assigned kuadrant-system/authorino-b6c89bb85-kw7ft to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevpfk4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevpfk4 to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schect2dz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schect2dz to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche5rn6q |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche5rn6q to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schez4nq5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schez4nq5 to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-5c5cfcf776-99knr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-99knr to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scherhk8p |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scherhk8p to ip-10-0-131-165.ec2.internal | ||
kuadrant-system |
limitador-limitador-ff68ff5cb-gf8sq |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-ff68ff5cb-gf8sq to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
auth-enabled-test-kserve-7bfb886698-zqrv5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-enabled-test-kserve-7bfb886698-zqrv5 to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-custom-template-test-kserve-router-scheduler-56762884 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-56762884 to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-custom-template-test-kserve-5bc7bd6864-5b4tt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-5b4tt to ip-10-0-134-202.ec2.internal | ||
kuadrant-system |
kuadrant-console-plugin-85fd4b8b9d-fq2x9 |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-fq2x9 to ip-10-0-131-165.ec2.internal | ||
kuadrant-system |
kuadrant-operator-controller-manager-bb7ddb7d7-h6vpf |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-h6vpf to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-7578d795d5-d8x2l |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-7578d795d5-d8x2l to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-inline-config-test-kserve-router-scheduler-d9ddfvmh8l |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddfvmh8l to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-inline-config-test-kserve-7c6c58cc96-vfth6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-vfth6 to ip-10-0-134-202.ec2.internal | ||
kuadrant-system |
authorino-operator-6d85f6564-kv2wg |
Scheduled |
Successfully assigned kuadrant-system/authorino-operator-6d85f6564-kv2wg to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schec5q9d |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schec5q9d to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
auth-invalid-token-test-kserve-router-scheduler-6c5f8f864brq9nx |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-invalid-token-test-kserve-router-scheduler-6c5f8f864brq9nx to ip-10-0-134-202.ec2.internal | ||
kuadrant-system |
limitador-operator-controller-manager-6f9f468797-w2wzk |
Scheduled |
Successfully assigned kuadrant-system/limitador-operator-controller-manager-6f9f468797-w2wzk to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schecvlkm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schecvlkm to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-configmap-ref-test-kserve-router-scheduler-68f87snbv9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87snbv9 to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
auth-enabled-test-kserve-router-scheduler-6956d85f9b-zqlh2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-6956d85f9b-zqlh2 to ip-10-0-134-202.ec2.internal | ||
kuadrant-system |
limitador-limitador-69574b596d-nqg8v |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-69574b596d-nqg8v to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-66c5d965c4bzmcc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-66c5d965c4bzmcc to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheh84nv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheh84nv to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schevdrkk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schevdrkk to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-c84499f99-5n7j7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-c84499f99-5n7j7 to ip-10-0-140-38.ec2.internal | ||
kuadrant-system |
dns-operator-controller-manager-65b49595d7-l2xrg |
Scheduled |
Successfully assigned kuadrant-system/dns-operator-controller-manager-65b49595d7-l2xrg to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f498rf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f498rf to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-88958b44c-s95rh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-88958b44c-s95rh to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d46hcd5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d46hcd5 to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dkwbck |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dkwbck to ip-10-0-140-38.ec2.internal | ||
openshift-ingress |
router-default-5655df4f5-g8dcn |
Scheduled |
Successfully assigned openshift-ingress/router-default-5655df4f5-g8dcn to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-54c47cdfc7-4sr52 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-4sr52 to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-router-scheduler-569482q2nc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-569482q2nc to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-54c47cdfc7-zpwwt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-zpwwt to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-799f46c59b-g9fx9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-g9fx9 to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-799f46c59b-pf9xz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-799f46c59b-pf9xz to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-2-openshift-default-54c789bdc6-fj8fg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-54c789bdc6-fj8fg to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
auth-disabled-test-kserve-7d4d7b596d-74pqp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-disabled-test-kserve-7d4d7b596d-74pqp to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-2-openshift-default-684dc9b4b9-nrf44 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-nrf44 to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-5f4558569-7l4qq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-5f4558569-7l4qq to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 to ip-10-0-131-165.ec2.internal | ||
openshift-ingress |
openshift-ai-inference-openshift-default-769cdd8d88-hxzrg |
Scheduled |
Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-769cdd8d88-hxzrg to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-prefill-64cf49759b-8g76f |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-64cf49759b-8g76f to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-router-scheduler-555b5c7c6jmtxm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-555b5c7c6jmtxm to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-94z7vmv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-94z7vmv to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-test-kserve-router-scheduler-65d75b5c87-vkrdg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-65d75b5c87-vkrdg to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
auth-invalid-token-test-kserve-75cc88cd9d-vn9hw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/auth-invalid-token-test-kserve-75cc88cd9d-vn9hw to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-configmap-ref-test-kserve-744bf59fbd-6cg2w |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-6cg2w to ip-10-0-134-202.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-prefill-7977c54448-fjjgc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-7977c54448-fjjgc to ip-10-0-140-38.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879bc2cc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879bc2cc to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb456jdn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb456jdn to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-vv8n8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-vv8n8 to ip-10-0-131-165.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddzzwd6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddzzwd6 to ip-10-0-134-202.ec2.internal | ||
openshift-ingress |
deployment-controller |
router-default |
ScalingReplicaSet |
Scaled up replica set router-default-5655df4f5 from 0 to 1 | |
| (x11) | openshift-ingress |
replicaset-controller |
router-default-5655df4f5 |
FailedCreate |
Error creating: pods "router-default-5655df4f5-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
openshift-ingress |
service-controller |
router-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
service-controller |
router-default |
UnAvailableLoadBalancer |
There are no available nodes for LoadBalancer | |
openshift-ingress |
service-controller |
router-default |
EnsuredLoadBalancer |
Ensured load balancer | |
| (x16) | openshift-ingress |
replicaset-controller |
router-default-5655df4f5 |
FailedCreate |
Error creating: pods "router-default-5655df4f5-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
| (x3) | openshift-ingress |
service-controller |
router-default |
UpdatedLoadBalancer |
Updated load balancer with new hosts |
openshift-ingress |
replicaset-controller |
router-default-5655df4f5 |
SuccessfulCreate |
Created pod: router-default-5655df4f5-g8dcn | |
| (x5) | openshift-ingress |
kubelet |
router-default-5655df4f5-g8dcn |
FailedMount |
MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt |
| (x5) | openshift-ingress |
kubelet |
router-default-5655df4f5-g8dcn |
FailedMount |
MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found |
openshift-ingress |
multus |
router-default-5655df4f5-g8dcn |
AddedInterface |
Add eth0 [10.132.0.9/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
router-default-5655df4f5-g8dcn |
Started |
Started container router | |
openshift-ingress |
kubelet |
router-default-5655df4f5-g8dcn |
Created |
Created container: router | |
openshift-ingress |
kubelet |
router-default-5655df4f5-g8dcn |
Pulled |
Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d6df0cb6282bc5ba571a8de322fe598afdf22e817f5a7dc92db3274dbdb9a1" already present on machine | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-94bb8fbfd from 0 to 1 | |
openshift-ingress |
multus |
istiod-openshift-gateway-94bb8fbfd-x2st2 |
AddedInterface |
Add eth0 [10.132.0.30/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-x2st2 |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-94bb8fbfd |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-94bb8fbfd-x2st2 | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-x2st2 |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" in 2.512s (2.512s including waiting). Image size: 181034515 bytes. | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-x2st2 |
Created |
Created container: discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-x2st2 |
Started |
Started container discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-x2st2 |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-94bb8fbfd-x2st2 |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
gateway_labeler_controller |
openshift-ai-inference |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway openshift-ai-inference | |
openshift-ingress |
replicaset-controller |
openshift-ai-inference-openshift-default-769cdd8d88 |
SuccessfulCreate |
Created pod: openshift-ai-inference-openshift-default-769cdd8d88-hxzrg | |
openshift-ingress |
deployment-controller |
openshift-ai-inference-openshift-default |
ScalingReplicaSet |
Scaled up replica set openshift-ai-inference-openshift-default-769cdd8d88 from 0 to 1 | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
multus |
openshift-ai-inference-openshift-default-769cdd8d88-hxzrg |
AddedInterface |
Add eth0 [10.134.0.21/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-769cdd8d88-hxzrg |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-769cdd8d88-hxzrg |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 2.646s (2.646s including waiting). Image size: 181251556 bytes. | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-l2xrg |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ba46f54446ecd3ed1a3d877dcbb7359ff8f2d918827f3411a5cb0781915a65d5" | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
multus |
dns-operator-controller-manager-65b49595d7-l2xrg |
AddedInterface |
Add eth0 [10.132.0.35/23] from ovn-kubernetes | |
kuadrant-system |
replicaset-controller |
dns-operator-controller-manager-65b49595d7 |
SuccessfulCreate |
Created pod: dns-operator-controller-manager-65b49595d7-l2xrg | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
InstallWaiting |
installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
deployment-controller |
dns-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set dns-operator-controller-manager-65b49595d7 from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-l2xrg |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ba46f54446ecd3ed1a3d877dcbb7359ff8f2d918827f3411a5cb0781915a65d5" in 1.42s (1.42s including waiting). Image size: 190472853 bytes. | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-l2xrg |
Started |
Started container manager | |
kuadrant-system |
dns-operator-controller-manager-65b49595d7-l2xrg_18a99236-b8d3-4e9b-99e2-13c734dcf01c |
a3f98d6c.kuadrant.io |
LeaderElection |
dns-operator-controller-manager-65b49595d7-l2xrg_18a99236-b8d3-4e9b-99e2-13c734dcf01c became leader | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-65b49595d7-l2xrg |
Created |
Created container: manager | |
kuadrant-system |
deployment-controller |
authorino-operator |
ScalingReplicaSet |
Scaled up replica set authorino-operator-6d85f6564 from 0 to 1 | |
kuadrant-system |
multus |
authorino-operator-6d85f6564-kv2wg |
AddedInterface |
Add eth0 [10.132.0.36/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
InstallWaiting |
installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability. | |
kuadrant-system |
replicaset-controller |
authorino-operator-6d85f6564 |
SuccessfulCreate |
Created pod: authorino-operator-6d85f6564-kv2wg | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-kv2wg |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:b2cc2c0f0729dad98f970830816e300c0b961ba42491f362295512d886384687" | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-kv2wg |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:b2cc2c0f0729dad98f970830816e300c0b961ba42491f362295512d886384687" in 2.399s (2.399s including waiting). Image size: 168639631 bytes. | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-kv2wg |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
authorino-operator-6d85f6564-kv2wg |
Started |
Started container manager | |
kuadrant-system |
authorino-operator-6d85f6564-kv2wg_bd645e48-6c62-40d0-91e9-f3a7f4520a72 |
aac3a15d.authorino.kuadrant.io |
LeaderElection |
authorino-operator-6d85f6564-kv2wg_bd645e48-6c62-40d0-91e9-f3a7f4520a72 became leader | |
kuadrant-system |
deployment-controller |
kuadrant-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set kuadrant-operator-controller-manager-bb7ddb7d7 from 0 to 1 | |
kuadrant-system |
replicaset-controller |
kuadrant-operator-controller-manager-bb7ddb7d7 |
SuccessfulCreate |
Created pod: kuadrant-operator-controller-manager-bb7ddb7d7-h6vpf | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-h6vpf |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:0b77e4a874b620095a0300877aea53e78559a601ce62b194537ed21c2743bbf3" | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
multus |
kuadrant-operator-controller-manager-bb7ddb7d7-h6vpf |
AddedInterface |
Add eth0 [10.132.0.37/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
InstallWaiting |
installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
replicaset-controller |
limitador-operator-controller-manager-6f9f468797 |
SuccessfulCreate |
Created pod: limitador-operator-controller-manager-6f9f468797-w2wzk | |
kuadrant-system |
deployment-controller |
limitador-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set limitador-operator-controller-manager-6f9f468797 from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
InstallWaiting |
installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-w2wzk |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:183bad2a6f5872aea38f54ad507f7e005d6facb02b18769e0407c82799f96a3e" | |
kuadrant-system |
multus |
limitador-operator-controller-manager-6f9f468797-w2wzk |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-w2wzk |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:183bad2a6f5872aea38f54ad507f7e005d6facb02b18769e0407c82799f96a3e" in 1.272s (1.272s including waiting). Image size: 178538972 bytes. | |
kuadrant-system |
limitador-operator-controller-manager-6f9f468797-w2wzk_bb13101c-06a7-4e68-afa6-6b53e9da0f61 |
3745a16e.kuadrant.io |
LeaderElection |
limitador-operator-controller-manager-6f9f468797-w2wzk_bb13101c-06a7-4e68-afa6-6b53e9da0f61 became leader | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-w2wzk |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-6f9f468797-w2wzk |
Started |
Started container manager | |
kuadrant-system |
kuadrant-operator-controller-manager-bb7ddb7d7-h6vpf_06fc4945-f66e-4836-9198-46c08de3a12f |
f139389e.kuadrant.io |
LeaderElection |
kuadrant-operator-controller-manager-bb7ddb7d7-h6vpf_06fc4945-f66e-4836-9198-46c08de3a12f became leader | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-h6vpf |
Started |
Started container manager | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-h6vpf |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-bb7ddb7d7-h6vpf |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:0b77e4a874b620095a0300877aea53e78559a601ce62b194537ed21c2743bbf3" in 4.008s (4.008s including waiting). Image size: 425661757 bytes. | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.0 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
replicaset-controller |
kuadrant-console-plugin-85fd4b8b9d |
SuccessfulCreate |
Created pod: kuadrant-console-plugin-85fd4b8b9d-fq2x9 | |
kuadrant-system |
deployment-controller |
kuadrant-console-plugin |
ScalingReplicaSet |
Scaled up replica set kuadrant-console-plugin-85fd4b8b9d from 0 to 1 | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-fq2x9 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:6e69f41d3d70b0afa7691a5d2400065d3bcdec2ea82830cf2992b8e69ba06e2a" | |
kuadrant-system |
multus |
kuadrant-console-plugin-85fd4b8b9d-fq2x9 |
AddedInterface |
Add eth0 [10.132.0.38/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.1 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-fq2x9 |
Started |
Started container kuadrant-console-plugin | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-fq2x9 |
Created |
Created container: kuadrant-console-plugin | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-85fd4b8b9d-fq2x9 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:6e69f41d3d70b0afa7691a5d2400065d3bcdec2ea82830cf2992b8e69ba06e2a" in 4.858s (4.858s including waiting). Image size: 342502139 bytes. | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.1 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.0 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
replicaset-controller |
limitador-limitador-ff68ff5cb |
SuccessfulCreate |
Created pod: limitador-limitador-ff68ff5cb-gf8sq | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-ff68ff5cb from 0 to 1 | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-69574b596d from 0 to 1 | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-nqg8v |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" | |
kuadrant-system |
multus |
limitador-limitador-ff68ff5cb-gf8sq |
AddedInterface |
Add eth0 [10.132.0.39/23] from ovn-kubernetes | |
kuadrant-system |
replicaset-controller |
authorino-8df697c9f |
SuccessfulCreate |
Created pod: authorino-8df697c9f-shs9j | |
kuadrant-system |
replicaset-controller |
authorino-b6c89bb85 |
SuccessfulCreate |
Created pod: authorino-b6c89bb85-kw7ft | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-b6c89bb85 from 0 to 1 | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-8df697c9f from 0 to 1 | |
kuadrant-system |
multus |
limitador-limitador-69574b596d-nqg8v |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
kuadrant-system |
replicaset-controller |
limitador-limitador-69574b596d |
SuccessfulCreate |
Created pod: limitador-limitador-69574b596d-nqg8v | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-gf8sq |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" | |
kuadrant-system |
multus |
authorino-8df697c9f-shs9j |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-8df697c9f-shs9j |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" | |
kuadrant-system |
multus |
authorino-b6c89bb85-kw7ft |
AddedInterface |
Add eth0 [10.134.0.23/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-kw7ft |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-kw7ft |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-gf8sq |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" in 3.641s (3.641s including waiting). Image size: 250499765 bytes. | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-kw7ft |
Started |
Started container authorino | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-kw7ft |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" in 2.284s (2.284s including waiting). Image size: 202706732 bytes. | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-gf8sq |
Started |
Started container limitador | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-gf8sq |
Created |
Created container: limitador | |
kuadrant-system |
kubelet |
authorino-8df697c9f-shs9j |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-8df697c9f-shs9j |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" in 4.029s (4.029s including waiting). Image size: 202706732 bytes. | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-nqg8v |
Created |
Created container: limitador | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-nqg8v |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" in 4.814s (4.814s including waiting). Image size: 250499765 bytes. | |
kuadrant-system |
kubelet |
authorino-8df697c9f-shs9j |
Started |
Started container authorino | |
kuadrant-system |
kubelet |
limitador-limitador-69574b596d-nqg8v |
Started |
Started container limitador | |
kuadrant-system |
replicaset-controller |
authorino-b6c89bb85 |
SuccessfulDelete |
Deleted pod: authorino-b6c89bb85-kw7ft | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-b6c89bb85 from 1 to 0 | |
kuadrant-system |
kubelet |
authorino-b6c89bb85-kw7ft |
Killing |
Stopping container authorino | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled down replica set limitador-limitador-ff68ff5cb from 1 to 0 | |
kuadrant-system |
replicaset-controller |
limitador-limitador-ff68ff5cb |
SuccessfulDelete |
Deleted pod: limitador-limitador-ff68ff5cb-gf8sq | |
kuadrant-system |
kubelet |
limitador-limitador-ff68ff5cb-gf8sq |
Killing |
Stopping container limitador | |
kuadrant-system |
replicaset-controller |
authorino-7c77957575 |
SuccessfulCreate |
Created pod: authorino-7c77957575-k7wx6 | |
kuadrant-system |
kubelet |
authorino-7c77957575-k7wx6 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" | |
kuadrant-system |
multus |
authorino-7c77957575-k7wx6 |
AddedInterface |
Add eth0 [10.134.0.24/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-7c77957575 from 0 to 1 | |
kuadrant-system |
replicaset-controller |
authorino-8df697c9f |
SuccessfulDelete |
Deleted pod: authorino-8df697c9f-shs9j | |
kuadrant-system |
kubelet |
authorino-8df697c9f-shs9j |
Killing |
Stopping container authorino | |
kuadrant-system |
kubelet |
authorino-7c77957575-k7wx6 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" in 480ms (480ms including waiting). Image size: 202706732 bytes. | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-8df697c9f from 1 to 0 | |
kuadrant-system |
kubelet |
authorino-7c77957575-k7wx6 |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-7c77957575-k7wx6 |
Started |
Started container authorino | |
kserve-ci-e2e-test |
deployment-controller |
precise-prefix-cache-test-kserve |
ScalingReplicaSet |
Scaled up replica set precise-prefix-cache-test-kserve-6c69b69b5d from 0 to 2 | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-6c69b69b5d |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-6c69b69b5d-v4g66 | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-6c69b69b5d |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-6c69b69b5d-kwcd6 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/precise-prefix-cache-test-epp-sa | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-6c69b69b5d-v4g66 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-6c69b69b5d-kwcd6 |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Role kserve-ci-e2e-test/precise-prefix-cache-test-epp-role | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-6c69b69b5d-kwcd6 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/precise-prefix-cache-test-epp-rb | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-6c69b69b5d-v4g66 |
AddedInterface |
Add eth0 [10.132.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr |
AddedInterface |
Add eth0 [10.132.0.45/23] from ovn-kubernetes | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
precise-prefix-cache-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy precise-prefix-cache-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "precise-prefix-cache-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb | |
kserve-ci-e2e-test |
deployment-controller |
precise-prefix-cache-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set precise-prefix-cache-test-kserve-router-scheduler-66d4c98884 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-router-scheduler-66d4c98884 |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-6c69b69b5d-v4g66 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-6c69b69b5d-v4g66 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1" | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" in 1.389s (1.389s including waiting). Image size: 75073927 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-6c69b69b5d-kwcd6 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-6c69b69b5d-kwcd6 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-6c69b69b5d-kwcd6 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" in 3.865s (3.865s including waiting). Image size: 300565430 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-6c69b69b5d-v4g66 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-enabled-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Role kserve-ci-e2e-test/auth-enabled-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Secret kserve-ci-e2e-test/auth-enabled-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-enabled-test-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
auth-enabled-test-kserve-7bfb886698 |
SuccessfulCreate |
Created pod: auth-enabled-test-kserve-7bfb886698-zqrv5 | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-6c69b69b5d-v4g66 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.654s (1.654s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-6c69b69b5d-v4g66 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-6c69b69b5d-v4g66 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-enabled-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/auth-enabled-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-enabled-test-epp-auth-rb | |
kserve-ci-e2e-test |
deployment-controller |
auth-enabled-test-kserve |
ScalingReplicaSet |
Scaled up replica set auth-enabled-test-kserve-7bfb886698 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
auth-enabled-test-kserve-router-scheduler-6956d85f9b |
SuccessfulCreate |
Created pod: auth-enabled-test-kserve-router-scheduler-6956d85f9b-zqlh2 | |
kserve-ci-e2e-test |
deployment-controller |
auth-enabled-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set auth-enabled-test-kserve-router-scheduler-6956d85f9b from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/auth-enabled-test-epp-rb | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6956d85f9b-zqlh2 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6956d85f9b-zqlh2 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6956d85f9b-zqlh2 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
multus |
auth-enabled-test-kserve-router-scheduler-6956d85f9b-zqlh2 |
AddedInterface |
Add eth0 [10.133.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7bfb886698-zqrv5 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" | |
kserve-ci-e2e-test |
multus |
auth-enabled-test-kserve-7bfb886698-zqrv5 |
AddedInterface |
Add eth0 [10.134.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6956d85f9b-zqlh2 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-6c69b69b5d-kwcd6 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7bfb886698-zqrv5 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7bfb886698-zqrv5 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6956d85f9b-zqlh2 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6956d85f9b-zqlh2 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" in 2.468s (2.468s including waiting). Image size: 75073927 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-6c69b69b5d-kwcd6 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 2.473s (2.473s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-6c69b69b5d-kwcd6 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6956d85f9b-zqlh2 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-6c69b69b5d-kwcd6 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7bfb886698-zqrv5 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" in 3.311s (3.311s including waiting). Image size: 300565430 bytes. | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7bfb886698-zqrv5 |
Pulling |
Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/precise-prefix-cache-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/auth-enabled-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-enabled-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/auth-enabled-test-kserve-route | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1" in 30.4s (30.4s including waiting). Image size: 2989890188 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr |
Started |
Started container tokenizer | |
| (x2) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr |
Created |
Created container: main |
| (x2) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr |
Started |
Started container main |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr |
Unhealthy |
Startup probe failed: Get "http://10.132.0.45:8082/healthz": dial tcp 10.132.0.45:8082: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7bfb886698-zqrv5 |
Pulled |
Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" in 28.192s (28.192s including waiting). Image size: 3531177328 bytes. | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7bfb886698-zqrv5 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7bfb886698-zqrv5 |
Started |
Started container main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr |
Unhealthy |
Liveness probe failed: timeout: failed to connect service "10.132.0.45:9003" within 1s: context deadline exceeded |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
LLMInferenceServiceReady |
LLMInferenceService [precise-prefix-cache-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-6c69b69b5d-kwcd6 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-66d4c9884dlzr |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-6c69b69b5d-v4g66 |
Killing |
Stopping container main | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-router-managed-test-llm-e45d1f79 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-e45d1f79-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-e45d1f79-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879bc2cc |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testef4d2875be14b30dc1561ed84d0d4bde-llmisvc-rout | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-service | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879 |
SuccessfulCreate |
Created pod: llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879bc2cc | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879bc2cc |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879bc2cc |
AddedInterface |
Add eth0 [10.132.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler-5dd88bfbb7 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler-5dd88bfbb7 |
SuccessfulCreate |
Created pod: llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schez4nq5 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-router-managed-test-llm-e45d1f79-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879bc2cc |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-role | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schez4nq5 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schez4nq5 |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schez4nq5 |
AddedInterface |
Add eth0 [10.132.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schez4nq5 |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-router-managed-test-llm-e45d1f79] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-e45d1f79 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testef4d2875be14b30dc1561ed84d0d4bde-llmisvc-rout | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879bc2cc |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schez4nq5 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-schez4nq5 |
FailedPreStopHook |
PreStopHook failed | |
| (x11) | kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7bfb886698-zqrv5 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.25:8000/health": dial tcp 10.134.0.25:8000: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879bc2cc |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.46:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
LLMInferenceServiceReady |
LLMInferenceService [auth-enabled-test] is Ready | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-router-managed-test-llm-5b1e8f15 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-5b1e8f15-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-5b1e8f15-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb456jdn |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test7f54e84970003a6e7372bdbcb574f7ed-llmisvc-rout | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4 |
SuccessfulCreate |
Created pod: llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb456jdn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-service | |
kserve-ci-e2e-test |
multus |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb456jdn |
AddedInterface |
Add eth0 [10.132.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb456jdn |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler-749449dbc8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb456jdn |
Started |
Started container main | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler-749449dbc8 |
SuccessfulCreate |
Created pod: llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheffxrb | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-router-managed-test-llm-5b1e8f15-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheffxrb |
AddedInterface |
Add eth0 [10.132.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheffxrb |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheffxrb |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheffxrb |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-enabled-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-enabled-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7bfb886698-zqrv5 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6956d85f9b-zqlh2 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-router-scheduler-6956d85f9b-zqlh2 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
auth-enabled-test-kserve-7bfb886698-zqrv5 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.25:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-invalid-token-test-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
auth-invalid-token-test-kserve-75cc88cd9d |
SuccessfulCreate |
Created pod: auth-invalid-token-test-kserve-75cc88cd9d-vn9hw | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Secret kserve-ci-e2e-test/auth-invalid-token-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
auth-invalid-token-test-kserve |
ScalingReplicaSet |
Scaled up replica set auth-invalid-token-test-kserve-75cc88cd9d from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/auth-invalid-token-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-invalid-token-test-kserve | |
kserve-ci-e2e-test |
multus |
auth-invalid-token-test-kserve-router-scheduler-6c5f8f864brq9nx |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-6c5f8f864brq9nx |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/auth-invalid-token-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-invalid-token-test-epp-service | |
kserve-ci-e2e-test |
replicaset-controller |
auth-invalid-token-test-kserve-router-scheduler-6c5f8f864b |
SuccessfulCreate |
Created pod: auth-invalid-token-test-kserve-router-scheduler-6c5f8f864brq9nx | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-75cc88cd9d-vn9hw |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-6c5f8f864brq9nx |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-invalid-token-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-6c5f8f864brq9nx |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.Role kserve-ci-e2e-test/auth-invalid-token-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-invalid-token-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-75cc88cd9d-vn9hw |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
auth-invalid-token-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set auth-invalid-token-test-kserve-router-scheduler-6c5f8f864b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-75cc88cd9d-vn9hw |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
multus |
auth-invalid-token-test-kserve-75cc88cd9d-vn9hw |
AddedInterface |
Add eth0 [10.134.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-6c5f8f864brq9nx |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-6c5f8f864brq9nx |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-6c5f8f864brq9nx |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-75cc88cd9d-vn9hw |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-75cc88cd9d-vn9hw |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-75cc88cd9d-vn9hw |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/auth-invalid-token-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-invalid-token-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/auth-invalid-token-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-router-managed-test-llm-5b1e8f15] is Ready | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddzzwd6 |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddzzwd6 |
AddedInterface |
Add eth0 [10.133.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testb7025ca4d8a6f8f5b2fd08b5581d2678-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler-6d86bd4d9d |
SuccessfulCreate |
Created pod: llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevpfk4 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler-6d86bd4d9d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd |
SuccessfulCreate |
Created pod: llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddzzwd6 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddzzwd6 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddzzwd6 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevpfk4 |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevpfk4 |
AddedInterface |
Add eth0 [10.132.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevpfk4 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevpfk4 |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-a50492e9] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58ddzzwd6 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-a50492e9 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testb7025ca4d8a6f8f5b2fd08b5581d2678-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevpfk4 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-schevpfk4 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheffxrb |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheffxrb |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb456jdn |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-5b1e8f15 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test7f54e84970003a6e7372bdbcb574f7ed-llmisvc-rout | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-router-managed-test-llm-4b931143 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-4b931143-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-4b931143-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-router-managed-test-llm-4b931143-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-service | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56 |
SuccessfulCreate |
Created pod: llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-vv8n8 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test8ac8e3d2264ccb939eb021b0b835847c-llmisvc-rout | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-role | |
kserve-ci-e2e-test |
deployment-controller |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler-68cc9685d6 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler-68cc9685d6 |
SuccessfulCreate |
Created pod: llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schebs46r | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schebs46r |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schebs46r |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schebs46r |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schebs46r |
AddedInterface |
Add eth0 [10.132.0.52/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-vv8n8 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-vv8n8 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-vv8n8 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-vv8n8 |
AddedInterface |
Add eth0 [10.132.0.51/23] from ovn-kubernetes | |
| (x11) | kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-75cc88cd9d-vn9hw |
Unhealthy |
Startup probe failed: Get "https://10.134.0.26:8000/health": dial tcp 10.134.0.26:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
LLMInferenceServiceReady |
LLMInferenceService [auth-invalid-token-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-6c5f8f864brq9nx |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-invalid-token-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-invalid-token-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-75cc88cd9d-vn9hw |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-router-scheduler-6c5f8f864brq9nx |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
auth-invalid-token-test-kserve-75cc88cd9d-vn9hw |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.26:8000/health": dial tcp 10.134.0.26:8000: connect: connection refused | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-router-managed-test-llm-4b931143] is Ready | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-rb | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler-6fcb489785 |
SuccessfulCreate |
Created pod: llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schevdrkk | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f |
SuccessfulCreate |
Created pod: llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f498rf | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-service | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test76d7f532acb694e4a7bcef75d32cd8a1-llmisvc-mode | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler-6fcb489785 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f498rf |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f498rf |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schevdrkk |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" | |
kserve-ci-e2e-test |
multus |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schevdrkk |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f498rf |
AddedInterface |
Add eth0 [10.133.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f498rf |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schevdrkk |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schevdrkk |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schevdrkk |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" in 1.558s (1.558s including waiting). Image size: 75073927 bytes. | |
| (x14) | kserve-ci-e2e-test |
OpenDataHubModelController |
auth-disabled-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy auth-disabled-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/auth-disabled-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "auth-disabled-test-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
auth-disabled-test-kserve |
ScalingReplicaSet |
Scaled up replica set auth-disabled-test-kserve-7d4d7b596d from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-disabled-test-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
auth-disabled-test-kserve-7d4d7b596d |
SuccessfulCreate |
Created pod: auth-disabled-test-kserve-7d4d7b596d-74pqp | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/auth-disabled-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Secret kserve-ci-e2e-test/auth-disabled-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-disabled-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-disabled-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/auth-disabled-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Role kserve-ci-e2e-test/auth-disabled-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/auth-disabled-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-69fc65b9c7-zrdff |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
multus |
auth-disabled-test-kserve-router-scheduler-69fc65b9c7-zrdff |
AddedInterface |
Add eth0 [10.133.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
Created v1.Service kserve-ci-e2e-test/auth-disabled-test-epp-service | |
kserve-ci-e2e-test |
multus |
auth-disabled-test-kserve-7d4d7b596d-74pqp |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
auth-disabled-test-kserve-router-scheduler-69fc65b9c7 |
SuccessfulCreate |
Created pod: auth-disabled-test-kserve-router-scheduler-69fc65b9c7-zrdff | |
kserve-ci-e2e-test |
deployment-controller |
auth-disabled-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set auth-disabled-test-kserve-router-scheduler-69fc65b9c7 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-69fc65b9c7-zrdff |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-7d4d7b596d-74pqp |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-69fc65b9c7-zrdff |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-7d4d7b596d-74pqp |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-7d4d7b596d-74pqp |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-69fc65b9c7-zrdff |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-69fc65b9c7-zrdff |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-69fc65b9c7-zrdff |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-7d4d7b596d-74pqp |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-7d4d7b596d-74pqp |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-7d4d7b596d-74pqp |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-4f8c0978] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/auth-disabled-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/auth-disabled-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-disabled-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schevdrkk |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f498rf |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schevdrkk |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4f8c0978 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test76d7f532acb694e4a7bcef75d32cd8a1-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-vv8n8 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schebs46r |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schebs46r |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-router-managed-test-llm-4b931143 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test8ac8e3d2264ccb939eb021b0b835847c-llmisvc-rout | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test5216bfd716f919dc046bc693ceb22e41-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-7ca60146-kserve-88958b44c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-88958b44c |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-7ca60146-kserve-88958b44c-s95rh | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-88958b44c-s95rh |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-service | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-88958b44c-s95rh |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-rb | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-88958b44c-s95rh |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-88958b44c-s95rh |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-role | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler-8b5cfdcfd |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schev6vd7 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler-8b5cfdcfd from 0 to 1 | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schev6vd7 |
AddedInterface |
Add eth0 [10.132.0.53/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schev6vd7 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schev6vd7 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schev6vd7 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schev6vd7 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schev6vd7 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schev6vd7 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-88958b44c-s95rh |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-88958b44c-s95rh |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-88958b44c-s95rh |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-shadow-svc |
| (x12) | kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-7d4d7b596d-74pqp |
Unhealthy |
Startup probe failed: Get "https://10.134.0.28:8000/health": dial tcp 10.134.0.28:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
LLMInferenceServiceReady |
LLMInferenceService [auth-disabled-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
auth-disabled-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-disabled-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-69fc65b9c7-zrdff |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-router-scheduler-69fc65b9c7-zrdff |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
auth-disabled-test-kserve-7d4d7b596d-74pqp |
Killing |
Stopping container main | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-769cdd8d88-hxzrg |
BackOff |
Back-off restarting failed container istio-proxy in pod openshift-ai-inference-openshift-default-769cdd8d88-hxzrg_openshift-ingress(07976c37-1aab-44af-ab95-9824a1a523b4) | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-799f46c59b-pf9xz | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-54c47cdfc7-4sr52 | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-799f46c59b-pf9xz |
AddedInterface |
Add eth0 [10.133.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-54c47cdfc7-4sr52 |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-pf9xz |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-799f46c59b-pf9xz | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
| (x2) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-769cdd8d88-hxzrg |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route" not found |
| (x3) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-769cdd8d88-hxzrg |
Created |
Created container: istio-proxy |
| (x3) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-769cdd8d88-hxzrg |
Started |
Started container istio-proxy |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d46hcd5 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d46hcd5 |
AddedInterface |
Add eth0 [10.133.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d46hcd5 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d46hcd5 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d46hcd5 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-pf9xz |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-pf9xz |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 7.003s (7.003s including waiting). Image size: 181251556 bytes. | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-pf9xz |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-pf9xz |
Started |
Started container istio-proxy | |
| (x11) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-769cdd8d88-hxzrg |
Unhealthy |
Startup probe failed: Get "http://10.134.0.21:15021/healthz/ready": dial tcp 10.134.0.21:15021: connect: connection refused |
| (x11) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-769cdd8d88-hxzrg |
ProbeError |
Startup probe error: Get "http://10.134.0.21:15021/healthz/ready": dial tcp 10.134.0.21:15021: connect: connection refused body: |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-769cdd8d88-hxzrg |
Unhealthy |
Startup probe failed: Get "http://10.134.0.21:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-769cdd8d88-hxzrg |
ProbeError |
Startup probe error: Get "http://10.134.0.21:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body: | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-4sr52 |
Started |
Started container istio-proxy |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-4sr52 |
Created |
Created container: istio-proxy |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-4sr52 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine |
| (x8) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-88958b44c-s95rh |
Unhealthy |
Startup probe failed: Get "https://10.134.0.29:8000/health": dial tcp 10.134.0.29:8000: connect: connection refused |
| (x5) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-4sr52 |
Unhealthy |
Startup probe failed: Get "http://10.134.0.30:15021/healthz/ready": dial tcp 10.134.0.30:15021: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-e95b1dc1 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-e95b1dc1] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-with-7ca60146] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-7ca60146 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test5216bfd716f919dc046bc693ceb22e41-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schev6vd7 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-88958b44c-s95rh |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schev6vd7 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test05addb65ba05195619f26ef266e8fc04-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6c8c6d4bd8-v7x5l |
Created |
Created container: storage-initializer | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-sa | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6c8c6d4bd8-v7x5l |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6c8c6d4bd8 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6c8c6d4bd8-v7x5l | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6c8c6d4bd8-v7x5l |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-service | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler-86759687c5 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesstzr | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler-86759687c5 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6c8c6d4bd8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6c8c6d4bd8-v7x5l |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesstzr |
AddedInterface |
Add eth0 [10.132.0.54/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesstzr |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesstzr |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesstzr |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesstzr |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesstzr |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesstzr |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6c8c6d4bd8-v7x5l |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6c8c6d4bd8-v7x5l |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6c8c6d4bd8-v7x5l |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d46hcd5 |
Killing |
Stopping container main | |
| (x8) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6c8c6d4bd8-v7x5l |
Unhealthy |
Startup probe failed: Get "https://10.134.0.31:8000/health": dial tcp 10.134.0.31:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test05addb65ba05195619f26ef266e8fc04-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-with-ba4d693a |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-with-ba4d693a] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d46hcd5 |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.38:8000/health": context deadline exceeded | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesstzr |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schesstzr |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6c8c6d4bd8-v7x5l |
Killing |
Stopping container main | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-87882a8e |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-6c8c6d4bd8-v7x5l |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.31:8000/health": dial tcp 10.134.0.31:8000: connect: connection refused | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-role | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-87882a8e-kserve-66c5d965c4 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-66c5d965c4 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-87882a8e-kserve-66c5d965c4bzmcc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test21fe6730fe484f3a92b1a16afe1bac8f-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-66c5d965c4bzmcc |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-service | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-66c5d965c4bzmcc |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-rb | |
kserve-ci-e2e-test |
deployment-controller |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler-f499d968 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler-f499d968 |
SuccessfulCreate |
Created pod: llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schect2dz | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schect2dz |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schect2dz |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schect2dz |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schect2dz |
AddedInterface |
Add eth0 [10.132.0.55/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-66c5d965c4bzmcc |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-66c5d965c4bzmcc |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
persistentvolume-controller |
e2e-pvc-model-storage |
WaitForFirstConsumer |
waiting for first consumer to be created before binding | |
kserve-ci-e2e-test |
job-controller |
e2e-pvc-model-download |
SuccessfulCreate |
Created pod: e2e-pvc-model-download-z62nj | |
kserve-ci-e2e-test |
ebs.csi.aws.com_aws-ebs-csi-driver-controller-867ffb9bb6-zkzc9_f783985d-736e-48aa-898e-8e1f7a5d0a81 |
e2e-pvc-model-storage |
Provisioning |
External provisioner is provisioning volume for claim "kserve-ci-e2e-test/e2e-pvc-model-storage" | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schect2dz |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schect2dz |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schect2dz |
Created |
Created container: main | |
| (x2) | kserve-ci-e2e-test |
persistentvolume-controller |
e2e-pvc-model-storage |
ExternalProvisioning |
Waiting for a volume to be created either by the external provisioner 'ebs.csi.aws.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered. |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs | |
kserve-ci-e2e-test |
ebs.csi.aws.com_aws-ebs-csi-driver-controller-867ffb9bb6-zkzc9_f783985d-736e-48aa-898e-8e1f7a5d0a81 |
e2e-pvc-model-storage |
ProvisioningSucceeded |
Successfully provisioned volume pvc-ec156ffb-b0e1-4a3b-ac5e-9d7ba35e3704 | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-66c5d965c4bzmcc |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-66c5d965c4bzmcc |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-66c5d965c4bzmcc |
Started |
Started container main | |
kserve-ci-e2e-test |
attachdetach-controller |
e2e-pvc-model-download-z62nj |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-ec156ffb-b0e1-4a3b-ac5e-9d7ba35e3704" | |
kserve-ci-e2e-test |
multus |
e2e-pvc-model-download-z62nj |
AddedInterface |
Add eth0 [10.133.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
e2e-pvc-model-download-z62nj |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
e2e-pvc-model-download-z62nj |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
kubelet |
e2e-pvc-model-download-z62nj |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
job-controller |
e2e-pvc-model-download |
Completed |
Job completed | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-pvc-router-manage-59b9d263 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-59b9d263-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-59b9d263-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testc9569cf4801efc0ed27b2f25ffaee875-llmisvc-mode | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler-5f555d4d85 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d |
SuccessfulCreate |
Created pod: llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dkwbck | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv8bf079eb6eda4debfb4ef5bb7817824c-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-role | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-pvc-router-manage-59b9d263-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-service | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler-5f555d4d85 |
SuccessfulCreate |
Created pod: llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche5rn6q | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-rb | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche5rn6q |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche5rn6q |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche5rn6q |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche5rn6q |
AddedInterface |
Add eth0 [10.133.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dkwbck |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-ec156ffb-b0e1-4a3b-ac5e-9d7ba35e3704" | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche5rn6q |
FailedAttachVolume |
Multi-Attach error for volume "pvc-ec156ffb-b0e1-4a3b-ac5e-9d7ba35e3704" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dkwbck | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dkwbck |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dkwbck |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dkwbck |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dkwbck |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-shadow-svc |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv8bf079eb6eda4debfb4ef5bb7817824c-kserve-self-signed-certs |
| (x13) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-66c5d965c4bzmcc |
Unhealthy |
Startup probe failed: Get "https://10.134.0.32:8000/health": dial tcp 10.134.0.32:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-87882a8e] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-87882a8e |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test21fe6730fe484f3a92b1a16afe1bac8f-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-66c5d965c4bzmcc |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schect2dz |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schect2dz |
Killing |
Stopping container main | |
| (x13) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dkwbck |
Unhealthy |
Startup probe failed: Get "https://10.134.0.33:8000/health": dial tcp 10.134.0.33:8000: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-87882a8e-kserve-66c5d965c4bzmcc |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.32:8000/health": context deadline exceeded | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
custom-route-timeout-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-test-kserve |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-test-kserve-5f665ff7fb from 0 to 1 | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-test-kserve-5f665ff7fb-2ltj8 |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-test-epp-sa | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-test-kserve-router-scheduler-5f76b9b8j8dlr |
AddedInterface |
Add eth0 [10.132.0.56/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Role kserve-ci-e2e-test/custom-route-timeout-test-epp-role | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-test-kserve-router-scheduler-5f76b9b8bc from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-5f76b9b8j8dlr |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-test-epp-rb | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-5f665ff7fb-2ltj8 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-epp-service | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-test-kserve-router-scheduler-5f76b9b8bc |
SuccessfulCreate |
Created pod: custom-route-timeout-test-kserve-router-scheduler-5f76b9b8j8dlr | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-5f665ff7fb-2ltj8 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-5f76b9b8j8dlr |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-5f76b9b8j8dlr |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-test-kserve-5f665ff7fb |
SuccessfulCreate |
Created pod: custom-route-timeout-test-kserve-5f665ff7fb-2ltj8 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-5f665ff7fb-2ltj8 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-5f76b9b8j8dlr |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-5f76b9b8j8dlr |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-5f76b9b8j8dlr |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-pvc-router-manage-59b9d263] is Ready | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-5f665ff7fb-2ltj8 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-5f665ff7fb-2ltj8 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-5f665ff7fb-2ltj8 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-59b9d263 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testc9569cf4801efc0ed27b2f25ffaee875-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche5rn6q |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-sche5rn6q |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dkwbck |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9dkwbck |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.33:8000/health": dial tcp 10.134.0.33:8000: connect: connection refused | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-pvc-router-manage-e8706282 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-e8706282-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-e8706282-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testf5d060a5eb39a04e074b78907a1556a6-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c |
SuccessfulCreate |
Created pod: llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-wwzw9 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79497db4cc |
SuccessfulCreate |
Created pod: llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79m2299 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-role | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79497db4cc from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvb19f98874e050eec8ca94d49676113f0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche72cwk |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche72cwk |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler-67b4bb9646 |
SuccessfulCreate |
Created pod: llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche72cwk | |
kserve-ci-e2e-test |
deployment-controller |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler-67b4bb9646 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche72cwk |
Created |
Created container: main | |
kserve-ci-e2e-test |
multus |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche72cwk |
AddedInterface |
Add eth0 [10.133.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche72cwk |
FailedAttachVolume |
Multi-Attach error for volume "pvc-ec156ffb-b0e1-4a3b-ac5e-9d7ba35e3704" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-wwzw9, llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79m2299 | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79m2299 |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-ec156ffb-b0e1-4a3b-ac5e-9d7ba35e3704" | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-wwzw9 |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-ec156ffb-b0e1-4a3b-ac5e-9d7ba35e3704" | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-wwzw9 |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79m2299 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79m2299 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79m2299 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-wwzw9 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-wwzw9 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" in 810ms (810ms including waiting). Image size: 44914394 bytes. | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-wwzw9 |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-wwzw9 |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
multus |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79m2299 |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-wwzw9 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-wwzw9 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-wwzw9 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-route | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-shadow-svc |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvb19f98874e050eec8ca94d49676113f0-kserve-self-signed-certs |
| (x12) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-5f665ff7fb-2ltj8 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.34:8000/health": dial tcp 10.134.0.34:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
LLMInferenceServiceReady |
LLMInferenceService [custom-route-timeout-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-5f665ff7fb-2ltj8 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-5f76b9b8j8dlr |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-5f76b9b8j8dlr |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-5f665ff7fb-2ltj8 |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.34:8000/health": dial tcp 10.134.0.34:8000: connect: connection refused | |
| (x2) | kserve-ci-e2e-test |
gateway_labeler_controller |
router-gateway-1 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway router-gateway-1 |
| (x2) | kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-1-openshift-default-799f46c59b from 0 to 1 |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-799f46c59b-g9fx9 |
AddedInterface |
Add eth0 [10.133.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-g9fx9 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-g9fx9 |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-g9fx9 |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-799f46c59b-g9fx9 | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-54c47cdfc7-4sr52 | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-zpwwt |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-zpwwt |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-zpwwt |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-54c47cdfc7 |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-54c47cdfc7-zpwwt | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-54c47cdfc7-zpwwt |
AddedInterface |
Add eth0 [10.133.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled down replica set router-gateway-1-openshift-default-54c47cdfc7 from 1 to 0 | |
| (x2) | kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-1-openshift-default-54c47cdfc7 from 0 to 1 |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-4sr52 |
Killing |
Stopping container istio-proxy | |
| (x6) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-54c47cdfc7-zpwwt |
Unhealthy |
Startup probe failed: Get "http://10.133.0.43:15021/healthz/ready": dial tcp 10.133.0.43:15021: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-799f46c59b-g9fx9 |
Killing |
Stopping container istio-proxy | |
| (x2) | kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled down replica set router-gateway-1-openshift-default-799f46c59b from 1 to 0 |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-799f46c59b |
SuccessfulDelete |
Deleted pod: router-gateway-1-openshift-default-799f46c59b-g9fx9 | |
kserve-ci-e2e-test |
multus |
router-with-refs-test-kserve-69686d4fbd-mlmqd |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-test-kserve-router-scheduler-65d75b5c87 |
SuccessfulCreate |
Created pod: router-with-refs-test-kserve-router-scheduler-65d75b5c87-vkrdg | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Role kserve-ci-e2e-test/router-with-refs-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-test-kserve |
ScalingReplicaSet |
Scaled up replica set router-with-refs-test-kserve-69686d4fbd from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set router-with-refs-test-kserve-router-scheduler-65d75b5c87 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-69686d4fbd-mlmqd |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-69686d4fbd-mlmqd |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-69686d4fbd-mlmqd |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-test-kserve-69686d4fbd |
SuccessfulCreate |
Created pod: router-with-refs-test-kserve-69686d4fbd-mlmqd | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-65d75b5c87-vkrdg |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-65d75b5c87-vkrdg |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-65d75b5c87-vkrdg |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
multus |
router-with-refs-test-kserve-router-scheduler-65d75b5c87-vkrdg |
AddedInterface |
Add eth0 [10.132.0.57/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-65d75b5c87-vkrdg |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-65d75b5c87-vkrdg |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-65d75b5c87-vkrdg |
Started |
Started container main | |
| (x5) | kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-69686d4fbd-mlmqd |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-69686d4fbd-mlmqd |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-69686d4fbd-mlmqd |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs | |
| (x16) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-wwzw9 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.35:8001/health": dial tcp 10.134.0.35:8001: connect: connection refused |
| (x16) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79m2299 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.36:8000/health": dial tcp 10.134.0.36:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-pvc-router-manage-e8706282] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-wwzw9 |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche72cwk |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-sche72cwk |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-wwzw9 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-e8706282 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testf5d060a5eb39a04e074b78907a1556a6-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79m2299 |
Killing |
Stopping container main | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-pvc-router-manage-2577e794 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-2577e794-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-2577e794-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-role | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
SuccessfulCreate |
create Pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 in StatefulSet llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 successful | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test37591b20e96e9663d45a730d03070f1e-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-scc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-workload-svc | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
GroupsProgressing |
Created worker statefulset for leader pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
SuccessfulCreate |
create Pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 in StatefulSet llmisvc-model-pvc-router-manage-2577e794-kserve-mn successful | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
CreatingRevision |
Creating revision with key 686d468674 for a newly created LeaderWorkerSet | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler-7dbcb75dbc |
SuccessfulCreate |
Created pod: llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheh84nv | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler-7dbcb75dbc from 0 to 1 | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
GroupsProgressing |
Created leader statefulset llmisvc-model-pvc-router-manage-2577e794-kserve-mn | |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn |
GroupsProgressing |
Replicas are progressing, with 0 groups ready of total 1 groups |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheh84nv |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheh84nv |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheh84nv |
AddedInterface |
Add eth0 [10.133.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheh84nv |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheh84nv |
SuccessfulAttachVolume |
AttachVolume.Attach succeeded for volume "pvc-ec156ffb-b0e1-4a3b-ac5e-9d7ba35e3704" | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 |
FailedAttachVolume |
Multi-Attach error for volume "pvc-ec156ffb-b0e1-4a3b-ac5e-9d7ba35e3704" Volume is already used by pod(s) llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheh84nv | |
kserve-ci-e2e-test |
attachdetach-controller |
llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 |
FailedAttachVolume |
Multi-Attach error for volume "pvc-ec156ffb-b0e1-4a3b-ac5e-9d7ba35e3704" Volume is already used by pod(s) llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheh84nv | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-route | |
| (x8) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-shadow-svc |
| (x12) | kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-69686d4fbd-mlmqd |
Unhealthy |
Startup probe failed: Get "https://10.134.0.37:8000/health": dial tcp 10.134.0.37:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
LLMInferenceServiceReady |
LLMInferenceService [router-with-refs-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-69686d4fbd-mlmqd |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-65d75b5c87-vkrdg |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-65d75b5c87-vkrdg |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-69686d4fbd-mlmqd |
Unhealthy |
Readiness probe failed: Get "https://10.134.0.37:8000/health": dial tcp 10.134.0.37:8000: connect: connection refused | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-50bc673d |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5855cf58bb from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler-568d8b9fb from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-944df5c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-944df5c |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-94z7vmv | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test00d7278d8a22c4e39146a6b0eb840f45-llmisvc-mode | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5855cf58bb |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5855cf58bb5ggkx | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler-568d8b9fb |
SuccessfulCreate |
Created pod: llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scherhk8p | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5855cf58bb5ggkx |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5855cf58bb5ggkx |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5855cf58bb5ggkx |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5855cf58bb5ggkx |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5855cf58bb5ggkx |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-94z7vmv |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-94z7vmv |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-94z7vmv |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5855cf58bb5ggkx |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-94z7vmv |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scherhk8p |
AddedInterface |
Add eth0 [10.132.0.58/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scherhk8p |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5855cf58bb5ggkx |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scherhk8p |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scherhk8p |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scherhk8p |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scherhk8p |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scherhk8p |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5855cf58bb5ggkx |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5855cf58bb5ggkx |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5855cf58bb5ggkx |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-94z7vmv |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-94z7vmv |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-94z7vmv |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-shadow-svc |
| (x16) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-94z7vmv |
Unhealthy |
Startup probe failed: Get "https://10.134.0.41:8000/health": dial tcp 10.134.0.41:8000: connect: connection refused |
| (x16) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5855cf58bb5ggkx |
Unhealthy |
Startup probe failed: Get "https://10.134.0.40:8001/health": dial tcp 10.134.0.40:8001: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-50bc673d] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-50bc673d |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test00d7278d8a22c4e39146a6b0eb840f45-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5855cf58bb5ggkx |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-94z7vmv |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-50bc673d-kserve-5855cf58bb5ggkx |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scherhk8p |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scherhk8p |
FailedPreStopHook |
PreStopHook failed | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
custom-route-timeout-pd-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-pd-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-pd-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Role kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-rb | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-7578d795d5 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-prefill-7977c54448 |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-prefill-7977c54448-fjjgc | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-prefill-7977c54448 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-7578d795d5 |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-7578d795d5-d8x2l | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-569482q2nc |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7578d795d5-d8x2l |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-7977c54448-fjjgc |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-569482q2nc |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-prefill-7977c54448-fjjgc |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7578d795d5-d8x2l |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-router-scheduler-569482q2nc |
AddedInterface |
Add eth0 [10.132.0.59/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7578d795d5-d8x2l |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7578d795d5-d8x2l |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-569482q2nc |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7578d795d5-d8x2l |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7578d795d5-d8x2l |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-7977c54448-fjjgc |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-router-scheduler-5694888cd |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-router-scheduler-569482q2nc | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-router-scheduler-5694888cd from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-7977c54448-fjjgc |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-7578d795d5-d8x2l |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-569482q2nc |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-569482q2nc |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-569482q2nc |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7578d795d5-d8x2l |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7578d795d5-d8x2l |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7578d795d5-d8x2l |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-7977c54448-fjjgc |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-7977c54448-fjjgc |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-7977c54448-fjjgc |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-shadow-svc |
| (x16) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-7977c54448-fjjgc |
Unhealthy |
Startup probe failed: Get "https://10.134.0.43:8000/health": dial tcp 10.134.0.43:8000: connect: connection refused |
| (x16) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7578d795d5-d8x2l |
Unhealthy |
Startup probe failed: Get "https://10.134.0.42:8001/health": dial tcp 10.134.0.42:8001: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
LLMInferenceServiceReady |
LLMInferenceService [custom-route-timeout-pd-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-569482q2nc |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-569482q2nc |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7578d795d5-d8x2l |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-7578d795d5-d8x2l |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-7977c54448-fjjgc |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-2-openshift-default-54c789bdc6 |
SuccessfulCreate |
Created pod: router-gateway-2-openshift-default-54c789bdc6-fj8fg | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-fj8fg |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-fj8fg |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
gateway_labeler_controller |
router-gateway-2 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway router-gateway-2 | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-fj8fg |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine | |
kserve-ci-e2e-test |
multus |
router-gateway-2-openshift-default-54c789bdc6-fj8fg |
AddedInterface |
Add eth0 [10.133.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
service-controller |
router-gateway-2-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-2-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-2-openshift-default-54c789bdc6 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-2-openshift-default-684dc9b4b9 |
SuccessfulCreate |
Created pod: router-gateway-2-openshift-default-684dc9b4b9-nrf44 | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-2-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-2-openshift-default-684dc9b4b9 from 0 to 1 | |
kserve-ci-e2e-test |
service-controller |
router-gateway-2-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
kserve-ci-e2e-test |
multus |
router-gateway-2-openshift-default-684dc9b4b9-nrf44 |
AddedInterface |
Add eth0 [10.133.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-2-openshift-default-54c789bdc6 |
SuccessfulDelete |
Deleted pod: router-gateway-2-openshift-default-54c789bdc6-fj8fg | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-54c789bdc6-fj8fg |
Killing |
Stopping container istio-proxy | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-2-openshift-default |
ScalingReplicaSet |
Scaled down replica set router-gateway-2-openshift-default-54c789bdc6 from 1 to 0 | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-nrf44 |
Started |
Started container istio-proxy |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-nrf44 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-nrf44 |
Created |
Created container: istio-proxy |
| (x5) | kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-684dc9b4b9-nrf44 |
Unhealthy |
Startup probe failed: Get "http://10.133.0.46:15021/healthz/ready": dial tcp 10.133.0.46:15021: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-pd-test-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-pd-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Role kserve-ci-e2e-test/router-with-refs-pd-test-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-epp-sa | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-prefill-64cf49759b from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-5f4558569 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-5f4558569 |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-5f4558569-7l4qq | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-prefill-64cf49759b |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-prefill-64cf49759b-8g76f | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5f4558569-7l4qq |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-64cf49759b-8g76f |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-prefill-64cf49759b-8g76f |
AddedInterface |
Add eth0 [10.134.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-64cf49759b-8g76f |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-5f4558569-7l4qq |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5f4558569-7l4qq |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5f4558569-7l4qq |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5f4558569-7l4qq |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5f4558569-7l4qq |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-64cf49759b-8g76f |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5f4558569-7l4qq |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-555b5c7c6jmtxm |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-555b5c7c6jmtxm |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-router-scheduler-555b5c7c66 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-555b5c7c6jmtxm |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-router-scheduler-555b5c7c6jmtxm |
AddedInterface |
Add eth0 [10.132.0.60/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-router-scheduler-555b5c7c66 |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-router-scheduler-555b5c7c6jmtxm | |
| (x9) | kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-pd-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-555b5c7c6jmtxm |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-555b5c7c6jmtxm |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-555b5c7c6jmtxm |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-64cf49759b-8g76f |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-64cf49759b-8g76f |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-64cf49759b-8g76f |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5f4558569-7l4qq |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5f4558569-7l4qq |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5f4558569-7l4qq |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs | |
| (x14) | kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5f4558569-7l4qq |
Unhealthy |
Startup probe failed: Get "https://10.134.0.44:8001/health": dial tcp 10.134.0.44:8001: connect: connection refused |
| (x16) | kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-64cf49759b-8g76f |
Unhealthy |
Startup probe failed: Get "https://10.134.0.45:8000/health": dial tcp 10.134.0.45:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
LLMInferenceServiceReady |
LLMInferenceService [router-with-refs-pd-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5f4558569-7l4qq |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-64cf49759b-8g76f |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-555b5c7c6jmtxm |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-555b5c7c6jmtxm |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-5f4558569-7l4qq |
Killing |
Stopping container main | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-3c960099 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-3c960099-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-3c960099-kserve-route" not found |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-c84499f99-5n7j7 |
AddedInterface |
Add eth0 [10.134.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-c84499f99-5n7j7 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-c84499f99 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-3c960099-kserve-c84499f99-5n7j7 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvd10b93c8eba12f87c3a350a5cae2ee0c-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-3c960099-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-3c960099-kserve-c84499f99 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-c84499f99-5n7j7 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-c84499f99-5n7j7 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-c84499f99-5n7j7 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-c84499f99-5n7j7 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-c84499f99-5n7j7 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvd10b93c8eba12f87c3a350a5cae2ee0c-kserve-self-signed-certs | |
| (x11) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-c84499f99-5n7j7 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.46:8000/health": dial tcp 10.134.0.46:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-3c960099 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-3c960099] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-3c960099-kserve-c84499f99-5n7j7 |
Killing |
Stopping container main | |
| (x14) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test386bd5808c5c450f11fd8632e1f821fb-llmisvc-mode | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
SuccessfulCreate |
create Pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 in StatefulSet llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn successful | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler-6fd65995d8 from 0 to 1 | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
SuccessfulCreate |
create Pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 in StatefulSet llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 successful | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
AddedInterface |
Add eth0 [10.134.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-scc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
GroupsProgressing |
Created worker statefulset for leader pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler-6fd65995d8 |
SuccessfulCreate |
Created pod: llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schecvlkm | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
CreatingRevision |
Creating revision with key 845b7486c6 for a newly created LeaderWorkerSet | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
GroupsProgressing |
Created leader statefulset llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
GroupsProgressing |
Replicas are progressing, with 0 groups ready of total 1 groups | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schecvlkm |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schecvlkm |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schecvlkm |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schecvlkm |
AddedInterface |
Add eth0 [10.132.0.62/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:8e9c7df00b7f8a40f3f94a720eed48825e8534341907d782b2b0fc71879b5a17" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
AddedInterface |
Add eth0 [10.132.0.61/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schecvlkm |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schecvlkm |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schecvlkm |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Pulling |
Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs | |
| (x8) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Pulled |
Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" in 46.134s (46.134s including waiting). Image size: 3531177328 bytes. | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 |
Created |
Created container: main | |
| (x10) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.47:8000/health": dial tcp 10.134.0.47:8000: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn |
AllGroupsReady |
All replicas are ready, with 1 groups ready of total 1 groups |
| (x14) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-inline-config-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-inline-config-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-inline-config-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-inline-config-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-inline-config-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-kserve-workload-svc | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-inline-config-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-inline-config-test-kserve-7c6c58cc96 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-inline-config-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-inline-config-test-kserve-router-scheduler-d9ddf6c4d from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-inline-config-test-kserve-7c6c58cc96 |
SuccessfulCreate |
Created pod: scheduler-inline-config-test-kserve-7c6c58cc96-vfth6 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-inline-config-test-kserve-router-scheduler-d9ddf6c4d |
SuccessfulCreate |
Created pod: scheduler-inline-config-test-kserve-router-scheduler-d9ddfvmh8l | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-vfth6 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-vfth6 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-vfth6 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
multus |
scheduler-inline-config-test-kserve-7c6c58cc96-vfth6 |
AddedInterface |
Add eth0 [10.133.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-inline-config-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d9ddfvmh8l |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d9ddfvmh8l |
Created |
Created container: main | |
kserve-ci-e2e-test |
multus |
scheduler-inline-config-test-kserve-router-scheduler-d9ddfvmh8l |
AddedInterface |
Add eth0 [10.132.0.63/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d9ddfvmh8l |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-dc21cb14 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-fb-opt-125m-route-dc21cb14] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-inline-config-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-inline-config-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d9ddfvmh8l |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d9ddfvmh8l |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-7c6c58cc96-vfth6 |
Killing |
Stopping container main | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route" not found |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4 |
SuccessfulCreate |
Created pod: llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvxrb | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler-79866dc455 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test80f99418f0f3eb4c80f02e6144a6d4f2-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler-79866dc455 |
SuccessfulCreate |
Created pod: llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schec5q9d | |
kserve-ci-e2e-test |
multus |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvxrb |
AddedInterface |
Add eth0 [10.133.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvxrb |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvxrb |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvxrb |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schec5q9d |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schec5q9d |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schec5q9d |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schec5q9d |
AddedInterface |
Add eth0 [10.132.0.64/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
LLMInferenceServiceReady |
LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-4c1ba212] is Ready | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvxrb |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schec5q9d |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schec5q9d |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212 |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test80f99418f0f3eb4c80f02e6144a6d4f2-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4qvxrb |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.48:8000/health": dial tcp 10.133.0.48:8000: connect: connection refused | |
| (x14) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-configmap-ref-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-configmap-ref-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-configmap-ref-test-kserve-route" not found |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-configmap-ref-test-kserve-router-scheduler-68f876cc5d |
SuccessfulCreate |
Created pod: scheduler-configmap-ref-test-kserve-router-scheduler-68f87snbv9 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-6cg2w |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-6cg2w |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-service | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-configmap-ref-test-kserve-744bf59fbd |
SuccessfulCreate |
Created pod: scheduler-configmap-ref-test-kserve-744bf59fbd-6cg2w | |
kserve-ci-e2e-test |
multus |
scheduler-configmap-ref-test-kserve-744bf59fbd-6cg2w |
AddedInterface |
Add eth0 [10.133.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
scheduler-configmap-ref-test-kserve-router-scheduler-68f87snbv9 |
AddedInterface |
Add eth0 [10.132.0.65/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-6cg2w |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-configmap-ref-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-configmap-ref-test-kserve-router-scheduler-68f876cc5d from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-configmap-ref-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-configmap-ref-test-kserve-744bf59fbd from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-68f87snbv9 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-68f87snbv9 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-68f87snbv9 |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-configmap-ref-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-68f87snbv9 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-68f87snbv9 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-744bf59fbd-6cg2w |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dnhjpk |
AddedInterface |
Add eth0 [10.133.0.51/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-99knr |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dptxbh |
AddedInterface |
Add eth0 [10.132.0.66/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dptxbh |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dnhjpk |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dnhjpk |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dnhjpk |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-service | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dbc4 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dnhjpk | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dbc4 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dptxbh | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-5c5cfcf776 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-5c5cfcf776-99knr | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dptxbh |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-99knr |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-99knr |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-5c5cfcf776-99knr |
AddedInterface |
Add eth0 [10.133.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dptxbh |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-ha-replicas-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dbc4 from 0 to 2 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-ha-replicas-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-ha-replicas-test-kserve-5c5cfcf776 from 0 to 1 | |
| (x14) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-ha-replicas-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-ha-replicas-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-ha-replicas-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-ha-replicas-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dptxbh |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-99knr |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dptxbh |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dnhjpk |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dnhjpk |
Killing |
Stopping container main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dnhjpk |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-5c5cfcf776-99knr |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.50:8000/health": dial tcp 10.133.0.50:8000: connect: connection refused | |
| (x14) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-custom-template-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-custom-template-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-custom-template-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-custom-template-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-custom-template-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-custom-template-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-custom-template-test-kserve-5bc7bd6864 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-custom-template-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-custom-template-test-kserve-5bc7bd6864 |
SuccessfulCreate |
Created pod: scheduler-custom-template-test-kserve-5bc7bd6864-5b4tt | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-custom-template-test-kserve-workload-svc | |
kserve-ci-e2e-test |
multus |
scheduler-custom-template-test-kserve-router-scheduler-56762884 |
AddedInterface |
Add eth0 [10.132.0.67/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-56762884 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-5b4tt |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
multus |
scheduler-custom-template-test-kserve-5bc7bd6864-5b4tt |
AddedInterface |
Add eth0 [10.133.0.52/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-5b4tt |
Started |
Started container main | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-custom-template-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-custom-template-test-kserve-router-scheduler-567469f665 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-custom-template-test-epp-sa | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-custom-template-test-kserve-router-scheduler-567469f665 |
SuccessfulCreate |
Created pod: scheduler-custom-template-test-kserve-router-scheduler-56762884 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-custom-template-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-custom-template-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-custom-template-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-custom-template-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-56762884 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-5b4tt |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-56762884 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-custom-template-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-custom-template-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-custom-template-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-custom-template-test] is Ready | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-custom-template-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-custom-template-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-56762884 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-router-scheduler-56762884 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
scheduler-custom-template-test-kserve-5bc7bd6864-5b4tt |
Killing |
Stopping container main | |
| (x14) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-v06-pd-migration-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-v06-pd-migration-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-v06-pd-migration-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-v06-pd-migration-test-epp-auth-rb | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-pd-migration-test-kserve-5c87756974 |
SuccessfulCreate |
Created pod: scheduler-v06-pd-migration-test-kserve-5c87756974-bgqq5 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847 |
SuccessfulCreate |
Created pod: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-wgdh2 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-pd-migration-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-pd-migration-test-kserve-router-scheduler-59dc679cd |
SuccessfulCreate |
Created pod: scheduler-v06-pd-migration-test-kserve-router-scheduler-59qr7w8 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-pd-migration-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-pd-migration-test-kserve-router-scheduler-59dc679cd from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-pd-migration-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-pd-migration-test-kserve-5c87756974 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-pd-migration-test-epp-sa | |
kserve-ci-e2e-test |
multus |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-wgdh2 |
AddedInterface |
Add eth0 [10.132.0.68/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
scheduler-v06-pd-migration-test-kserve-router-scheduler-59qr7w8 |
AddedInterface |
Add eth0 [10.133.0.54/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
scheduler-v06-pd-migration-test-kserve-5c87756974-bgqq5 |
AddedInterface |
Add eth0 [10.133.0.53/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-bgqq5 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-bgqq5 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" in 813ms (813ms including waiting). Image size: 44914394 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-bgqq5 |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-bgqq5 |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-59qr7w8 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-59qr7w8 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-59qr7w8 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-wgdh2 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-wgdh2 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-wgdh2 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-bgqq5 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-bgqq5 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-bgqq5 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
| (x186) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-pvc-router-manage-2577e794 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-v06-pd-migration-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-59qr7w8 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-bgqq5 |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-wgdh2 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-pd-migration-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-v06-pd-migration-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-router-scheduler-59qr7w8 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-5c87756974-bgqq5 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-wgdh2 |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.68:8000/health": dial tcp 10.132.0.68:8000: connect: connection refused | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-v06-threshold-migration-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-v06-threshold-migration-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-v06-threshold-migration-test-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-threshold-migration-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-threshold-migration-test-kserve-router-scheduler-dbc65f645 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-role | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-threshold-migration-test-kserve-router-scheduler-dbc65f645 |
SuccessfulCreate |
Created pod: scheduler-v06-threshold-migration-test-kserve-router-schedwqxc2 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-threshold-migration-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-threshold-migration-test-kserve-prefill-5fc599dc49 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test0a07e82be2036793543b2d3db2ea0785-scheduler-v0 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve | |
kserve-ci-e2e-test |
multus |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-zhckd |
AddedInterface |
Add eth0 [10.133.0.55/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-zhckd |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
multus |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5ws27c |
AddedInterface |
Add eth0 [10.132.0.69/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc599dc49 |
SuccessfulCreate |
Created pod: scheduler-v06-threshold-migration-test-kserve-prefill-5fc5ws27c | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5ws27c |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5ws27c |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-zhckd |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-zhckd |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-v06-threshold-migration-test-kserve-5994569d5b |
SuccessfulCreate |
Created pod: scheduler-v06-threshold-migration-test-kserve-5994569d5b-zhckd | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-v06-threshold-migration-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-v06-threshold-migration-test-kserve-5994569d5b from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5ws27c |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedwqxc2 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedwqxc2 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-zhckd |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-zhckd |
Started |
Started container main | |
kserve-ci-e2e-test |
multus |
scheduler-v06-threshold-migration-test-kserve-router-schedwqxc2 |
AddedInterface |
Add eth0 [10.133.0.56/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-zhckd |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedwqxc2 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-route | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
LLMInferenceServiceReady |
LLMInferenceService [scheduler-v06-threshold-migration-test] is Ready | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedwqxc2 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-prefill-5fc5ws27c |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-router-schedwqxc2 |
FailedPreStopHook |
PreStopHook failed | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-zhckd |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-zhckd |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-v06-threshold-migration-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test0a07e82be2036793543b2d3db2ea0785-scheduler-v0 | |
kserve-ci-e2e-test |
kubelet |
scheduler-v06-threshold-migration-test-kserve-5994569d5b-zhckd |
Unhealthy |
Readiness probe failed: Get "https://10.133.0.55:8001/health": dial tcp 10.133.0.55:8001: connect: connection refused |