Time Namespace Component RelatedObject Reason Message

kserve-ci-e2e-test

router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr

Scheduled

Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79j8spp

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79j8spp to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-6j9zb

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-6j9zb to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-kcm8z

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-kcm8z to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d9kvx5

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d9kvx5 to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4xwdp7

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4xwdp7 to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879h867m

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879h867m to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

auth-disabled-test-kserve-router-scheduler-9bc4884b5-shml5

Scheduled

Successfully assigned kserve-ci-e2e-test/auth-disabled-test-kserve-router-scheduler-9bc4884b5-shml5 to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

router-with-refs-test-kserve-7948b44cf6-7jnwf

Scheduled

Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-7948b44cf6-7jnwf to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schednpfr

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schednpfr to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheklks8

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheklks8 to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche4f97z

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche4f97z to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

custom-route-timeout-pd-test-kserve-bf6648c8f-l76d2

Scheduled

Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-bf6648c8f-l76d2 to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche45kkn

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche45kkn to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-7bcb69f67b-q2jnj

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-7bcb69f67b-q2jnj to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schejh6wz

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schejh6wz to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheln89s

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheln89s to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2 to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schewvvrj

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schewvvrj to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

lora-multiple-adapters-test-kserve-76d7f87f5d-zt9x2

Scheduled

Successfully assigned kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-76d7f87f5d-zt9x2 to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

auth-disabled-test-kserve-68bf46444d-nz2fk

Scheduled

Successfully assigned kserve-ci-e2e-test/auth-disabled-test-kserve-68bf46444d-nz2fk to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

lora-single-adapter-test-kserve-6b64c6f8b9-2lb72

Scheduled

Successfully assigned kserve-ci-e2e-test/lora-single-adapter-test-kserve-6b64c6f8b9-2lb72 to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

precise-prefix-cache-test-kserve-7f56466b78-5ms96

Scheduled

Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-5ms96 to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-ffbdb7db7-cdtzl

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-ffbdb7db7-cdtzl to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

precise-prefix-cache-test-kserve-7f56466b78-t94t8

Scheduled

Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-7f56466b78-t94t8 to ip-10-0-138-219.ec2.internal

openshift-ingress

router-default-bcd57767c-rwpfk

Scheduled

Successfully assigned openshift-ingress/router-default-bcd57767c-rwpfk to ip-10-0-138-219.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-default-655f7c58b4-57g8x

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-655f7c58b4-57g8x to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

custom-route-timeout-pd-test-kserve-prefill-84bf95b496-tchc8

Scheduled

Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-84bf95b496-tchc8 to ip-10-0-138-219.ec2.internal

openshift-ingress

istiod-openshift-gateway-94bb8fbfd-kqnw7

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-94bb8fbfd-kqnw7 to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx

Scheduled

Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx to ip-10-0-132-117.ec2.internal

kuadrant-system

limitador-operator-controller-manager-6f9f468797-f448h

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-6f9f468797-f448h to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

auth-enabled-test-kserve-d8474687d-xkkfx

Scheduled

Successfully assigned kserve-ci-e2e-test/auth-enabled-test-kserve-d8474687d-xkkfx to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d48hqx6

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d48hqx6 to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7

Scheduled

Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7 to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

prestop-hook-test-kserve-6769cdd744-b8f4z

Scheduled

Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-6769cdd744-b8f4z to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

prestop-hook-test-kserve-6769cdd744-kpvrw

Scheduled

Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-6769cdd744-kpvrw to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db

Scheduled

Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

rolling-upgrade-test-kserve-54bc76f55b-r2wjc

Scheduled

Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-54bc76f55b-r2wjc to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

rolling-upgrade-test-kserve-859df57bcb-glml8

Scheduled

Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-859df57bcb-glml8 to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

router-gateway-1-openshift-default-54c47cdfc7-ss4x6

Scheduled

Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-54c47cdfc7-ss4x6 to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg

Scheduled

Successfully assigned kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

router-gateway-2-openshift-default-684dc9b4b9-j47sj

Scheduled

Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-684dc9b4b9-j47sj to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

router-with-refs-pd-test-kserve-88fcd5785-4gknp

Scheduled

Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-88fcd5785-4gknp to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

router-with-refs-pd-test-kserve-prefill-6f65776896-vzvsg

Scheduled

Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-6f65776896-vzvsg to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr

Scheduled

Successfully assigned kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4bzrdv

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4bzrdv to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt

Scheduled

Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-55fbb5c846qq7vl

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-55fbb5c846qq7vl to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

scheduler-configmap-ref-test-kserve-744bf59fbd-w4dpn

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-744bf59fbd-w4dpn to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

scheduler-configmap-ref-test-kserve-router-scheduler-68f87brkb6

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-68f87brkb6 to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

scheduler-custom-template-test-kserve-5bc7bd6864-gd7l9

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-custom-template-test-kserve-5bc7bd6864-gd7l9 to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

scheduler-custom-template-test-kserve-router-scheduler-567jsr2c

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-567jsr2c to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

scheduler-ha-replicas-test-kserve-5c5cfcf776-r296b

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5c5cfcf776-r296b to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dhg8tc

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dhg8tc to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dmcsm9

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dmcsm9 to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

scheduler-inline-config-test-kserve-7c6c58cc96-c4czf

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-7c6c58cc96-c4czf to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

scheduler-inline-config-test-kserve-router-scheduler-d9ddfgcgqs

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d9ddfgcgqs to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hhhsk

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hhhsk to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

scheduler-v06-pd-migration-test-kserve-router-scheduler-59zfr9k

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-router-scheduler-59zfr9k to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

scheduler-v06-threshold-migration-test-kserve-5994569d5b-kpnrr

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-5994569d5b-kpnrr to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

scheduler-v06-threshold-migration-test-kserve-prefill-5fc56gcmm

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill-5fc56gcmm to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

scheduler-v06-threshold-migration-test-kserve-router-sched94m92

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-router-sched94m92 to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

stop-feature-test-kserve-8486474f84-czrmh

Scheduled

Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-8486474f84-czrmh to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

stop-feature-test-kserve-8486474f84-dz7zq

Scheduled

Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-8486474f84-dz7zq to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq

Scheduled

Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44

Scheduled

Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44 to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

tls-verification-test-kserve-654fdf69fb-mc965

Scheduled

Successfully assigned kserve-ci-e2e-test/tls-verification-test-kserve-654fdf69fb-mc965 to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x

Scheduled

Successfully assigned kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

auth-invalid-token-test-kserve-6f6986f4-vmpkj

Scheduled

Successfully assigned kserve-ci-e2e-test/auth-invalid-token-test-kserve-6f6986f4-vmpkj to ip-10-0-138-219.ec2.internal

kuadrant-system

authorino-7c77957575-nf65n

Scheduled

Successfully assigned kuadrant-system/authorino-7c77957575-nf65n to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5f7cvrx

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5f7cvrx to ip-10-0-138-219.ec2.internal

kuadrant-system

authorino-8df697c9f-nr87c

Scheduled

Successfully assigned kuadrant-system/authorino-8df697c9f-nr87c to ip-10-0-132-117.ec2.internal

kuadrant-system

authorino-b6c89bb85-nw9cq

Scheduled

Successfully assigned kuadrant-system/authorino-b6c89bb85-nw9cq to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-bb84757f8-mvk8h

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-bb84757f8-mvk8h to ip-10-0-138-219.ec2.internal

kuadrant-system

authorino-operator-6d85f6564-s4vc7

Scheduled

Successfully assigned kuadrant-system/authorino-operator-6d85f6564-s4vc7 to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c86ddcf67nm9lm

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c86ddcf67nm9lm to ip-10-0-138-219.ec2.internal

kserve-ci-e2e-test

gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q

Scheduled

Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

router-with-refs-test-kserve-router-scheduler-5594f94979-fqs8s

Scheduled

Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-5594f94979-fqs8s to ip-10-0-138-219.ec2.internal

kuadrant-system

dns-operator-controller-manager-65b49595d7-c59jh

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-65b49595d7-c59jh to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

e2e-pvc-model-download-9dx26

Scheduled

Successfully assigned kserve-ci-e2e-test/e2e-pvc-model-download-9dx26 to ip-10-0-132-117.ec2.internal

kuadrant-system

kuadrant-console-plugin-85fd4b8b9d-pgv8h

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-pgv8h to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

auth-invalid-token-test-kserve-router-scheduler-54958d97466ldts

Scheduled

Successfully assigned kserve-ci-e2e-test/auth-invalid-token-test-kserve-router-scheduler-54958d97466ldts to ip-10-0-138-219.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz to ip-10-0-132-117.ec2.internal

kuadrant-system

limitador-limitador-69574b596d-8mmn4

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-69574b596d-8mmn4 to ip-10-0-140-104.ec2.internal

kserve-ci-e2e-test

custom-route-timeout-test-kserve-router-scheduler-5599744dttprw

Scheduled

Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-5599744dttprw to ip-10-0-132-117.ec2.internal

kuadrant-system

limitador-limitador-ff68ff5cb-hpwld

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-ff68ff5cb-hpwld to ip-10-0-132-117.ec2.internal

kserve-ci-e2e-test

custom-route-timeout-test-kserve-bbd5bdc5b-t6rkv

Scheduled

Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-bbd5bdc5b-t6rkv to ip-10-0-138-219.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-bcd57767c from 0 to 1
(x10)

openshift-ingress

replicaset-controller

router-default-bcd57767c

FailedCreate

Error creating: pods "router-default-bcd57767c-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-bcd57767c

FailedCreate

Error creating: pods "router-default-bcd57767c-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-bcd57767c

SuccessfulCreate

Created pod: router-default-bcd57767c-rwpfk
(x6)

openshift-ingress

kubelet

router-default-bcd57767c-rwpfk

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-bcd57767c-rwpfk

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-bcd57767c-rwpfk

AddedInterface

Add eth0 [10.132.0.11/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-bcd57767c-rwpfk

Created

Created container: router

openshift-ingress

kubelet

router-default-bcd57767c-rwpfk

Started

Started container router

openshift-ingress

kubelet

router-default-bcd57767c-rwpfk

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:d0a4ad778508b54686000a2e9088f085a174aa26c504abe9f8ffe8cab7fdd077" already present on machine

openshift-ingress

multus

istiod-openshift-gateway-94bb8fbfd-kqnw7

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-94bb8fbfd from 0 to 1

openshift-ingress

kubelet

istiod-openshift-gateway-94bb8fbfd-kqnw7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9"

openshift-ingress

replicaset-controller

istiod-openshift-gateway-94bb8fbfd

SuccessfulCreate

Created pod: istiod-openshift-gateway-94bb8fbfd-kqnw7

openshift-ingress

kubelet

istiod-openshift-gateway-94bb8fbfd-kqnw7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:0850242436e88f7d82f0f2126de064c7e0f09844f31d8ff0f53dc8d3908075d9" in 3.015s (3.015s including waiting). Image size: 181034515 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-94bb8fbfd-kqnw7

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-94bb8fbfd-kqnw7

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-94bb8fbfd-kqnw7

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-94bb8fbfd-kqnw7

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

service-controller

openshift-ai-inference-openshift-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-default

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-default-655f7c58b4 from 0 to 1

openshift-ingress

multus

openshift-ai-inference-openshift-default-655f7c58b4-57g8x

AddedInterface

Add eth0 [10.133.0.20/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-655f7c58b4-57g8x

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8"

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-655f7c58b4

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-655f7c58b4-57g8x

openshift-ingress

gateway_labeler_controller

openshift-ai-inference

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway openshift-ai-inference

openshift-ingress

service-controller

openshift-ai-inference-openshift-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-655f7c58b4-57g8x

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 5.023s (5.023s including waiting). Image size: 181251556 bytes.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.1

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.1

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.1

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.1

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.1

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

replicaset-controller

authorino-operator-6d85f6564

SuccessfulCreate

Created pod: authorino-operator-6d85f6564-s4vc7

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-6d85f6564 from 0 to 1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.1

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.1

RequirementsUnknown

requirements not yet checked

kuadrant-system

multus

authorino-operator-6d85f6564-s4vc7

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-6d85f6564-s4vc7

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:b2cc2c0f0729dad98f970830816e300c0b961ba42491f362295512d886384687"

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.0

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.1

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-bb7ddb7d7

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz

kuadrant-system

kubelet

authorino-operator-6d85f6564-s4vc7

Started

Started container manager

kuadrant-system

kubelet

authorino-operator-6d85f6564-s4vc7

Created

Created container: manager

kuadrant-system

kubelet

authorino-operator-6d85f6564-s4vc7

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:b2cc2c0f0729dad98f970830816e300c0b961ba42491f362295512d886384687" in 4.192s (4.192s including waiting). Image size: 168639631 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:0b77e4a874b620095a0300877aea53e78559a601ce62b194537ed21c2743bbf3"

kuadrant-system

multus

kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

kuadrant-system

authorino-operator-6d85f6564-s4vc7_9a161572-fc75-45fc-9514-2d6ae03e479d

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-6d85f6564-s4vc7_9a161572-fc75-45fc-9514-2d6ae03e479d became leader

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.0

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-bb7ddb7d7 from 0 to 1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.1

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.1

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

limitador-operator-controller-manager-6f9f468797-f448h

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:183bad2a6f5872aea38f54ad507f7e005d6facb02b18769e0407c82799f96a3e"

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-6f9f468797

SuccessfulCreate

Created pod: limitador-operator-controller-manager-6f9f468797-f448h

kuadrant-system

multus

limitador-operator-controller-manager-6f9f468797-f448h

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-6f9f468797 from 0 to 1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.0

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.0

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.0

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.0

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.0

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-65b49595d7 from 0 to 1

kuadrant-system

kubelet

dns-operator-controller-manager-65b49595d7-c59jh

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ba46f54446ecd3ed1a3d877dcbb7359ff8f2d918827f3411a5cb0781915a65d5"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.0

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

kubelet

limitador-operator-controller-manager-6f9f468797-f448h

Started

Started container manager

kuadrant-system

kubelet

limitador-operator-controller-manager-6f9f468797-f448h

Created

Created container: manager

kuadrant-system

kubelet

limitador-operator-controller-manager-6f9f468797-f448h

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:183bad2a6f5872aea38f54ad507f7e005d6facb02b18769e0407c82799f96a3e" in 2.035s (2.035s including waiting). Image size: 178538972 bytes.

kuadrant-system

replicaset-controller

dns-operator-controller-manager-65b49595d7

SuccessfulCreate

Created pod: dns-operator-controller-manager-65b49595d7-c59jh

kuadrant-system

kubelet

kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz

Started

Started container manager

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.0

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

multus

dns-operator-controller-manager-65b49595d7-c59jh

AddedInterface

Add eth0 [10.133.0.22/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.0

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

kubelet

kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:0b77e4a874b620095a0300877aea53e78559a601ce62b194537ed21c2743bbf3" in 4.077s (4.077s including waiting). Image size: 425661757 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz

Created

Created container: manager

kuadrant-system

kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz_f1db0ff3-5866-44ea-80e2-0309154b14e5

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-bb7ddb7d7-l4dwz_f1db0ff3-5866-44ea-80e2-0309154b14e5 became leader

kuadrant-system

limitador-operator-controller-manager-6f9f468797-f448h_f2dd4021-9fdb-46e7-9de2-da7a29635edc

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-6f9f468797-f448h_f2dd4021-9fdb-46e7-9de2-da7a29635edc became leader

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-85fd4b8b9d from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-console-plugin-85fd4b8b9d

SuccessfulCreate

Created pod: kuadrant-console-plugin-85fd4b8b9d-pgv8h

kuadrant-system

kubelet

kuadrant-console-plugin-85fd4b8b9d-pgv8h

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:6e69f41d3d70b0afa7691a5d2400065d3bcdec2ea82830cf2992b8e69ba06e2a"

kuadrant-system

multus

kuadrant-console-plugin-85fd4b8b9d-pgv8h

AddedInterface

Add eth0 [10.133.0.23/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-65b49595d7-c59jh

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ba46f54446ecd3ed1a3d877dcbb7359ff8f2d918827f3411a5cb0781915a65d5" in 3.859s (3.859s including waiting). Image size: 190472853 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-65b49595d7-c59jh

Created

Created container: manager

kuadrant-system

kubelet

dns-operator-controller-manager-65b49595d7-c59jh

Started

Started container manager

kuadrant-system

dns-operator-controller-manager-65b49595d7-c59jh_90f14135-06d9-40ea-bf2b-d1ef4dc61648

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-65b49595d7-c59jh_90f14135-06d9-40ea-bf2b-d1ef4dc61648 became leader

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.1

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-console-plugin-85fd4b8b9d-pgv8h

Started

Started container kuadrant-console-plugin

kuadrant-system

kubelet

kuadrant-console-plugin-85fd4b8b9d-pgv8h

Created

Created container: kuadrant-console-plugin

kuadrant-system

kubelet

kuadrant-console-plugin-85fd4b8b9d-pgv8h

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:6e69f41d3d70b0afa7691a5d2400065d3bcdec2ea82830cf2992b8e69ba06e2a" in 5.091s (5.091s including waiting). Image size: 342502139 bytes.
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x3)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.0

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.1

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.0

InstallSucceeded

install strategy completed with no errors

kuadrant-system

multus

limitador-limitador-ff68ff5cb-hpwld

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

limitador-limitador-ff68ff5cb

SuccessfulCreate

Created pod: limitador-limitador-ff68ff5cb-hpwld

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-ff68ff5cb from 0 to 1

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-69574b596d from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-69574b596d

SuccessfulCreate

Created pod: limitador-limitador-69574b596d-8mmn4

kuadrant-system

kubelet

limitador-limitador-ff68ff5cb-hpwld

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474"

kuadrant-system

multus

authorino-b6c89bb85-nw9cq

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

kuadrant-system

multus

limitador-limitador-69574b596d-8mmn4

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-8df697c9f from 0 to 1

kuadrant-system

multus

authorino-8df697c9f-nr87c

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-8df697c9f-nr87c

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a"

kuadrant-system

replicaset-controller

authorino-8df697c9f

SuccessfulCreate

Created pod: authorino-8df697c9f-nr87c

kuadrant-system

kubelet

authorino-b6c89bb85-nw9cq

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a"

kuadrant-system

kubelet

limitador-limitador-69574b596d-8mmn4

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474"

kuadrant-system

replicaset-controller

authorino-b6c89bb85

SuccessfulCreate

Created pod: authorino-b6c89bb85-nw9cq

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-b6c89bb85 from 0 to 1

kuadrant-system

kubelet

authorino-b6c89bb85-nw9cq

Created

Created container: authorino

kuadrant-system

kubelet

authorino-b6c89bb85-nw9cq

Started

Started container authorino

kuadrant-system

kubelet

authorino-b6c89bb85-nw9cq

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" in 2.739s (2.739s including waiting). Image size: 202706732 bytes.

kuadrant-system

kubelet

limitador-limitador-69574b596d-8mmn4

Started

Started container limitador

kuadrant-system

kubelet

limitador-limitador-69574b596d-8mmn4

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" in 4.023s (4.023s including waiting). Image size: 250499765 bytes.

kuadrant-system

kubelet

limitador-limitador-69574b596d-8mmn4

Created

Created container: limitador

kuadrant-system

kubelet

limitador-limitador-ff68ff5cb-hpwld

Created

Created container: limitador

kuadrant-system

kubelet

authorino-8df697c9f-nr87c

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" in 4.457s (4.457s including waiting). Image size: 202706732 bytes.

kuadrant-system

kubelet

authorino-8df697c9f-nr87c

Started

Started container authorino

kuadrant-system

replicaset-controller

authorino-b6c89bb85

SuccessfulDelete

Deleted pod: authorino-b6c89bb85-nw9cq

kuadrant-system

kubelet

authorino-8df697c9f-nr87c

Created

Created container: authorino

kuadrant-system

kubelet

limitador-limitador-ff68ff5cb-hpwld

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" in 5.21s (5.21s including waiting). Image size: 250499765 bytes.

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-b6c89bb85 from 1 to 0

kuadrant-system

kubelet

limitador-limitador-ff68ff5cb-hpwld

Started

Started container limitador

kuadrant-system

kubelet

authorino-b6c89bb85-nw9cq

Killing

Stopping container authorino

kuadrant-system

kubelet

limitador-limitador-ff68ff5cb-hpwld

Killing

Stopping container limitador

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-ff68ff5cb from 1 to 0

kuadrant-system

replicaset-controller

limitador-limitador-ff68ff5cb

SuccessfulDelete

Deleted pod: limitador-limitador-ff68ff5cb-hpwld

kuadrant-system

replicaset-controller

authorino-7c77957575

SuccessfulCreate

Created pod: authorino-7c77957575-nf65n

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-7c77957575 from 0 to 1

kuadrant-system

multus

authorino-7c77957575-nf65n

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-7c77957575-nf65n

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a" in 568ms (568ms including waiting). Image size: 202706732 bytes.

kuadrant-system

kubelet

authorino-7c77957575-nf65n

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:eaadd50c0e4938926e50283a5f3e3b5f1dd24d820a3a2c7434153080180cc95a"

kuadrant-system

kubelet

authorino-8df697c9f-nr87c

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-8df697c9f

SuccessfulDelete

Deleted pod: authorino-8df697c9f-nr87c

kuadrant-system

kubelet

authorino-7c77957575-nf65n

Created

Created container: authorino

kuadrant-system

kubelet

authorino-7c77957575-nf65n

Started

Started container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-8df697c9f from 1 to 0

kserve-ci-e2e-test

replicaset-controller

router-gateway-1-openshift-default-54c47cdfc7

SuccessfulCreate

Created pod: router-gateway-1-openshift-default-54c47cdfc7-ss4x6

kserve-ci-e2e-test

kubelet

router-gateway-1-openshift-default-54c47cdfc7-ss4x6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8"

kserve-ci-e2e-test

service-controller

router-gateway-1-openshift-default

EnsuringLoadBalancer

Ensuring load balancer

kserve-ci-e2e-test

deployment-controller

router-gateway-1-openshift-default

ScalingReplicaSet

Scaled up replica set router-gateway-1-openshift-default-54c47cdfc7 from 0 to 1

kserve-ci-e2e-test

multus

router-gateway-1-openshift-default-54c47cdfc7-ss4x6

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

router-gateway-1-openshift-default-54c47cdfc7-ss4x6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" in 3.122s (3.122s including waiting). Image size: 181251556 bytes.

kserve-ci-e2e-test

service-controller

router-gateway-1-openshift-default

EnsuredLoadBalancer

Ensured load balancer

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-kserve-workload-svc

kserve-ci-e2e-test

replicaset-controller

precise-prefix-cache-test-kserve-7f56466b78

SuccessfulCreate

Created pod: precise-prefix-cache-test-kserve-7f56466b78-5ms96

kserve-ci-e2e-test

replicaset-controller

precise-prefix-cache-test-kserve-7f56466b78

SuccessfulCreate

Created pod: precise-prefix-cache-test-kserve-7f56466b78-t94t8

kserve-ci-e2e-test

deployment-controller

precise-prefix-cache-test-kserve

ScalingReplicaSet

Scaled up replica set precise-prefix-cache-test-kserve-7f56466b78 from 0 to 2

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

precise-prefix-cache-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy precise-prefix-cache-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "precise-prefix-cache-test-kserve-route" not found

kserve-ci-e2e-test

multus

precise-prefix-cache-test-kserve-7f56466b78-5ms96

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-7f56466b78-5ms96

Pulling

Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb"

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/precise-prefix-cache-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.Role kserve-ci-e2e-test/precise-prefix-cache-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb

kserve-ci-e2e-test

multus

precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

kserve-ci-e2e-test

replicaset-controller

precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf96

SuccessfulCreate

Created pod: precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/precise-prefix-cache-test-epp-sa

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-7f56466b78-t94t8

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-7f56466b78-t94t8

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-7f56466b78-t94t8

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

multus

precise-prefix-cache-test-kserve-7f56466b78-t94t8

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

kserve-ci-e2e-test

deployment-controller

precise-prefix-cache-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf96 from 0 to 1

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7

Pulling

Pulling image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2"

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7

Pulling

Pulling image "ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1"

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" in 1.45s (1.45s including waiting). Image size: 75073927 bytes.

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-7f56466b78-5ms96

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" in 3.563s (3.563s including waiting). Image size: 300567477 bytes.

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-7f56466b78-5ms96

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-7f56466b78-5ms96

Started

Started container storage-initializer

kserve-ci-e2e-test

replicaset-controller

gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5

SuccessfulCreate

Created pod: gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-2f0a622e

Created

Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-2f0a622e

Created

Created v1.Secret kserve-ci-e2e-test/gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs

kserve-ci-e2e-test

deployment-controller

gw-section-name-router-with-gat-2f0a622e-kserve

ScalingReplicaSet

Scaled up replica set gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc5 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-2f0a622e

Created

Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-2f0a622e

Created

Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-2f0a622e

Created

Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

kserve-ci-e2e-test

multus

gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt

Created

Created container: main

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt

Started

Started container main

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.423s (1.423s including waiting). Image size: 98346788 bytes.

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-7f56466b78-t94t8

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-7f56466b78-t94t8

Started

Started container main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-7f56466b78-t94t8

Created

Created container: main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-7f56466b78-t94t8

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.723s (1.723s including waiting). Image size: 98346788 bytes.

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-7f56466b78-5ms96

Started

Started container main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-7f56466b78-5ms96

Created

Created container: main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-7f56466b78-5ms96

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine
(x2)

kserve-ci-e2e-test

kubelet

router-gateway-1-openshift-default-54c47cdfc7-ss4x6

Created

Created container: istio-proxy
(x2)

kserve-ci-e2e-test

kubelet

router-gateway-1-openshift-default-54c47cdfc7-ss4x6

Started

Started container istio-proxy

kserve-ci-e2e-test

kubelet

router-gateway-1-openshift-default-54c47cdfc7-ss4x6

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Updated

Updated v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/precise-prefix-cache-test-kserve-shadow-svc
(x5)

kserve-ci-e2e-test

kubelet

router-gateway-1-openshift-default-54c47cdfc7-ss4x6

Unhealthy

Startup probe failed: Get "http://10.134.0.44:15021/healthz/ready": dial tcp 10.134.0.44:15021: connect: connection refused

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-uds-tokenizer:vllm-v0.19.1" in 29.907s (29.907s including waiting). Image size: 2989890188 bytes.

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7

Started

Started container tokenizer
(x2)

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7

Created

Created container: main
(x2)

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7

Started

Started container main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-2f0a622e-kserve-7c9c8cffc52ftwt

Unhealthy

Readiness probe failed: Get "https://10.134.0.46:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-f1d92d0f

Created

Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc

kserve-ci-e2e-test

replicaset-controller

gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b

SuccessfulCreate

Created pod: gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-f1d92d0f

Created

Created v1.Secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs

kserve-ci-e2e-test

deployment-controller

gw-section-name-router-with-gat-f1d92d0f-kserve

ScalingReplicaSet

Scaled up replica set gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5b from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-f1d92d0f

Created

Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-f1d92d0f

Created

Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-f1d92d0f

Created

Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-route

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q

Created

Created container: main

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q

Started

Started container main

kserve-ci-e2e-test

multus

gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q

Killing

Stopping container main
(x2)

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7

Unhealthy

Liveness probe failed: timeout: failed to connect service "10.132.0.31:9003" within 1s: context deadline exceeded

kserve-ci-e2e-test

multus

auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-d8474687d-xkkfx

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-d8474687d-xkkfx

Created

Created container: storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/auth-enabled-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

Created v1.Deployment kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

Created v1.Role kserve-ci-e2e-test/auth-enabled-test-epp-role

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-enabled-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/auth-enabled-test-epp-sa

kserve-ci-e2e-test

multus

auth-enabled-test-kserve-d8474687d-xkkfx

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

Created v1.Service kserve-ci-e2e-test/auth-enabled-test-epp-service

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-d8474687d-xkkfx

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

replicaset-controller

auth-enabled-test-kserve-d8474687d

SuccessfulCreate

Created pod: auth-enabled-test-kserve-d8474687d-xkkfx

kserve-ci-e2e-test

replicaset-controller

auth-enabled-test-kserve-router-scheduler-64d4b65cc6

SuccessfulCreate

Created pod: auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg

kserve-ci-e2e-test

deployment-controller

auth-enabled-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set auth-enabled-test-kserve-router-scheduler-64d4b65cc6 from 0 to 1

kserve-ci-e2e-test

deployment-controller

auth-enabled-test-kserve

ScalingReplicaSet

Scaled up replica set auth-enabled-test-kserve-d8474687d from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

Created v1.Secret kserve-ci-e2e-test/auth-enabled-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

Created v1.Deployment kserve-ci-e2e-test/auth-enabled-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

Created v1.Service kserve-ci-e2e-test/auth-enabled-test-kserve-workload-svc

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg

Pulling

Pulling image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2"

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg

Started

Started container main

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" in 1.013s (1.013s including waiting). Image size: 75073927 bytes.

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg

Created

Created container: main
(x6)

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-f1d92d0f-kserve-7bc8dd6c5bpz57q

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs" not found

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-d8474687d-xkkfx

Pulling

Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0"

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/auth-enabled-test-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Updated

Updated v1.Secret kserve-ci-e2e-test/auth-enabled-test-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-enabled-test-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

LLMInferenceServiceReady

LLMInferenceService [precise-prefix-cache-test] is Ready

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-7f56466b78-5ms96

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-c6c4fdf9pc8c7

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-7f56466b78-t94t8

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-7f56466b78-t94t8

Unhealthy

Readiness probe failed: Get "https://10.132.0.30:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-workload-svc

kserve-ci-e2e-test

replicaset-controller

llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879

SuccessfulCreate

Created pod: llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879h867m

kserve-ci-e2e-test

deployment-controller

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler-5dd88bfbb7 from 0 to 1

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879h867m

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-sa
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-router-managed-test-llm-e45d1f79

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-e45d1f79-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-e45d1f79-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-testef4d2875be14b30dc1561ed84d0d4bde-llmisvc-rout

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve

kserve-ci-e2e-test

replicaset-controller

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler-5dd88bfbb7

SuccessfulCreate

Created pod: llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche45kkn

kserve-ci-e2e-test

multus

llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879h867m

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-service

kserve-ci-e2e-test

deployment-controller

llmisvc-router-managed-test-llm-e45d1f79-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

Created v1.Secret kserve-ci-e2e-test/llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-d8474687d-xkkfx

Started

Started container main

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-d8474687d-xkkfx

Created

Created container: main

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-d8474687d-xkkfx

Pulled

Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" in 38.539s (38.539s including waiting). Image size: 3531177328 bytes.

kserve-ci-e2e-test

multus

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche45kkn

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche45kkn

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche45kkn

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche45kkn

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-route
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-shadow-svc

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879h867m

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 29.647s (29.647s including waiting). Image size: 98346788 bytes.

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879h867m

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879h867m

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

LLMInferenceServiceReady

LLMInferenceService [llmisvc-router-managed-test-llm-e45d1f79] is Ready

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879h867m

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testef4d2875be14b30dc1561ed84d0d4bde-llmisvc-rout
(x4)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche45kkn

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

kubelet

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche45kkn

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-sche45kkn

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-e45d1f79-kserve-7fdbbd4879h867m

Unhealthy

Readiness probe failed: Get "https://10.133.0.25:8000/health": dial tcp 10.133.0.25:8000: connect: connection refused

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4xwdp7

Started

Started container main

kserve-ci-e2e-test

deployment-controller

llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler-749449dbc8 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

Created v1.Secret kserve-ci-e2e-test/llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve

kserve-ci-e2e-test

deployment-controller

llmisvc-router-managed-test-llm-5b1e8f15-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4 from 0 to 1

kserve-ci-e2e-test

replicaset-controller

llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4

SuccessfulCreate

Created pod: llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4xwdp7

kserve-ci-e2e-test

multus

llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4xwdp7

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4xwdp7

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test7f54e84970003a6e7372bdbcb574f7ed-llmisvc-rout

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-service

kserve-ci-e2e-test

replicaset-controller

llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler-749449dbc8

SuccessfulCreate

Created pod: llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schewvvrj
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-router-managed-test-llm-5b1e8f15

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-5b1e8f15-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-5b1e8f15-kserve-route" not found

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4xwdp7

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schewvvrj

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schewvvrj

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schewvvrj

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

multus

llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schewvvrj

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-shadow-svc
(x11)

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-d8474687d-xkkfx

Unhealthy

Startup probe failed: Get "https://10.132.0.32:8000/health": dial tcp 10.132.0.32:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

LLMInferenceServiceReady

LLMInferenceService [llmisvc-router-managed-test-llm-5b1e8f15] is Ready

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

LLMInferenceServiceReady

LLMInferenceService [auth-enabled-test] is Ready

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-d8474687d-xkkfx

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-enabled-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-router-scheduler-64d4b65cc6-hlfjg

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.48:9003" within 1s: context deadline exceeded
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-qwen2-5-0-5b-rout-a50492e9

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-a50492e9

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-a50492e9

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve

kserve-ci-e2e-test

multus

llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs

Started

Started container main

kserve-ci-e2e-test

deployment-controller

llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-a50492e9

Created

Created v1.Secret kserve-ci-e2e-test/llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd

SuccessfulCreate

Created pod: llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-a50492e9

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-a50492e9

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-a50492e9

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-testb7025ca4d8a6f8f5b2fd08b5581d2678-llmisvc-mode

kserve-ci-e2e-test

deployment-controller

llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler-6d86bd4d9d from 0 to 1

kserve-ci-e2e-test

replicaset-controller

llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler-6d86bd4d9d

SuccessfulCreate

Created pod: llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-a50492e9

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-a50492e9

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-a50492e9

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scheduler

kserve-ci-e2e-test

kubelet

llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs

Created

Created container: main

kserve-ci-e2e-test

multus

llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-a50492e9

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisvb11a9c9832b99b016bc8f8e0ea095712-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-a50492e9

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-a50492e9

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-route

kserve-ci-e2e-test

deployment-controller

auth-invalid-token-test-kserve

ScalingReplicaSet

Scaled up replica set auth-invalid-token-test-kserve-6f6986f4 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

Created v1.Secret kserve-ci-e2e-test/auth-invalid-token-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

Created v1.Deployment kserve-ci-e2e-test/auth-invalid-token-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

Created v1.Service kserve-ci-e2e-test/auth-invalid-token-test-kserve-workload-svc

kserve-ci-e2e-test

replicaset-controller

auth-invalid-token-test-kserve-6f6986f4

SuccessfulCreate

Created pod: auth-invalid-token-test-kserve-6f6986f4-vmpkj

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-54958d97466ldts

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

multus

auth-invalid-token-test-kserve-6f6986f4-vmpkj

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-invalid-token-test-epp-auth-rb

kserve-ci-e2e-test

deployment-controller

auth-invalid-token-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set auth-invalid-token-test-kserve-router-scheduler-54958d9746 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

Created v1.Service kserve-ci-e2e-test/auth-invalid-token-test-epp-service

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-6f6986f4-vmpkj

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-6f6986f4-vmpkj

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/auth-invalid-token-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

Created v1.Deployment kserve-ci-e2e-test/auth-invalid-token-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

Created v1.Role kserve-ci-e2e-test/auth-invalid-token-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/auth-invalid-token-test-epp-rb

kserve-ci-e2e-test

replicaset-controller

auth-invalid-token-test-kserve-router-scheduler-54958d9746

SuccessfulCreate

Created pod: auth-invalid-token-test-kserve-router-scheduler-54958d97466ldts

kserve-ci-e2e-test

multus

auth-invalid-token-test-kserve-router-scheduler-54958d97466ldts

AddedInterface

Add eth0 [10.132.0.36/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-6f6986f4-vmpkj

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-54958d97466ldts

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-54958d97466ldts

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-54958d97466ldts

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-54958d97466ldts

Created

Created container: main

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-54958d97466ldts

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-a50492e9

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-a50492e9] is Ready

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-6f6986f4-vmpkj

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-6f6986f4-vmpkj

Created

Created container: main

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-6f6986f4-vmpkj

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Updated

Updated v1.Secret kserve-ci-e2e-test/auth-invalid-token-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/auth-invalid-token-test-kserve-route
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-invalid-token-test-kserve-shadow-svc

kserve-ci-e2e-test

kubelet

llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-a50492e9

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testb7025ca4d8a6f8f5b2fd08b5581d2678-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

kubelet

llmisvcb11a9c9832b99b016bc8f8e0ea095712-kserve-router-scherk7cs

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc-model-qwen2-5-0-5b-rout-a50492e9-kserve-5d8ffd58dd85rfs

Unhealthy

Readiness probe failed: Get "https://10.134.0.49:8000/health": EOF

kserve-ci-e2e-test

kubelet

llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schewvvrj

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4xwdp7

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-schewvvrj

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test7f54e84970003a6e7372bdbcb574f7ed-llmisvc-rout

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-5b1e8f15-kserve-64df7bddb4xwdp7

Unhealthy

Readiness probe failed: Get "https://10.133.0.26:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x13)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-router-managed-test-llm-4b931143

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-4b931143-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-4b931143-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test8ac8e3d2264ccb939eb021b0b835847c-llmisvc-rout

kserve-ci-e2e-test

replicaset-controller

llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56

SuccessfulCreate

Created pod: llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-kcm8z

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

Created v1.Secret kserve-ci-e2e-test/llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs

kserve-ci-e2e-test

deployment-controller

llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler-68cc9685d6 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-sa

kserve-ci-e2e-test

replicaset-controller

llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler-68cc9685d6

SuccessfulCreate

Created pod: llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-rb

kserve-ci-e2e-test

deployment-controller

llmisvc-router-managed-test-llm-4b931143-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-service

kserve-ci-e2e-test

multus

llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-kcm8z

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-kcm8z

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-kcm8z

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-kcm8z

Created

Created container: main

kserve-ci-e2e-test

multus

llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2

Started

Started container main
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

LLMInferenceServiceReady

LLMInferenceService [llmisvc-router-managed-test-llm-4b931143] is Ready
(x11)

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-6f6986f4-vmpkj

Unhealthy

Startup probe failed: Get "https://10.132.0.35:8000/health": dial tcp 10.132.0.35:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

LLMInferenceServiceReady

LLMInferenceService [auth-invalid-token-test] is Ready

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-invalid-token-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-54958d97466ldts

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-54958d97466ldts

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-6f6986f4-vmpkj

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-6f6986f4-vmpkj

Unhealthy

Readiness probe failed: Get "https://10.132.0.35:8000/health": dial tcp 10.132.0.35:8000: connect: connection refused
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

auth-disabled-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy auth-disabled-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/auth-disabled-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "auth-disabled-test-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/auth-disabled-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

Created v1.Service kserve-ci-e2e-test/auth-disabled-test-kserve-workload-svc

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-68bf46444d-nz2fk

Created

Created container: storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

Created v1.Service kserve-ci-e2e-test/auth-disabled-test-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

Created v1.Deployment kserve-ci-e2e-test/auth-disabled-test-kserve-router-scheduler

kserve-ci-e2e-test

multus

auth-disabled-test-kserve-68bf46444d-nz2fk

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

kserve-ci-e2e-test

replicaset-controller

auth-disabled-test-kserve-68bf46444d

SuccessfulCreate

Created pod: auth-disabled-test-kserve-68bf46444d-nz2fk

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

Created v1.Secret kserve-ci-e2e-test/auth-disabled-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

Created v1.Role kserve-ci-e2e-test/auth-disabled-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-disabled-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-68bf46444d-nz2fk

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

Created v1.Deployment kserve-ci-e2e-test/auth-disabled-test-kserve

kserve-ci-e2e-test

replicaset-controller

auth-disabled-test-kserve-router-scheduler-9bc4884b5

SuccessfulCreate

Created pod: auth-disabled-test-kserve-router-scheduler-9bc4884b5-shml5

kserve-ci-e2e-test

deployment-controller

auth-disabled-test-kserve

ScalingReplicaSet

Scaled up replica set auth-disabled-test-kserve-68bf46444d from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/auth-disabled-test-epp-sa

kserve-ci-e2e-test

deployment-controller

auth-disabled-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set auth-disabled-test-kserve-router-scheduler-9bc4884b5 from 0 to 1

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-68bf46444d-nz2fk

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-router-scheduler-9bc4884b5-shml5

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-router-scheduler-9bc4884b5-shml5

Created

Created container: storage-initializer

kserve-ci-e2e-test

multus

auth-disabled-test-kserve-router-scheduler-9bc4884b5-shml5

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-router-scheduler-9bc4884b5-shml5

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-router-scheduler-9bc4884b5-shml5

Started

Started container main

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-router-scheduler-9bc4884b5-shml5

Created

Created container: main

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-router-scheduler-9bc4884b5-shml5

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-68bf46444d-nz2fk

Created

Created container: main

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-68bf46444d-nz2fk

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-68bf46444d-nz2fk

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/auth-disabled-test-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Updated

Updated v1.Secret kserve-ci-e2e-test/auth-disabled-test-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-disabled-test-kserve-shadow-svc
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f

SuccessfulCreate

Created pod: llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b

kserve-ci-e2e-test

deployment-controller

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98f from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978

Created

Created v1.Secret kserve-ci-e2e-test/llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test76d7f532acb694e4a7bcef75d32cd8a1-llmisvc-mode

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-rb

kserve-ci-e2e-test

replicaset-controller

llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler-6fcb489785

SuccessfulCreate

Created pod: llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schednpfr

kserve-ci-e2e-test

deployment-controller

llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler-6fcb489785 from 0 to 1

kserve-ci-e2e-test

kubelet

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b

Started

Started container main

kserve-ci-e2e-test

multus

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schednpfr

Pulling

Pulling image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2"

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-scheduler

kserve-ci-e2e-test

multus

llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schednpfr

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schednpfr

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" in 1.523s (1.523s including waiting). Image size: 75073927 bytes.

kserve-ci-e2e-test

kubelet

llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schednpfr

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schednpfr

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv08544b88a8d963ffd553cc1f3ed82d16-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-4f8c0978] is Ready

kserve-ci-e2e-test

kubelet

llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schednpfr

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc08544b88a8d963ffd553cc1f3ed82d16-kserve-router-schednpfr

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

kubelet

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978-kserve-5c54ddb98ftfz2b

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4f8c0978

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test76d7f532acb694e4a7bcef75d32cd8a1-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-4b931143-kserve-bd545d56-kcm8z

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test8ac8e3d2264ccb939eb021b0b835847c-llmisvc-rout

kserve-ci-e2e-test

kubelet

llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-sche4pfx2

FailedPreStopHook

PreStopHook failed
(x11)

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-68bf46444d-nz2fk

Unhealthy

Startup probe failed: Get "https://10.132.0.37:8000/health": dial tcp 10.132.0.37:8000: connect: connection refused
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-fb-opt-125m-with-7ca60146

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route" not found

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-ffbdb7db7-cdtzl

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf

Started

Started container storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test5216bfd716f919dc046bc693ceb22e41-llmisvc-mode

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-role

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-ffbdb7db7

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-with-7ca60146-kserve-ffbdb7db7-cdtzl

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-rb

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler-597fc788f8

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-ffbdb7db7-cdtzl

Created

Created container: storage-initializer

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-ffbdb7db7-cdtzl

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-workload-svc

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-with-7ca60146-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-with-7ca60146-kserve-ffbdb7db7 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

Created v1.Secret kserve-ci-e2e-test/llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-ffbdb7db7-cdtzl

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-service

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler-597fc788f8 from 0 to 1

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

LLMInferenceServiceReady

LLMInferenceService [auth-disabled-test] is Ready

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-ffbdb7db7-cdtzl

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-ffbdb7db7-cdtzl

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-ffbdb7db7-cdtzl

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-disabled-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-68bf46444d-nz2fk

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-router-scheduler-9bc4884b5-shml5

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-router-scheduler-9bc4884b5-shml5

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-68bf46444d-nz2fk

Unhealthy

Readiness probe failed: Get "https://10.132.0.37:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x10)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-fb-opt-125m-route-e95b1dc1

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-e95b1dc1

Created

Created v1.Secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-e95b1dc1

Created

Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d48hqx6

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-e95b1dc1

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-e95b1dc1

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d4 from 0 to 1

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d48hqx6

Started

Started container main

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d48hqx6

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d48hqx6

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d48hqx6

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-e95b1dc1

Created

Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-e95b1dc1

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-e95b1dc1

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-fb-opt-125m-route-e95b1dc1] is Ready

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-66874c76d48hqx6

Killing

Stopping container main
(x7)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-ffbdb7db7-cdtzl

Unhealthy

Startup probe failed: Get "https://10.132.0.39:8000/health": dial tcp 10.132.0.39:8000: connect: connection refused
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-fb-opt-125m-route-87882a8e

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-service

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-55fbb5c846

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-route-87882a8e-kserve-55fbb5c846qq7vl

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-55fbb5c846qq7vl

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-55fbb5c846qq7vl

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test21fe6730fe484f3a92b1a16afe1bac8f-llmisvc-mode

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-route-87882a8e-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-route-87882a8e-kserve-55fbb5c846 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

Created v1.Secret kserve-ci-e2e-test/llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler

kserve-ci-e2e-test

replicaset-controller

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler-7b78b68f76

SuccessfulCreate

Created pod: llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve

kserve-ci-e2e-test

deployment-controller

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler-7b78b68f76 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-rb

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-55fbb5c846qq7vl

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-55fbb5c846qq7vl

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

multus

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-55fbb5c846qq7vl

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-55fbb5c846qq7vl

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-55fbb5c846qq7vl

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-fb-opt-125m-with-7ca60146] is Ready

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-ffbdb7db7-cdtzl

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test5216bfd716f919dc046bc693ceb22e41-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schewzkwf

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-ffbdb7db7-cdtzl

Unhealthy

Readiness probe failed: Get "https://10.132.0.39:8000/health": dial tcp 10.132.0.39:8000: connect: connection refused
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-fb-opt-125m-with-ba4d693a

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route" not found

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler-65cf48d687

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

Created v1.Secret kserve-ci-e2e-test/llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-7bcb69f67b-q2jnj

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-7bcb69f67b-q2jnj

Created

Created container: storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-service

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-7bcb69f67b-q2jnj

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-workload-svc

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-7bcb69f67b-q2jnj

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-7bcb69f67b

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-7bcb69f67b-q2jnj

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-sa

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm

Started

Started container storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test05addb65ba05195619f26ef266e8fc04-llmisvc-mode

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-7bcb69f67b from 0 to 1

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler-65cf48d687 from 0 to 1

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-7bcb69f67b-q2jnj

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-7bcb69f67b-q2jnj

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-7bcb69f67b-q2jnj

Created

Created container: main
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-shadow-svc
(x11)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-55fbb5c846qq7vl

Unhealthy

Startup probe failed: Get "https://10.132.0.40:8000/health": dial tcp 10.132.0.40:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-fb-opt-125m-route-87882a8e] is Ready

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-55fbb5c846qq7vl

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test21fe6730fe484f3a92b1a16afe1bac8f-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-sche8nfrs

Killing

Stopping container main
(x7)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-7bcb69f67b-q2jnj

Unhealthy

Startup probe failed: Get "https://10.132.0.41:8000/health": dial tcp 10.132.0.41:8000: connect: connection refused
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-655f7c58b4-57g8x

BackOff

Back-off restarting failed container istio-proxy in pod openshift-ai-inference-openshift-default-655f7c58b4-57g8x_openshift-ingress(f1d4abbb-fa80-4dff-8760-4c5e5f0d7c13)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-55fbb5c846qq7vl

Unhealthy

Readiness probe failed: Get "https://10.132.0.40:8000/health": context deadline exceeded

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-fb-opt-125m-with-ba4d693a] is Ready
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

custom-route-timeout-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-test-kserve-route" not found

kserve-ci-e2e-test

replicaset-controller

custom-route-timeout-test-kserve-router-scheduler-5599744d7

SuccessfulCreate

Created pod: custom-route-timeout-test-kserve-router-scheduler-5599744dttprw

kserve-ci-e2e-test

deployment-controller

custom-route-timeout-test-kserve

ScalingReplicaSet

Scaled up replica set custom-route-timeout-test-kserve-bbd5bdc5b from 0 to 1

kserve-ci-e2e-test

deployment-controller

custom-route-timeout-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set custom-route-timeout-test-kserve-router-scheduler-5599744d7 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve

kserve-ci-e2e-test

multus

custom-route-timeout-test-kserve-bbd5bdc5b-t6rkv

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.Role kserve-ci-e2e-test/custom-route-timeout-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-bbd5bdc5b-t6rkv

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-bbd5bdc5b-t6rkv

Created

Created container: storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-epp-service

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-bbd5bdc5b-t6rkv

Started

Started container storage-initializer

kserve-ci-e2e-test

replicaset-controller

custom-route-timeout-test-kserve-bbd5bdc5b

SuccessfulCreate

Created pod: custom-route-timeout-test-kserve-bbd5bdc5b-t6rkv

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-kserve-workload-svc

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-5599744dttprw

Created

Created container: main

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-5599744dttprw

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-5599744dttprw

Started

Started container main

kserve-ci-e2e-test

multus

custom-route-timeout-test-kserve-router-scheduler-5599744dttprw

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-5599744dttprw

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-5599744dttprw

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-5599744dttprw

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-bbd5bdc5b-t6rkv

Created

Created container: main

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-bbd5bdc5b-t6rkv

Started

Started container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-bbd5bdc5b-t6rkv

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Updated

Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-test-kserve-shadow-svc
(x11)

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-bbd5bdc5b-t6rkv

Unhealthy

Startup probe failed: Get "https://10.132.0.42:8000/health": dial tcp 10.132.0.42:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test05addb65ba05195619f26ef266e8fc04-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-7bcb69f67b-q2jnj

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-sche2vbzm

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

LLMInferenceServiceReady

LLMInferenceService [custom-route-timeout-test] is Ready

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-5599744dttprw

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-5599744dttprw

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-bbd5bdc5b-t6rkv

Killing

Stopping container main

kserve-ci-e2e-test

job-controller

e2e-pvc-model-download

SuccessfulCreate

Created pod: e2e-pvc-model-download-9dx26

kserve-ci-e2e-test

persistentvolume-controller

e2e-pvc-model-storage

WaitForFirstConsumer

waiting for first consumer to be created before binding

kserve-ci-e2e-test

persistentvolume-controller

e2e-pvc-model-storage

ExternalProvisioning

Waiting for a volume to be created either by the external provisioner 'ebs.csi.aws.com' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered.

kserve-ci-e2e-test

ebs.csi.aws.com_aws-ebs-csi-driver-controller-564866f9b6-tqnr4_f420500d-b6c1-4335-9b84-0352757a07ad

e2e-pvc-model-storage

Provisioning

External provisioner is provisioning volume for claim "kserve-ci-e2e-test/e2e-pvc-model-storage"

kserve-ci-e2e-test

ebs.csi.aws.com_aws-ebs-csi-driver-controller-564866f9b6-tqnr4_f420500d-b6c1-4335-9b84-0352757a07ad

e2e-pvc-model-storage

ProvisioningSucceeded

Successfully provisioned volume pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-bbd5bdc5b-t6rkv

Unhealthy

Readiness probe failed: Get "https://10.132.0.42:8000/health": dial tcp 10.132.0.42:8000: connect: connection refused

kserve-ci-e2e-test

attachdetach-controller

e2e-pvc-model-download-9dx26

SuccessfulAttachVolume

AttachVolume.Attach succeeded for volume "pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb"
(x4)

kserve-ci-e2e-test

gateway_labeler_controller

router-gateway-1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway router-gateway-1

kserve-ci-e2e-test

kubelet

e2e-pvc-model-download-9dx26

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

e2e-pvc-model-download-9dx26

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

e2e-pvc-model-download-9dx26

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

multus

e2e-pvc-model-download-9dx26

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

kserve-ci-e2e-test

job-controller

e2e-pvc-model-download

Completed

Job completed

kserve-ci-e2e-test

deployment-controller

router-with-refs-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set router-with-refs-test-kserve-router-scheduler-5594f94979 from 0 to 1

kserve-ci-e2e-test

deployment-controller

router-with-refs-test-kserve

ScalingReplicaSet

Scaled up replica set router-with-refs-test-kserve-7948b44cf6 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.Role kserve-ci-e2e-test/router-with-refs-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb

kserve-ci-e2e-test

replicaset-controller

router-with-refs-test-kserve-7948b44cf6

SuccessfulCreate

Created pod: router-with-refs-test-kserve-7948b44cf6-7jnwf

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.Service kserve-ci-e2e-test/router-with-refs-test-kserve-workload-svc

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-7948b44cf6-7jnwf

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-5594f94979-fqs8s

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-5594f94979-fqs8s

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-7948b44cf6-7jnwf

Created

Created container: storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.Service kserve-ci-e2e-test/router-with-refs-test-epp-service

kserve-ci-e2e-test

multus

router-with-refs-test-kserve-router-scheduler-5594f94979-fqs8s

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

kserve-ci-e2e-test

replicaset-controller

router-with-refs-test-kserve-router-scheduler-5594f94979

SuccessfulCreate

Created pod: router-with-refs-test-kserve-router-scheduler-5594f94979-fqs8s

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-5594f94979-fqs8s

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-7948b44cf6-7jnwf

Started

Started container storage-initializer

kserve-ci-e2e-test

multus

router-with-refs-test-kserve-7948b44cf6-7jnwf

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-5594f94979-fqs8s

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-5594f94979-fqs8s

Created

Created container: main

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-5594f94979-fqs8s

Started

Started container main
(x5)

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-test-kserve-shadow-svc

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-7948b44cf6-7jnwf

Started

Started container main

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-7948b44cf6-7jnwf

Created

Created container: main

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-7948b44cf6-7jnwf

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine
(x14)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-pvc-router-manage-59b9d263

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-59b9d263-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-59b9d263-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-59b9d263

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-testc9569cf4801efc0ed27b2f25ffaee875-llmisvc-mode

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-59b9d263

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-59b9d263

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-59b9d263

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-59b9d263

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-role

kserve-ci-e2e-test

kubelet

llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schejh6wz

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-59b9d263

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-sa

kserve-ci-e2e-test

replicaset-controller

llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler-5f555d4d85

SuccessfulCreate

Created pod: llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schejh6wz

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-59b9d263

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-59b9d263

Created

Created v1.Secret kserve-ci-e2e-test/llmisv8bf079eb6eda4debfb4ef5bb7817824c-kserve-self-signed-certs

kserve-ci-e2e-test

deployment-controller

llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-scheduler-5f555d4d85 from 0 to 1

kserve-ci-e2e-test

deployment-controller

llmisvc-model-pvc-router-manage-59b9d263-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-59b9d263

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-epp-service

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d

SuccessfulCreate

Created pod: llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d9kvx5

kserve-ci-e2e-test

multus

llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schejh6wz

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schejh6wz

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schejh6wz

Started

Started container main

kserve-ci-e2e-test

attachdetach-controller

llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d9kvx5

SuccessfulAttachVolume

AttachVolume.Attach succeeded for volume "pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb"

kserve-ci-e2e-test

attachdetach-controller

llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schejh6wz

FailedAttachVolume

Multi-Attach error for volume "pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d9kvx5

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d9kvx5

Started

Started container main

kserve-ci-e2e-test

multus

llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d9kvx5

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d9kvx5

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d9kvx5

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Updated

Updated v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-59b9d263

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-59b9d263

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv8bf079eb6eda4debfb4ef5bb7817824c-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-59b9d263

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-59b9d263-kserve-shadow-svc
(x12)

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-7948b44cf6-7jnwf

Unhealthy

Startup probe failed: Get "https://10.132.0.43:8000/health": dial tcp 10.132.0.43:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

LLMInferenceServiceReady

LLMInferenceService [router-with-refs-test] is Ready

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-5594f94979-fqs8s

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-7948b44cf6-7jnwf

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-5594f94979-fqs8s

Killing

Stopping container main
(x12)

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d9kvx5

Unhealthy

Startup probe failed: Get "https://10.132.0.45:8000/health": dial tcp 10.132.0.45:8000: connect: connection refused
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-fb-opt-125m-route-50bc673d

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route" not found

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5f85dddfb9 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

Created v1.Secret kserve-ci-e2e-test/llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-role

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-rb

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-route-50bc673d-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-route-50bc673d-kserve-bb84757f8 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5f85dddfb9

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5f7cvrx

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test00d7278d8a22c4e39146a6b0eb840f45-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5f7cvrx

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5f7cvrx

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-bb84757f8

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-route-50bc673d-kserve-bb84757f8-mvk8h

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-bb84757f8-mvk8h

Pulling

Pulling image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2"

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-bb84757f8-mvk8h

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

kserve-ci-e2e-test

replicaset-controller

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler-78f7f9db6d

SuccessfulCreate

Created pod: llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc

kserve-ci-e2e-test

deployment-controller

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler-78f7f9db6d from 0 to 1

kserve-ci-e2e-test

kubelet

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-bb84757f8-mvk8h

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" in 779ms (779ms including waiting). Image size: 44914394 bytes.

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-bb84757f8-mvk8h

Created

Created container: llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-bb84757f8-mvk8h

Started

Started container llm-d-routing-sidecar

kserve-ci-e2e-test

multus

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5f7cvrx

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5f7cvrx

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-bb84757f8-mvk8h

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-bb84757f8-mvk8h

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-bb84757f8-mvk8h

Started

Started container storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-59b9d263

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-pvc-router-manage-59b9d263] is Ready

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5f7cvrx

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5f7cvrx

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5f7cvrx

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-bb84757f8-mvk8h

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-bb84757f8-mvk8h

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-bb84757f8-mvk8h

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs
(x10)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route

kserve-ci-e2e-test

kubelet

llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schejh6wz

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d9kvx5

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc8bf079eb6eda4debfb4ef5bb7817824c-kserve-router-schejh6wz

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-59b9d263

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testc9569cf4801efc0ed27b2f25ffaee875-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-59b9d263-kserve-585587bc9d9kvx5

Unhealthy

Readiness probe failed: Get "https://10.132.0.45:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-pvc-router-manage-e8706282

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-e8706282-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-e8706282-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-e8706282

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-rb

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c

SuccessfulCreate

Created pod: llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-6j9zb

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-e8706282

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-testf5d060a5eb39a04e074b78907a1556a6-llmisvc-mode

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79497db4cc

SuccessfulCreate

Created pod: llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79j8spp

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-e8706282

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-e8706282

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-prefill

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-e8706282

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve

kserve-ci-e2e-test

deployment-controller

llmisvc-model-pvc-router-manage-e8706282-kserve-prefill

ScalingReplicaSet

Scaled up replica set llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79497db4cc from 0 to 1

kserve-ci-e2e-test

deployment-controller

llmisvc-model-pvc-router-manage-e8706282-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-e8706282

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-e8706282

Created

Created v1.Secret kserve-ci-e2e-test/llmisvb19f98874e050eec8ca94d49676113f0-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-e8706282

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-e8706282

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-role

kserve-ci-e2e-test

replicaset-controller

llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler-67b4bb9646

SuccessfulCreate

Created pod: llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheln89s

kserve-ci-e2e-test

multus

llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheln89s

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

kserve-ci-e2e-test

deployment-controller

llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheduler-67b4bb9646 from 0 to 1

kserve-ci-e2e-test

kubelet

llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheln89s

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheln89s

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheln89s

Started

Started container main

kserve-ci-e2e-test

attachdetach-controller

llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-6j9zb

SuccessfulAttachVolume

AttachVolume.Attach succeeded for volume "pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb"

kserve-ci-e2e-test

attachdetach-controller

llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79j8spp

SuccessfulAttachVolume

AttachVolume.Attach succeeded for volume "pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb"

kserve-ci-e2e-test

attachdetach-controller

llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheln89s

FailedAttachVolume

Multi-Attach error for volume "pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-6j9zb, llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79j8spp

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79j8spp

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-6j9zb

Created

Created container: llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79j8spp

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79j8spp

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-6j9zb

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

multus

llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-6j9zb

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-6j9zb

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-6j9zb

Pulled

Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-6j9zb

Started

Started container main

kserve-ci-e2e-test

multus

llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79j8spp

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-6j9zb

Started

Started container llm-d-routing-sidecar

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-e8706282

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-route
(x2)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-e8706282

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisvb19f98874e050eec8ca94d49676113f0-kserve-self-signed-certs
(x10)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-e8706282

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-e8706282-kserve-shadow-svc
(x17)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5f7cvrx

Unhealthy

Startup probe failed: Get "https://10.132.0.47:8000/health": dial tcp 10.132.0.47:8000: connect: connection refused
(x18)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-bb84757f8-mvk8h

Unhealthy

Startup probe failed: Get "https://10.132.0.46:8001/health": dial tcp 10.132.0.46:8001: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-fb-opt-125m-route-50bc673d] is Ready

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test00d7278d8a22c4e39146a6b0eb840f45-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-bb84757f8-mvk8h

Killing

Stopping container llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-bb84757f8-mvk8h

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-5f7cvrx

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-schentcfc

FailedPreStopHook

PreStopHook failed
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

custom-route-timeout-pd-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-pd-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-pd-test-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.Role kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-role

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.Service kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-workload-svc

kserve-ci-e2e-test

multus

custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

kserve-ci-e2e-test

deployment-controller

custom-route-timeout-pd-test-kserve

ScalingReplicaSet

Scaled up replica set custom-route-timeout-pd-test-kserve-bf6648c8f from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-rb

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-bf6648c8f-l76d2

Created

Created container: llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-bf6648c8f-l76d2

Started

Started container llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-bf6648c8f-l76d2

Pulled

Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

multus

custom-route-timeout-pd-test-kserve-bf6648c8f-l76d2

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

replicaset-controller

custom-route-timeout-pd-test-kserve-router-scheduler-6546688786

SuccessfulCreate

Created pod: custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx

kserve-ci-e2e-test

deployment-controller

custom-route-timeout-pd-test-kserve-prefill

ScalingReplicaSet

Scaled up replica set custom-route-timeout-pd-test-kserve-prefill-84bf95b496 from 0 to 1

kserve-ci-e2e-test

replicaset-controller

custom-route-timeout-pd-test-kserve-prefill-84bf95b496

SuccessfulCreate

Created pod: custom-route-timeout-pd-test-kserve-prefill-84bf95b496-tchc8

kserve-ci-e2e-test

deployment-controller

custom-route-timeout-pd-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set custom-route-timeout-pd-test-kserve-router-scheduler-6546688786 from 0 to 1

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-84bf95b496-tchc8

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-84bf95b496-tchc8

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-84bf95b496-tchc8

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

multus

custom-route-timeout-pd-test-kserve-prefill-84bf95b496-tchc8

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx

Started

Started container storage-initializer

kserve-ci-e2e-test

replicaset-controller

custom-route-timeout-pd-test-kserve-bf6648c8f

SuccessfulCreate

Created pod: custom-route-timeout-pd-test-kserve-bf6648c8f-l76d2
(x18)

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-6j9zb

Unhealthy

Startup probe failed: Get "https://10.132.0.48:8001/health": dial tcp 10.132.0.48:8001: connect: connection refused

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx

Created

Created container: main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-bf6648c8f-l76d2

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-bf6648c8f-l76d2

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-bf6648c8f-l76d2

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine
(x18)

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79j8spp

Unhealthy

Startup probe failed: Get "https://10.132.0.49:8000/health": dial tcp 10.132.0.49:8000: connect: connection refused

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx

Started

Started container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-84bf95b496-tchc8

Started

Started container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-84bf95b496-tchc8

Created

Created container: main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-84bf95b496-tchc8

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-bf6648c8f-l76d2

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-bf6648c8f-l76d2

Created

Created container: main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-bf6648c8f-l76d2

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Updated

Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs
(x10)

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-e8706282

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-pvc-router-manage-e8706282] is Ready

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-6j9zb

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-e8706282-kserve-7db79954c-6j9zb

Killing

Stopping container llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheln89s

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-e8706282

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testf5d060a5eb39a04e074b78907a1556a6-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvcb19f98874e050eec8ca94d49676113f0-kserve-router-scheln89s

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-e8706282-kserve-prefill-79j8spp

Killing

Stopping container main
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-pvc-router-manage-2577e794

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-pvc-router-manage-2577e794-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-pvc-router-manage-2577e794-kserve-route" not found

kserve-ci-e2e-test

statefulset-controller

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0

SuccessfulCreate

create Pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1 in StatefulSet llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 successful

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-2577e794

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn

kserve-ci-e2e-test

statefulset-controller

llmisvc-model-pvc-router-manage-2577e794-kserve-mn

SuccessfulCreate

create Pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0 in StatefulSet llmisvc-model-pvc-router-manage-2577e794-kserve-mn successful

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-pvc-router-manage-2577e794-kserve-mn

GroupsProgressing

Created worker statefulset for leader pod llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-pvc-router-manage-2577e794-kserve-mn

CreatingRevision

Creating revision with key 686d468674 for a newly created LeaderWorkerSet

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-2577e794

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test37591b20e96e9663d45a730d03070f1e-llmisvc-mode

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-2577e794

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn-scc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-2577e794

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-sa
(x2)

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-pvc-router-manage-2577e794-kserve-mn

GroupsProgressing

Replicas are progressing, with 0 groups ready of total 1 groups

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-2577e794

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-2577e794

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-2577e794

Created

Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-mn

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-2577e794

Created

Created v1.Secret kserve-ci-e2e-test/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-pvc-router-manage-2577e794-kserve-mn

GroupsProgressing

Created leader statefulset llmisvc-model-pvc-router-manage-2577e794-kserve-mn

kserve-ci-e2e-test

replicaset-controller

llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler-7dbcb75dbc

SuccessfulCreate

Created pod: llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheklks8

kserve-ci-e2e-test

kubelet

llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheklks8

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

multus

llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheklks8

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

kserve-ci-e2e-test

deployment-controller

llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheduler-7dbcb75dbc from 0 to 1

kserve-ci-e2e-test

kubelet

llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheklks8

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-2577e794

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-epp-rb

kserve-ci-e2e-test

kubelet

llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheklks8

Started

Started container main

kserve-ci-e2e-test

attachdetach-controller

llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheklks8

FailedAttachVolume

Multi-Attach error for volume "pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb" Volume is already used by pod(s) llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0, llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1

kserve-ci-e2e-test

attachdetach-controller

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1

SuccessfulAttachVolume

AttachVolume.Attach succeeded for volume "pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb"

kserve-ci-e2e-test

attachdetach-controller

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0

SuccessfulAttachVolume

AttachVolume.Attach succeeded for volume "pvc-6f1bb542-bfcb-4c3d-b024-6b18bd08bbeb"

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

multus

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

multus

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-2577e794

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-route
(x8)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-2577e794

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-pvc-router-manage-2577e794-kserve-shadow-svc
(x2)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-2577e794

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs
(x20)

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-84bf95b496-tchc8

Unhealthy

Startup probe failed: Get "https://10.132.0.51:8000/health": dial tcp 10.132.0.51:8000: connect: connection refused
(x20)

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-bf6648c8f-l76d2

Unhealthy

Startup probe failed: Get "https://10.132.0.50:8001/health": dial tcp 10.132.0.50:8001: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

LLMInferenceServiceReady

LLMInferenceService [custom-route-timeout-pd-test] is Ready
(x18)

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0

Unhealthy

Startup probe failed: Get "https://10.132.0.52:8000/health": dial tcp 10.132.0.52:8000: connect: connection refused

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-pvc-router-manage-2577e794-kserve-mn

AllGroupsReady

All replicas are ready, with 1 groups ready of total 1 groups

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-bf6648c8f-l76d2

Killing

Stopping container llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-84bf95b496-tchc8

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-65466ct4gx

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-bf6648c8f-l76d2

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-2577e794

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-pvc-router-manage-2577e794] is Ready

kserve-ci-e2e-test

replicaset-controller

router-gateway-2-openshift-default-684dc9b4b9

SuccessfulCreate

Created pod: router-gateway-2-openshift-default-684dc9b4b9-j47sj

kserve-ci-e2e-test

deployment-controller

router-gateway-2-openshift-default

ScalingReplicaSet

Scaled up replica set router-gateway-2-openshift-default-684dc9b4b9 from 0 to 1

kserve-ci-e2e-test

service-controller

router-gateway-2-openshift-default

EnsuringLoadBalancer

Ensuring load balancer

kserve-ci-e2e-test

gateway_labeler_controller

router-gateway-2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway router-gateway-2

kserve-ci-e2e-test

multus

router-gateway-2-openshift-default-684dc9b4b9-j47sj

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

kserve-ci-e2e-test

service-controller

router-gateway-2-openshift-default

EnsuredLoadBalancer

Ensured load balancer
(x2)

kserve-ci-e2e-test

kubelet

router-gateway-2-openshift-default-684dc9b4b9-j47sj

Started

Started container istio-proxy
(x2)

kserve-ci-e2e-test

kubelet

router-gateway-2-openshift-default-684dc9b4b9-j47sj

Created

Created container: istio-proxy
(x2)

kserve-ci-e2e-test

kubelet

router-gateway-2-openshift-default-684dc9b4b9-j47sj

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine
(x5)

kserve-ci-e2e-test

kubelet

router-gateway-2-openshift-default-684dc9b4b9-j47sj

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused

kserve-ci-e2e-test

replicaset-controller

router-with-refs-pd-test-kserve-router-scheduler-7b9956b846

SuccessfulCreate

Created pod: router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr

kserve-ci-e2e-test

deployment-controller

router-with-refs-pd-test-kserve

ScalingReplicaSet

Scaled up replica set router-with-refs-pd-test-kserve-88fcd5785 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.Service kserve-ci-e2e-test/router-with-refs-pd-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-pd-test-kserve-rb

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.Role kserve-ci-e2e-test/router-with-refs-pd-test-kserve-role

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs

kserve-ci-e2e-test

deployment-controller

router-with-refs-pd-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set router-with-refs-pd-test-kserve-router-scheduler-7b9956b846 from 0 to 1

kserve-ci-e2e-test

deployment-controller

router-with-refs-pd-test-kserve-prefill

ScalingReplicaSet

Scaled up replica set router-with-refs-pd-test-kserve-prefill-6f65776896 from 0 to 1

kserve-ci-e2e-test

replicaset-controller

router-with-refs-pd-test-kserve-prefill-6f65776896

SuccessfulCreate

Created pod: router-with-refs-pd-test-kserve-prefill-6f65776896-vzvsg

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-6f65776896-vzvsg

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-6f65776896-vzvsg

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-6f65776896-vzvsg

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

multus

router-with-refs-pd-test-kserve-prefill-6f65776896-vzvsg

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

kserve-ci-e2e-test

replicaset-controller

router-with-refs-pd-test-kserve-88fcd5785

SuccessfulCreate

Created pod: router-with-refs-pd-test-kserve-88fcd5785-4gknp

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-88fcd5785-4gknp

Started

Started container llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-88fcd5785-4gknp

Created

Created container: llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-88fcd5785-4gknp

Pulled

Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

multus

router-with-refs-pd-test-kserve-88fcd5785-4gknp

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr

Started

Started container storage-initializer

kserve-ci-e2e-test

multus

router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-88fcd5785-4gknp

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-88fcd5785-4gknp

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-88fcd5785-4gknp

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr

Created

Created container: main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr

Started

Started container main
(x9)

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-pd-test-kserve-shadow-svc

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-6f65776896-vzvsg

Started

Started container main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-6f65776896-vzvsg

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-6f65776896-vzvsg

Created

Created container: main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-88fcd5785-4gknp

Created

Created container: main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-88fcd5785-4gknp

Started

Started container main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-88fcd5785-4gknp

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Updated

Updated v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheklks8

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc1dc4269d1ada5f2d28562215d180c57f-kserve-router-scheklks8

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-pvc-router-manage-2577e794

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test37591b20e96e9663d45a730d03070f1e-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1

FailedToRetrieveImagePullSecret

Unable to retrieve some image pull secrets (llmisvc-model-pvc-router-manage-2577e7-b09f84b1-dockercfg-ph46t); attempting to pull the image may not succeed.

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0

Unhealthy

Readiness probe failed: Get "https://10.132.0.52:8000/health": dial tcp 10.132.0.52:8000: connect: connection refused

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0

Unhealthy

Readiness probe failed: Get "https://10.132.0.52:8000/health": context deadline exceeded
(x6)

kserve-ci-e2e-test

kubelet

llmisvc-model-pvc-router-manage-2577e794-kserve-mn-0-1

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "llmisv1dc4269d1ada5f2d28562215d180c57f-kserve-self-signed-certs" not found

kserve-ci-e2e-test

LLMInferenceServiceController

conv-test-v1a1-to-v1a2

UpdateFailed

Failed to update status for LLMInferenceService "conv-test-v1a1-to-v1a2": llminferenceservices.serving.kserve.io "conv-test-v1a1-to-v1a2" not found

kserve-ci-e2e-test

LLMInferenceServiceController

conv-test-lora-crit

UpdateFailed

Failed to update status for LLMInferenceService "conv-test-lora-crit": llminferenceservices.serving.kserve.io "conv-test-lora-crit" not found

kserve-ci-e2e-test

LLMInferenceServiceController

conv-test-criticality

UpdateFailed

Failed to update status for LLMInferenceService "conv-test-criticality": Operation cannot be fulfilled on llminferenceservices.serving.kserve.io "conv-test-criticality": the object has been modified; please apply your changes to the latest version and try again

kserve-ci-e2e-test

LLMInferenceServiceController

conv-test-round-trip

UpdateFailed

Failed to update status for LLMInferenceService "conv-test-round-trip": llminferenceservices.serving.kserve.io "conv-test-round-trip" not found

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-8486474f84-czrmh

Created

Created container: storage-initializer

kserve-ci-e2e-test

replicaset-controller

stop-feature-test-kserve-router-scheduler-7bb5b6598f

SuccessfulCreate

Created pod: stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44

Started

Started container storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/stop-feature-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.Role kserve-ci-e2e-test/stop-feature-test-epp-role

kserve-ci-e2e-test

multus

stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44

Created

Created container: storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-stop-feature-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-8486474f84-czrmh

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service

kserve-ci-e2e-test

multus

stop-feature-test-kserve-8486474f84-czrmh

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-8486474f84-czrmh

Started

Started container storage-initializer

kserve-ci-e2e-test

replicaset-controller

stop-feature-test-kserve-8486474f84

SuccessfulCreate

Created pod: stop-feature-test-kserve-8486474f84-czrmh

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

deployment-controller

stop-feature-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set stop-feature-test-kserve-router-scheduler-7bb5b6598f from 0 to 1

kserve-ci-e2e-test

deployment-controller

stop-feature-test-kserve

ScalingReplicaSet

Scaled up replica set stop-feature-test-kserve-8486474f84 from 0 to 1

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44

Started

Started container main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44

Created

Created container: main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-8486474f84-czrmh

Created

Created container: main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-8486474f84-czrmh

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-8486474f84-czrmh

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Updated

Updated v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/stop-feature-test-kserve-shadow-svc
(x15)

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-88fcd5785-4gknp

Unhealthy

Startup probe failed: Get "https://10.132.0.54:8001/health": dial tcp 10.132.0.54:8001: connect: connection refused
(x15)

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-6f65776896-vzvsg

Unhealthy

Startup probe failed: Get "https://10.132.0.55:8000/health": dial tcp 10.132.0.55:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

LLMInferenceServiceReady

LLMInferenceService [router-with-refs-pd-test] is Ready

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-88fcd5785-4gknp

Killing

Stopping container llm-d-routing-sidecar

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-7b9956b84w4fkr

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-6f65776896-vzvsg

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-88fcd5785-4gknp

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c86ddcf67nm9lm

Started

Started container storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-3c960099

Created

Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-route

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c86ddcf67nm9lm

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c86ddcf67nm9lm

Created

Created container: storage-initializer

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c86ddcf67

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c86ddcf67nm9lm

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-3c960099

Created

Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-workload-svc

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c86ddcf67nm9lm

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-3c960099

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-workload-svc

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-route-3c960099-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c86ddcf67 from 0 to 1
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-fb-opt-125m-route-3c960099

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-3c960099-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-3c960099-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-3c960099

Created

Created v1.Secret kserve-ci-e2e-test/llmisvd10b93c8eba12f87c3a350a5cae2ee0c-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-3c960099

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c86ddcf67nm9lm

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c86ddcf67nm9lm

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c86ddcf67nm9lm

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-3c960099

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisvd10b93c8eba12f87c3a350a5cae2ee0c-kserve-self-signed-certs
(x11)

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-8486474f84-czrmh

Unhealthy

Startup probe failed: Get "https://10.132.0.56:8000/health": dial tcp 10.132.0.56:8000: connect: connection refused

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-8486474f84-czrmh

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

LLMInferenceServiceReady

LLMInferenceService [stop-feature-test] is Ready

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Error

Reconciliation failed: failed to reconcile networking: failed to reconcile scheduler: failed to build expected scheduler deployment: failed to attach model artifacts to scheduler deployment: secrets "stop-feature-test-epp-sa-dockercfg-5q9g5" not found

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

LLMInferenceServiceNotReady

LLMInferenceService [stop-feature-test] is no longer Ready because of: MainWorkloadReady, PrefillWorkerWorkloadReady, PrefillWorkloadReady, RouterReady, SchedulerWorkloadReady, WorkerWorkloadReady, WorkloadsReady

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-8486474f84-czrmh

Unhealthy

Readiness probe failed: Get "https://10.132.0.56:8000/health": dial tcp 10.132.0.56:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.InferencePool kserve-ci-e2e-test/stop-feature-test-inference-pool

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7bb5b6598f-cxj44

Killing

Stopping container main
(x23)

kserve-ci-e2e-test

OpenDataHubModelController

stop-feature-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy stop-feature-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "stop-feature-test-kserve-route" not found

kserve-ci-e2e-test

replicaset-controller

stop-feature-test-kserve-8486474f84

SuccessfulCreate

Created pod: stop-feature-test-kserve-8486474f84-dz7zq

kserve-ci-e2e-test

deployment-controller

stop-feature-test-kserve

ScalingReplicaSet

Scaled up replica set stop-feature-test-kserve-8486474f84 from 0 to 1

kserve-ci-e2e-test

deployment-controller

stop-feature-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set stop-feature-test-kserve-router-scheduler-7bb5b6598f from 0 to 1

kserve-ci-e2e-test

replicaset-controller

stop-feature-test-kserve-router-scheduler-7bb5b6598f

SuccessfulCreate

Created pod: stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq

kserve-ci-e2e-test

multus

stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq

AddedInterface

Add eth0 [10.134.0.63/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-8486474f84-dz7zq

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq

Started

Started container storage-initializer

kserve-ci-e2e-test

multus

stop-feature-test-kserve-8486474f84-dz7zq

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-8486474f84-dz7zq

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-8486474f84-dz7zq

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq

Started

Started container main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq

Created

Created container: main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-8486474f84-dz7zq

Started

Started container main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-8486474f84-dz7zq

Created

Created container: main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-8486474f84-dz7zq

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine
(x11)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c86ddcf67nm9lm

Unhealthy

Startup probe failed: Get "https://10.132.0.57:8000/health": dial tcp 10.132.0.57:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-3c960099

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-fb-opt-125m-route-3c960099] is Ready

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c86ddcf67nm9lm

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-3c960099-kserve-7c86ddcf67nm9lm

Unhealthy

Readiness probe failed: Get "https://10.132.0.57:8000/health": dial tcp 10.132.0.57:8000: connect: connection refused
(x11)

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-8486474f84-dz7zq

Unhealthy

Startup probe failed: Get "https://10.132.0.58:8000/health": dial tcp 10.132.0.58:8000: connect: connection refused
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-fb-opt-125m-route-dc21cb14

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test386bd5808c5c450f11fd8632e1f821fb-llmisvc-mode

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn

CreatingRevision

Creating revision with key 85976476fb for a newly created LeaderWorkerSet
(x2)

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn

GroupsProgressing

Replicas are progressing, with 0 groups ready of total 1 groups

kserve-ci-e2e-test

statefulset-controller

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn

SuccessfulCreate

create Pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 in StatefulSet llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn successful

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn

GroupsProgressing

Created worker statefulset for leader pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

kserve-ci-e2e-test

statefulset-controller

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

SuccessfulCreate

create Pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 in StatefulSet llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 successful

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

Created v1.Secret kserve-ci-e2e-test/llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-scc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-sa

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn

GroupsProgressing

Created leader statefulset llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

Created

Created container: storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-role

kserve-ci-e2e-test

kubelet

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

AddedInterface

Add eth0 [10.132.0.59/23] from ovn-kubernetes

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

AddedInterface

Add eth0 [10.132.0.60/23] from ovn-kubernetes

kserve-ci-e2e-test

replicaset-controller

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler-8445d86596

SuccessfulCreate

Created pod: llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw

kserve-ci-e2e-test

deployment-controller

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler-8445d86596 from 0 to 1

kserve-ci-e2e-test

multus

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw

AddedInterface

Add eth0 [10.134.0.64/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs
(x8)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7bb5b6598f-9j9zq

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-8486474f84-dz7zq

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-8486474f84-dz7zq

Unhealthy

Readiness probe failed: Get "https://10.132.0.58:8000/health": dial tcp 10.132.0.58:8000: connect: connection refused
(x10)

kserve-ci-e2e-test

OpenDataHubModelController

lora-single-adapter-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy lora-single-adapter-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/lora-single-adapter-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "lora-single-adapter-test-kserve-route" not found

kserve-ci-e2e-test

replicaset-controller

lora-single-adapter-test-kserve-6b64c6f8b9

SuccessfulCreate

Created pod: lora-single-adapter-test-kserve-6b64c6f8b9-2lb72

kserve-ci-e2e-test

deployment-controller

lora-single-adapter-test-kserve

ScalingReplicaSet

Scaled up replica set lora-single-adapter-test-kserve-6b64c6f8b9 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

lora-single-adapter-test

Created

Created v1.DestinationRule kserve-ci-e2e-test/lora-single-adapter-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

lora-single-adapter-test

Created

Created v1.HTTPRoute kserve-ci-e2e-test/lora-single-adapter-test-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

lora-single-adapter-test

Created

Created v1.Service kserve-ci-e2e-test/lora-single-adapter-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

lora-single-adapter-test

Created

Created v1.Deployment kserve-ci-e2e-test/lora-single-adapter-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

lora-single-adapter-test

Created

Created v1.Secret kserve-ci-e2e-test/lora-single-adapter-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

lora-single-adapter-test-kserve-6b64c6f8b9-2lb72

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

multus

lora-single-adapter-test-kserve-6b64c6f8b9-2lb72

AddedInterface

Add eth0 [10.132.0.61/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

lora-single-adapter-test-kserve-6b64c6f8b9-2lb72

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

lora-single-adapter-test-kserve-6b64c6f8b9-2lb72

Started

Started container storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

lora-single-adapter-test

Updated

Updated v1.Secret kserve-ci-e2e-test/lora-single-adapter-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

lora-single-adapter-test-kserve-6b64c6f8b9-2lb72

Created

Created container: main

kserve-ci-e2e-test

kubelet

lora-single-adapter-test-kserve-6b64c6f8b9-2lb72

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

lora-single-adapter-test-kserve-6b64c6f8b9-2lb72

Started

Started container main
(x8)

kserve-ci-e2e-test

kubelet

lora-single-adapter-test-kserve-6b64c6f8b9-2lb72

Unhealthy

Startup probe failed: Get "https://10.132.0.61:8000/health": dial tcp 10.132.0.61:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

lora-single-adapter-test

LLMInferenceServiceReady

LLMInferenceService [lora-single-adapter-test] is Ready
(x13)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

Unhealthy

Startup probe failed: Get "https://10.132.0.59:8000/health": dial tcp 10.132.0.59:8000: connect: connection refused
(x2)

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn

AllGroupsReady

All replicas are ready, with 1 groups ready of total 1 groups

kserve-ci-e2e-test

kubelet

lora-single-adapter-test-kserve-6b64c6f8b9-2lb72

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-fb-opt-125m-route-dc21cb14] is Ready

kserve-ci-e2e-test

kubelet

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test386bd5808c5c450f11fd8632e1f821fb-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schexmbsw

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

lora-single-adapter-test-kserve-6b64c6f8b9-2lb72

Unhealthy

Readiness probe failed: Get "https://10.132.0.61:8000/health": dial tcp 10.132.0.61:8000: connect: connection refused

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

Unhealthy

Readiness probe failed: Get "https://10.132.0.59:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

lora-multiple-adapters-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy lora-multiple-adapters-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "lora-multiple-adapters-test-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

lora-multiple-adapters-test

Created

Created v1.DestinationRule kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-workload-svc

kserve-ci-e2e-test

deployment-controller

lora-multiple-adapters-test-kserve

ScalingReplicaSet

Scaled up replica set lora-multiple-adapters-test-kserve-76d7f87f5d from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

lora-multiple-adapters-test

Created

Created v1.HTTPRoute kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

lora-multiple-adapters-test

Created

Created v1.Service kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

lora-multiple-adapters-test

Created

Created v1.Deployment kserve-ci-e2e-test/lora-multiple-adapters-test-kserve

kserve-ci-e2e-test

replicaset-controller

lora-multiple-adapters-test-kserve-76d7f87f5d

SuccessfulCreate

Created pod: lora-multiple-adapters-test-kserve-76d7f87f5d-zt9x2

kserve-ci-e2e-test

LLMInferenceServiceController

lora-multiple-adapters-test

Created

Created v1.Secret kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-self-signed-certs

kserve-ci-e2e-test

multus

lora-multiple-adapters-test-kserve-76d7f87f5d-zt9x2

AddedInterface

Add eth0 [10.132.0.62/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

lora-multiple-adapters-test-kserve-76d7f87f5d-zt9x2

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

lora-multiple-adapters-test-kserve-76d7f87f5d-zt9x2

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

lora-multiple-adapters-test-kserve-76d7f87f5d-zt9x2

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

lora-multiple-adapters-test-kserve-76d7f87f5d-zt9x2

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

lora-multiple-adapters-test-kserve-76d7f87f5d-zt9x2

Created

Created container: main

kserve-ci-e2e-test

kubelet

lora-multiple-adapters-test-kserve-76d7f87f5d-zt9x2

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

lora-multiple-adapters-test

Updated

Updated v1.Secret kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-self-signed-certs
(x14)

kserve-ci-e2e-test

OpenDataHubModelController

scheduler-inline-config-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-inline-config-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-inline-config-test-kserve-route" not found

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-7c6c58cc96-c4czf

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-inline-config-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.Role kserve-ci-e2e-test/scheduler-inline-config-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/scheduler-inline-config-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-epp-service

kserve-ci-e2e-test

deployment-controller

scheduler-inline-config-test-kserve

ScalingReplicaSet

Scaled up replica set scheduler-inline-config-test-kserve-7c6c58cc96 from 0 to 1

kserve-ci-e2e-test

deployment-controller

scheduler-inline-config-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set scheduler-inline-config-test-kserve-router-scheduler-d9ddf6c4d from 0 to 1

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-d9ddfgcgqs

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

multus

scheduler-inline-config-test-kserve-router-scheduler-d9ddfgcgqs

AddedInterface

Add eth0 [10.132.0.63/23] from ovn-kubernetes

kserve-ci-e2e-test

replicaset-controller

scheduler-inline-config-test-kserve-router-scheduler-d9ddf6c4d

SuccessfulCreate

Created pod: scheduler-inline-config-test-kserve-router-scheduler-d9ddfgcgqs

kserve-ci-e2e-test

replicaset-controller

scheduler-inline-config-test-kserve-7c6c58cc96

SuccessfulCreate

Created pod: scheduler-inline-config-test-kserve-7c6c58cc96-c4czf

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-7c6c58cc96-c4czf

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-7c6c58cc96-c4czf

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

multus

scheduler-inline-config-test-kserve-7c6c58cc96-c4czf

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-d9ddfgcgqs

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-d9ddfgcgqs

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Updated

Updated v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-inline-config-test-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

LLMInferenceServiceReady

LLMInferenceService [scheduler-inline-config-test] is Ready

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-d9ddfgcgqs

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-d9ddfgcgqs

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-7c6c58cc96-c4czf

Killing

Stopping container main
(x7)

kserve-ci-e2e-test

kubelet

lora-multiple-adapters-test-kserve-76d7f87f5d-zt9x2

Unhealthy

Startup probe failed: Get "https://10.132.0.62:8000/health": dial tcp 10.132.0.62:8000: connect: connection refused

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-7c6c58cc96-c4czf

Unhealthy

Readiness probe failed: Get "https://10.133.0.33:8000/health": dial tcp 10.133.0.33:8000: connect: connection refused
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route" not found

kserve-ci-e2e-test

deployment-controller

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler-79866dc455 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

Created v1.Secret kserve-ci-e2e-test/llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-service

kserve-ci-e2e-test

replicaset-controller

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler-79866dc455

SuccessfulCreate

Created pod: llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche4f97z

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test80f99418f0f3eb4c80f02e6144a6d4f2-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4bzrdv

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

multus

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4bzrdv

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4

SuccessfulCreate

Created pod: llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4bzrdv

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve

kserve-ci-e2e-test

kubelet

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4bzrdv

Created

Created container: main

kserve-ci-e2e-test

deployment-controller

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4 from 0 to 1

kserve-ci-e2e-test

multus

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche4f97z

AddedInterface

Add eth0 [10.132.0.64/23] from ovn-kubernetes
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-655f7c58b4-57g8x

Started

Started container istio-proxy
(x5)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-655f7c58b4-57g8x

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:7d15cebf9b62f3f235c0eab5158ac8ff2fda86a1d193490dc94c301402c99da8" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche4f97z

Started

Started container main
(x6)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-655f7c58b4-57g8x

Created

Created container: istio-proxy

kserve-ci-e2e-test

kubelet

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4bzrdv

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche4f97z

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche4f97z

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

lora-multiple-adapters-test

LLMInferenceServiceReady

LLMInferenceService [lora-multiple-adapters-test] is Ready
(x24)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-655f7c58b4-57g8x

Unhealthy

Startup probe failed: Get "http://10.133.0.20:15021/healthz/ready": dial tcp 10.133.0.20:15021: connect: connection refused
(x25)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-655f7c58b4-57g8x

ProbeError

Startup probe error: Get "http://10.133.0.20:15021/healthz/ready": dial tcp 10.133.0.20:15021: connect: connection refused body:

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-4c1ba212] is Ready

kserve-ci-e2e-test

kubelet

lora-multiple-adapters-test-kserve-76d7f87f5d-zt9x2

Killing

Stopping container main
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

tls-verification-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy tls-verification-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/tls-verification-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "tls-verification-test-kserve-route" not found

kserve-ci-e2e-test

deployment-controller

tls-verification-test-kserve

ScalingReplicaSet

Scaled up replica set tls-verification-test-kserve-654fdf69fb from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

tls-verification-test

Created

Created v1.Role kserve-ci-e2e-test/tls-verification-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

tls-verification-test

Created

Created v1.Secret kserve-ci-e2e-test/tls-verification-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

tls-verification-test-kserve-654fdf69fb-mc965

Started

Started container storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

tls-verification-test

Created

Created v1.Service kserve-ci-e2e-test/tls-verification-test-epp-service

kserve-ci-e2e-test

deployment-controller

tls-verification-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set tls-verification-test-kserve-router-scheduler-58bcc64bb9 from 0 to 1

kserve-ci-e2e-test

replicaset-controller

tls-verification-test-kserve-router-scheduler-58bcc64bb9

SuccessfulCreate

Created pod: tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x

kserve-ci-e2e-test

LLMInferenceServiceController

tls-verification-test

Created

Created v1.Deployment kserve-ci-e2e-test/tls-verification-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

tls-verification-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/tls-verification-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

tls-verification-test

Created

Created v1.Deployment kserve-ci-e2e-test/tls-verification-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

tls-verification-test

Created

Created v1.Service kserve-ci-e2e-test/tls-verification-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

tls-verification-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/tls-verification-test-epp-sa

kserve-ci-e2e-test

replicaset-controller

tls-verification-test-kserve-654fdf69fb

SuccessfulCreate

Created pod: tls-verification-test-kserve-654fdf69fb-mc965

kserve-ci-e2e-test

kubelet

tls-verification-test-kserve-654fdf69fb-mc965

Created

Created container: storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

tls-verification-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-tls-verification-test-epp-auth-rb

kserve-ci-e2e-test

multus

tls-verification-test-kserve-654fdf69fb-mc965

AddedInterface

Add eth0 [10.132.0.65/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

tls-verification-test-kserve-654fdf69fb-mc965

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x

Started

Started container storage-initializer

kserve-ci-e2e-test

multus

tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x

AddedInterface

Add eth0 [10.134.0.65/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x

Started

Started container main

kserve-ci-e2e-test

kubelet

tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x

Created

Created container: main

kserve-ci-e2e-test

kubelet

tls-verification-test-kserve-654fdf69fb-mc965

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

tls-verification-test-kserve-654fdf69fb-mc965

Started

Started container main

kserve-ci-e2e-test

kubelet

tls-verification-test-kserve-654fdf69fb-mc965

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

tls-verification-test

Updated

Updated v1.Secret kserve-ci-e2e-test/tls-verification-test-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

tls-verification-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/tls-verification-test-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

tls-verification-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/tls-verification-test-kserve-route

kserve-ci-e2e-test

kubelet

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche4f97z

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test80f99418f0f3eb4c80f02e6144a6d4f2-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-797dfc7ff4bzrdv

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-sche4f97z

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

deployment-controller

scheduler-configmap-ref-test-kserve

ScalingReplicaSet

Scaled up replica set scheduler-configmap-ref-test-kserve-744bf59fbd from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.Role kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-role

kserve-ci-e2e-test

replicaset-controller

scheduler-configmap-ref-test-kserve-744bf59fbd

SuccessfulCreate

Created pod: scheduler-configmap-ref-test-kserve-744bf59fbd-w4dpn

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb
(x10)

kserve-ci-e2e-test

OpenDataHubModelController

scheduler-configmap-ref-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-configmap-ref-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-configmap-ref-test-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-68f87brkb6

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-rb

kserve-ci-e2e-test

multus

scheduler-configmap-ref-test-kserve-744bf59fbd-w4dpn

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-744bf59fbd-w4dpn

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-744bf59fbd-w4dpn

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-744bf59fbd-w4dpn

Started

Started container main

kserve-ci-e2e-test

replicaset-controller

scheduler-configmap-ref-test-kserve-router-scheduler-68f876cc5d

SuccessfulCreate

Created pod: scheduler-configmap-ref-test-kserve-router-scheduler-68f87brkb6

kserve-ci-e2e-test

multus

scheduler-configmap-ref-test-kserve-router-scheduler-68f87brkb6

AddedInterface

Add eth0 [10.132.0.66/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-68f87brkb6

Created

Created container: main

kserve-ci-e2e-test

deployment-controller

scheduler-configmap-ref-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set scheduler-configmap-ref-test-kserve-router-scheduler-68f876cc5d from 0 to 1

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-68f87brkb6

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Updated

Updated v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

LLMInferenceServiceReady

LLMInferenceService [scheduler-configmap-ref-test] is Ready
(x11)

kserve-ci-e2e-test

kubelet

tls-verification-test-kserve-654fdf69fb-mc965

Unhealthy

Startup probe failed: Get "https://10.132.0.65:8000/health": dial tcp 10.132.0.65:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

tls-verification-test

LLMInferenceServiceReady

LLMInferenceService [tls-verification-test] is Ready

kserve-ci-e2e-test

kubelet

tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

tls-verification-test-kserve-router-scheduler-58bcc64bb9-zrd4x

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

LLMInferenceServiceController

tls-verification-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-tls-verification-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

tls-verification-test-kserve-654fdf69fb-mc965

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

tls-verification-test-kserve-654fdf69fb-mc965

Unhealthy

Readiness probe failed: Get "https://10.132.0.65:8000/health": dial tcp 10.132.0.65:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

Created v1.Service kserve-ci-e2e-test/prestop-hook-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

Created v1.Deployment kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-prestop-hook-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/prestop-hook-test-epp-sa

kserve-ci-e2e-test

replicaset-controller

prestop-hook-test-kserve-6769cdd744

SuccessfulCreate

Created pod: prestop-hook-test-kserve-6769cdd744-b8f4z

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

Created v1.Service kserve-ci-e2e-test/prestop-hook-test-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

Created v1.Secret kserve-ci-e2e-test/prestop-hook-test-kserve-self-signed-certs

kserve-ci-e2e-test

deployment-controller

prestop-hook-test-kserve

ScalingReplicaSet

Scaled up replica set prestop-hook-test-kserve-6769cdd744 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/prestop-hook-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

Created v1.Deployment kserve-ci-e2e-test/prestop-hook-test-kserve

kserve-ci-e2e-test

deployment-controller

prestop-hook-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set prestop-hook-test-kserve-router-scheduler-85465b59fc from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

Created v1.Role kserve-ci-e2e-test/prestop-hook-test-epp-role

kserve-ci-e2e-test

replicaset-controller

prestop-hook-test-kserve-router-scheduler-85465b59fc

SuccessfulCreate

Created pod: prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db

kserve-ci-e2e-test

multus

prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db

AddedInterface

Add eth0 [10.134.0.66/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6769cdd744-b8f4z

Created

Created container: storage-initializer

kserve-ci-e2e-test

multus

prestop-hook-test-kserve-6769cdd744-b8f4z

AddedInterface

Add eth0 [10.132.0.67/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6769cdd744-b8f4z

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6769cdd744-b8f4z

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db

Started

Started container main

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db

Created

Created container: main

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6769cdd744-b8f4z

Started

Started container main

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6769cdd744-b8f4z

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6769cdd744-b8f4z

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/prestop-hook-test-kserve-route
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/prestop-hook-test-kserve-shadow-svc
(x11)

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6769cdd744-b8f4z

Unhealthy

Startup probe failed: Get "https://10.132.0.67:8000/health": dial tcp 10.132.0.67:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

LLMInferenceServiceReady

LLMInferenceService [prestop-hook-test] is Ready

kserve-ci-e2e-test

replicaset-controller

prestop-hook-test-kserve-6769cdd744

SuccessfulCreate

Created pod: prestop-hook-test-kserve-6769cdd744-kpvrw

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6769cdd744-b8f4z

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6769cdd744-kpvrw

Started

Started container storage-initializer

kserve-ci-e2e-test

multus

prestop-hook-test-kserve-6769cdd744-kpvrw

AddedInterface

Add eth0 [10.132.0.68/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6769cdd744-kpvrw

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:cc7b8fac71b36ebfd1661675b86a84ade93db501973e87758605bd27f47937cb" already present on machine

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6769cdd744-kpvrw

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6769cdd744-kpvrw

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6769cdd744-kpvrw

Created

Created container: main

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6769cdd744-kpvrw

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

LLMInferenceServiceNotReady

LLMInferenceService [prestop-hook-test] is no longer Ready because of: MainWorkloadReady, WorkloadsReady

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6769cdd744-b8f4z

Unhealthy

Readiness probe failed: Get "https://10.132.0.67:8000/health": dial tcp 10.132.0.67:8000: connect: connection refused
(x3)

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6769cdd744-kpvrw

Unhealthy

Startup probe failed: Get "https://10.132.0.68:8000/health": dial tcp 10.132.0.68:8000: connect: connection refused

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6769cdd744-kpvrw

Killing

Stopping container main
(x3)

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Updated

Updated v1.Secret kserve-ci-e2e-test/prestop-hook-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-router-scheduler-85465b59fc-5v5db

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-prestop-hook-test-epp-auth-rb
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

rolling-upgrade-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy rolling-upgrade-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/rolling-upgrade-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "rolling-upgrade-test-kserve-route" not found

kserve-ci-e2e-test

replicaset-controller

rolling-upgrade-test-kserve-54bc76f55b

SuccessfulCreate

Created pod: rolling-upgrade-test-kserve-54bc76f55b-r2wjc

kserve-ci-e2e-test

LLMInferenceServiceController

rolling-upgrade-test

Created

Created v1.Service kserve-ci-e2e-test/rolling-upgrade-test-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

rolling-upgrade-test

Created

Created v1.Secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs

kserve-ci-e2e-test

multus

rolling-upgrade-test-kserve-54bc76f55b-r2wjc

AddedInterface

Add eth0 [10.132.0.69/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

rolling-upgrade-test

Created

Created v1.Service kserve-ci-e2e-test/rolling-upgrade-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

rolling-upgrade-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/rolling-upgrade-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

rolling-upgrade-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/rolling-upgrade-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

rolling-upgrade-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-rolling-upgrade-test-epp-auth-rb

kserve-ci-e2e-test

deployment-controller

rolling-upgrade-test-kserve

ScalingReplicaSet

Scaled up replica set rolling-upgrade-test-kserve-54bc76f55b from 0 to 1

kserve-ci-e2e-test

deployment-controller

rolling-upgrade-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd from 0 to 1

kserve-ci-e2e-test

replicaset-controller

rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd

SuccessfulCreate

Created pod: rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr

kserve-ci-e2e-test

LLMInferenceServiceController

rolling-upgrade-test

Created

Created v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

rolling-upgrade-test

Created

Created v1.Role kserve-ci-e2e-test/rolling-upgrade-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

rolling-upgrade-test

Created

Created v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve

kserve-ci-e2e-test

kubelet

rolling-upgrade-test-kserve-54bc76f55b-r2wjc

Created

Created container: main

kserve-ci-e2e-test

kubelet

rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr

Created

Created container: main

kserve-ci-e2e-test

kubelet

rolling-upgrade-test-kserve-54bc76f55b-r2wjc

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

multus

rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr

AddedInterface

Add eth0 [10.134.0.67/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr

Started

Started container main

kserve-ci-e2e-test

kubelet

rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

kubelet

rolling-upgrade-test-kserve-54bc76f55b-r2wjc

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

rolling-upgrade-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/rolling-upgrade-test-kserve-route
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

rolling-upgrade-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/rolling-upgrade-test-kserve-shadow-svc

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-744bf59fbd-w4dpn

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-68f87brkb6

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-68f87brkb6

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

rolling-upgrade-test

LLMInferenceServiceReady

LLMInferenceService [rolling-upgrade-test] is Ready

kserve-ci-e2e-test

kubelet

rolling-upgrade-test-kserve-859df57bcb-glml8

Started

Started container main

kserve-ci-e2e-test

replicaset-controller

rolling-upgrade-test-kserve-859df57bcb

SuccessfulCreate

Created pod: rolling-upgrade-test-kserve-859df57bcb-glml8

kserve-ci-e2e-test

multus

rolling-upgrade-test-kserve-859df57bcb-glml8

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

kserve-ci-e2e-test

deployment-controller

rolling-upgrade-test-kserve

ScalingReplicaSet

Scaled up replica set rolling-upgrade-test-kserve-859df57bcb from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

rolling-upgrade-test

Updated

Updated v1.Deployment kserve-ci-e2e-test/rolling-upgrade-test-kserve

kserve-ci-e2e-test

kubelet

rolling-upgrade-test-kserve-859df57bcb-glml8

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

kubelet

rolling-upgrade-test-kserve-859df57bcb-glml8

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-744bf59fbd-w4dpn

Unhealthy

Readiness probe failed: Get "https://10.133.0.35:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

kserve-ci-e2e-test

deployment-controller

rolling-upgrade-test-kserve

ScalingReplicaSet

Scaled down replica set rolling-upgrade-test-kserve-54bc76f55b from 1 to 0
(x2)

kserve-ci-e2e-test

LLMInferenceServiceController

rolling-upgrade-test

Updated

Updated v1.Secret kserve-ci-e2e-test/rolling-upgrade-test-kserve-self-signed-certs

kserve-ci-e2e-test

replicaset-controller

rolling-upgrade-test-kserve-54bc76f55b

SuccessfulDelete

Deleted pod: rolling-upgrade-test-kserve-54bc76f55b-r2wjc

kserve-ci-e2e-test

kubelet

rolling-upgrade-test-kserve-54bc76f55b-r2wjc

Killing

Stopping container main
(x13)

kserve-ci-e2e-test

OpenDataHubModelController

scheduler-ha-replicas-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-ha-replicas-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-ha-replicas-test-kserve-route" not found

kserve-ci-e2e-test

deployment-controller

scheduler-ha-replicas-test-kserve

ScalingReplicaSet

Scaled up replica set scheduler-ha-replicas-test-kserve-5c5cfcf776 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-workload-svc

kserve-ci-e2e-test

replicaset-controller

scheduler-ha-replicas-test-kserve-5c5cfcf776

SuccessfulCreate

Created pod: scheduler-ha-replicas-test-kserve-5c5cfcf776-r296b

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-5c5cfcf776-r296b

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dhg8tc

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dmcsm9

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

multus

scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dmcsm9

AddedInterface

Add eth0 [10.132.0.71/23] from ovn-kubernetes

kserve-ci-e2e-test

replicaset-controller

scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dbc4

SuccessfulCreate

Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dhg8tc

kserve-ci-e2e-test

replicaset-controller

scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dbc4

SuccessfulCreate

Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dmcsm9

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-5c5cfcf776-r296b

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-sa

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-5c5cfcf776-r296b

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.Role kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dmcsm9

Created

Created container: main

kserve-ci-e2e-test

deployment-controller

scheduler-ha-replicas-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dbc4 from 0 to 2

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dhg8tc

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dhg8tc

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

multus

scheduler-ha-replicas-test-kserve-5c5cfcf776-r296b

AddedInterface

Add eth0 [10.132.0.70/23] from ovn-kubernetes

kserve-ci-e2e-test

multus

scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dhg8tc

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dmcsm9

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

rolling-upgrade-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-rolling-upgrade-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

kubelet

rolling-upgrade-test-kserve-router-scheduler-8586d4bbcd-6cmlr

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

rolling-upgrade-test-kserve-859df57bcb-glml8

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Updated

Updated v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

LLMInferenceServiceReady

LLMInferenceService [scheduler-ha-replicas-test] is Ready
(x10)

kserve-ci-e2e-test

OpenDataHubModelController

scheduler-v06-pd-migration-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-v06-pd-migration-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-v06-pd-migration-test-kserve-route" not found

kserve-ci-e2e-test

kubelet

scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz

Pulling

Pulling image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2"

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-pd-migration-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-pd-migration-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-v06-pd-migration-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-pd-migration-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-pd-migration-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-pd-migration-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-pd-migration-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-prefill

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-pd-migration-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-rb

kserve-ci-e2e-test

multus

scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz

AddedInterface

Add eth0 [10.134.0.69/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-pd-migration-test

Created

Created v1.Role kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-role

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-pd-migration-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve

kserve-ci-e2e-test

replicaset-controller

scheduler-v06-pd-migration-test-kserve-5c87756974

SuccessfulCreate

Created pod: scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz

kserve-ci-e2e-test

multus

scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hhhsk

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hhhsk

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

kubelet

scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hhhsk

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hhhsk

Started

Started container main

kserve-ci-e2e-test

replicaset-controller

scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847

SuccessfulCreate

Created pod: scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847-hhhsk

kserve-ci-e2e-test

deployment-controller

scheduler-v06-pd-migration-test-kserve-prefill

ScalingReplicaSet

Scaled up replica set scheduler-v06-pd-migration-test-kserve-prefill-78b7f4c847 from 0 to 1

kserve-ci-e2e-test

replicaset-controller

scheduler-v06-pd-migration-test-kserve-router-scheduler-59dc679cd

SuccessfulCreate

Created pod: scheduler-v06-pd-migration-test-kserve-router-scheduler-59zfr9k

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-pd-migration-test

Created

Created v1.Secret kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-self-signed-certs

kserve-ci-e2e-test

deployment-controller

scheduler-v06-pd-migration-test-kserve

ScalingReplicaSet

Scaled up replica set scheduler-v06-pd-migration-test-kserve-5c87756974 from 0 to 1

kserve-ci-e2e-test

deployment-controller

scheduler-v06-pd-migration-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set scheduler-v06-pd-migration-test-kserve-router-scheduler-59dc679cd from 0 to 1

kserve-ci-e2e-test

kubelet

scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

kubelet

scheduler-v06-pd-migration-test-kserve-router-scheduler-59zfr9k

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-v06-pd-migration-test-kserve-router-scheduler-59zfr9k

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-v06-pd-migration-test-kserve-router-scheduler-59zfr9k

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

multus

scheduler-v06-pd-migration-test-kserve-router-scheduler-59zfr9k

AddedInterface

Add eth0 [10.132.0.72/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz

Created

Created container: llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" in 739ms (739ms including waiting). Image size: 44914394 bytes.

kserve-ci-e2e-test

kubelet

scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz

Started

Started container llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

scheduler-v06-pd-migration-test-kserve-5c87756974-j2gzz

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-5c5cfcf776-r296b

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dmcsm9

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb
(x9)

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dmcsm9

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dmcsm9

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dhg8tc

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-6f5f85dhg8tc

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-pd-migration-test

Updated

Updated v1.Secret kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-self-signed-certs
(x10)

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-pd-migration-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-pd-migration-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-v06-pd-migration-test-kserve-route
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

scheduler-custom-template-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-custom-template-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-custom-template-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-custom-template-test-kserve-route" not found

kserve-ci-e2e-test

multus

scheduler-custom-template-test-kserve-5bc7bd6864-gd7l9

AddedInterface

Add eth0 [10.132.0.73/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-custom-template-test-kserve

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-5bc7bd6864-gd7l9

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-5bc7bd6864-gd7l9

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-5bc7bd6864-gd7l9

Started

Started container main

kserve-ci-e2e-test

replicaset-controller

scheduler-custom-template-test-kserve-5bc7bd6864

SuccessfulCreate

Created pod: scheduler-custom-template-test-kserve-5bc7bd6864-gd7l9

kserve-ci-e2e-test

replicaset-controller

scheduler-custom-template-test-kserve-router-scheduler-567469f665

SuccessfulCreate

Created pod: scheduler-custom-template-test-kserve-router-scheduler-567jsr2c

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-custom-template-test-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler

kserve-ci-e2e-test

multus

scheduler-custom-template-test-kserve-router-scheduler-567jsr2c

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/scheduler-custom-template-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

Created v1.Role kserve-ci-e2e-test/scheduler-custom-template-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-custom-template-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-custom-template-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-custom-template-test-kserve-workload-svc

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-router-scheduler-567jsr2c

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

Created v1.Secret kserve-ci-e2e-test/scheduler-custom-template-test-kserve-self-signed-certs

kserve-ci-e2e-test

deployment-controller

scheduler-custom-template-test-kserve

ScalingReplicaSet

Scaled up replica set scheduler-custom-template-test-kserve-5bc7bd6864 from 0 to 1

kserve-ci-e2e-test

deployment-controller

scheduler-custom-template-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set scheduler-custom-template-test-kserve-router-scheduler-567469f665 from 0 to 1

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-router-scheduler-567jsr2c

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-router-scheduler-567jsr2c

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-pd-migration-test

LLMInferenceServiceReady

LLMInferenceService [scheduler-v06-pd-migration-test] is Ready

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Updated

Updated v1.Secret kserve-ci-e2e-test/scheduler-custom-template-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-custom-template-test-kserve-route
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-custom-template-test-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

LLMInferenceServiceReady

LLMInferenceService [scheduler-custom-template-test] is Ready

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-router-scheduler-567jsr2c

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-router-scheduler-567jsr2c

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-5bc7bd6864-gd7l9

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-custom-template-test-epp-auth-rb
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

scheduler-v06-threshold-migration-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-v06-threshold-migration-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-v06-threshold-migration-test-kserve-route" not found

kserve-ci-e2e-test

kubelet

scheduler-v06-threshold-migration-test-kserve-5994569d5b-kpnrr

Pulled

Container image "ghcr.io/llm-d/llm-d-router-disagg-sidecar:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-threshold-migration-test

Created

Created v1.Secret kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

scheduler-v06-threshold-migration-test-kserve-5994569d5b-kpnrr

Started

Started container llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

scheduler-v06-threshold-migration-test-kserve-5994569d5b-kpnrr

Created

Created container: llm-d-routing-sidecar

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-threshold-migration-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-epp-sa

kserve-ci-e2e-test

multus

scheduler-v06-threshold-migration-test-kserve-5994569d5b-kpnrr

AddedInterface

Add eth0 [10.132.0.75/23] from ovn-kubernetes

kserve-ci-e2e-test

deployment-controller

scheduler-v06-threshold-migration-test-kserve

ScalingReplicaSet

Scaled up replica set scheduler-v06-threshold-migration-test-kserve-5994569d5b from 0 to 1

kserve-ci-e2e-test

deployment-controller

scheduler-v06-threshold-migration-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set scheduler-v06-threshold-migration-test-kserve-router-scheduler-dbc65f645 from 0 to 1

kserve-ci-e2e-test

replicaset-controller

scheduler-v06-threshold-migration-test-kserve-router-scheduler-dbc65f645

SuccessfulCreate

Created pod: scheduler-v06-threshold-migration-test-kserve-router-sched94m92

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-threshold-migration-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-threshold-migration-test

Created

Created v1.Role kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-role

kserve-ci-e2e-test

deployment-controller

scheduler-v06-threshold-migration-test-kserve-prefill

ScalingReplicaSet

Scaled up replica set scheduler-v06-threshold-migration-test-kserve-prefill-5fc599dc49 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-threshold-migration-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-threshold-migration-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-prefill

kserve-ci-e2e-test

replicaset-controller

scheduler-v06-threshold-migration-test-kserve-5994569d5b

SuccessfulCreate

Created pod: scheduler-v06-threshold-migration-test-kserve-5994569d5b-kpnrr

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-threshold-migration-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test0a07e82be2036793543b2d3db2ea0785-scheduler-v0

kserve-ci-e2e-test

multus

scheduler-v06-threshold-migration-test-kserve-prefill-5fc56gcmm

AddedInterface

Add eth0 [10.132.0.74/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-threshold-migration-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve

kserve-ci-e2e-test

kubelet

scheduler-v06-threshold-migration-test-kserve-prefill-5fc56gcmm

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

kubelet

scheduler-v06-threshold-migration-test-kserve-prefill-5fc56gcmm

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-v06-threshold-migration-test-kserve-prefill-5fc56gcmm

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-threshold-migration-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-rb

kserve-ci-e2e-test

replicaset-controller

scheduler-v06-threshold-migration-test-kserve-prefill-5fc599dc49

SuccessfulCreate

Created pod: scheduler-v06-threshold-migration-test-kserve-prefill-5fc56gcmm

kserve-ci-e2e-test

kubelet

scheduler-v06-threshold-migration-test-kserve-router-sched94m92

Pulled

Container image "ghcr.io/llm-d/llm-d-router-endpoint-picker:v0.9.0-rc.2" already present on machine

kserve-ci-e2e-test

multus

scheduler-v06-threshold-migration-test-kserve-router-sched94m92

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-v06-threshold-migration-test-kserve-5994569d5b-kpnrr

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-v06-threshold-migration-test-kserve-router-sched94m92

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-v06-threshold-migration-test-kserve-router-sched94m92

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-v06-threshold-migration-test-kserve-5994569d5b-kpnrr

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

kubelet

scheduler-v06-threshold-migration-test-kserve-5994569d5b-kpnrr

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-threshold-migration-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-threshold-migration-test

Updated

Updated v1.Secret kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-self-signed-certs
(x10)

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-threshold-migration-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-v06-threshold-migration-test-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-threshold-migration-test

LLMInferenceServiceReady

LLMInferenceService [scheduler-v06-threshold-migration-test] is Ready

kserve-ci-e2e-test

kubelet

scheduler-v06-threshold-migration-test-kserve-router-sched94m92

FailedPreStopHook

PreStopHook failed

kserve-ci-e2e-test

kubelet

scheduler-v06-threshold-migration-test-kserve-router-sched94m92

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

scheduler-v06-threshold-migration-test-kserve-prefill-5fc56gcmm

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-v06-threshold-migration-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test0a07e82be2036793543b2d3db2ea0785-scheduler-v0

kserve-ci-e2e-test

kubelet

scheduler-v06-threshold-migration-test-kserve-5994569d5b-kpnrr

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

scheduler-v06-threshold-migration-test-kserve-5994569d5b-kpnrr

Killing

Stopping container llm-d-routing-sidecar