Time Namespace Component RelatedObject Reason Message

kuadrant-system

authorino-544488d7bd-x96dr

Scheduled

Successfully assigned kuadrant-system/authorino-544488d7bd-x96dr to ip-10-0-128-243.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-766cc944c5-85gl8

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-766cc944c5-85gl8 to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

scheduler-inline-config-test-kserve-router-scheduler-5484fkg45z

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-5484fkg45z to ip-10-0-128-226.ec2.internal

kuadrant-system

limitador-operator-controller-manager-6f9f468797-cgn2h

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-6f9f468797-cgn2h to ip-10-0-141-25.ec2.internal

kserve-ci-e2e-test

scheduler-inline-config-test-kserve-d5fb8b768-9kwjd

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-d5fb8b768-9kwjd to ip-10-0-128-243.ec2.internal

kserve-ci-e2e-test

router-gateway-2-openshift-default-78c98f6f4c-ddrqp

Scheduled

Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-78c98f6f4c-ddrqp to ip-10-0-128-243.ec2.internal

kserve-ci-e2e-test

router-with-refs-pd-test-kserve-6f78896447-wshh4

Scheduled

Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-6f78896447-wshh4 to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

router-with-refs-pd-test-kserve-prefill-5fc8578dd5-d6lhp

Scheduled

Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-5fc8578dd5-d6lhp to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

auth-invalid-token-test-kserve-router-scheduler-7748b48dbdsc89b

Scheduled

Successfully assigned kserve-ci-e2e-test/auth-invalid-token-test-kserve-router-scheduler-7748b48dbdsc89b to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b

Scheduled

Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b to ip-10-0-141-25.ec2.internal

kserve-ci-e2e-test

gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6

Scheduled

Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6 to ip-10-0-128-243.ec2.internal

kserve-ci-e2e-test

auth-disabled-test-kserve-router-scheduler-b5799d8f5-l8kp6

Scheduled

Successfully assigned kserve-ci-e2e-test/auth-disabled-test-kserve-router-scheduler-b5799d8f5-l8kp6 to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

router-with-refs-test-kserve-578d595fc-gtvkx

Scheduled

Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-578d595fc-gtvkx to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr to ip-10-0-128-243.ec2.internal

kserve-ci-e2e-test

router-with-refs-test-kserve-router-scheduler-7d4868d689-h4c76

Scheduled

Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-7d4868d689-h4c76 to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

scheduler-configmap-ref-test-kserve-67776fd94d-4b46z

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-67776fd94d-4b46z to ip-10-0-128-243.ec2.internal

openshift-ingress

router-default-8bdfdcbd8-4fc26

Scheduled

Successfully assigned openshift-ingress/router-default-8bdfdcbd8-4fc26 to ip-10-0-128-243.ec2.internal

openshift-ingress

router-default-8bdfdcbd8-4fc26

FailedScheduling

0/2 nodes are available: 2 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/2 nodes are available: 2 Preemption is not helpful for scheduling.

kserve-ci-e2e-test

custom-route-timeout-pd-test-kserve-prefill-7b4cdcb48f-wnvss

Scheduled

Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-7b4cdcb48f-wnvss to ip-10-0-128-226.ec2.internal

kuadrant-system

kuadrant-console-plugin-7dbb555447-w6b6b

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-7dbb555447-w6b6b to ip-10-0-128-243.ec2.internal

kuadrant-system

dns-operator-controller-manager-65b49595d7-knbkx

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-65b49595d7-knbkx to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7

Scheduled

Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7 to ip-10-0-141-25.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-5c9bd5678d-xwtf4

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-5c9bd5678d-xwtf4 to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

custom-route-timeout-pd-test-kserve-78b45dc7ff-nzkk7

Scheduled

Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-78b45dc7ff-nzkk7 to ip-10-0-128-226.ec2.internal

kuadrant-system

limitador-limitador-69574b596d-qnf8x

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-69574b596d-qnf8x to ip-10-0-141-25.ec2.internal

kserve-ci-e2e-test

prestop-hook-test-kserve-6758474485-mt9pm

Scheduled

Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-mt9pm to ip-10-0-128-243.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd to ip-10-0-141-25.ec2.internal

kuadrant-system

authorino-operator-6d75c86569-cxdzr

Scheduled

Successfully assigned kuadrant-system/authorino-operator-6d75c86569-cxdzr to ip-10-0-141-25.ec2.internal

kuadrant-system

limitador-limitador-ff68ff5cb-frnlb

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-ff68ff5cb-frnlb to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj to ip-10-0-141-25.ec2.internal

kserve-ci-e2e-test

scheduler-custom-template-test-kserve-96f8b89cb-j7r99

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-custom-template-test-kserve-96f8b89cb-j7r99 to ip-10-0-128-243.ec2.internal

kuadrant-system

authorino-88c64b96b-6kpcd

Scheduled

Successfully assigned kuadrant-system/authorino-88c64b96b-6kpcd to ip-10-0-128-243.ec2.internal

kserve-ci-e2e-test

custom-route-timeout-test-kserve-598d8c75cc-qw9md

Scheduled

Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-598d8c75cc-qw9md to ip-10-0-128-226.ec2.internal

kuadrant-system

authorino-686db986cb-n5rxl

Scheduled

Successfully assigned kuadrant-system/authorino-686db986cb-n5rxl to ip-10-0-128-243.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-6b87f7f5c5mv4vf

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-6b87f7f5c5mv4vf to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

custom-route-timeout-test-kserve-router-scheduler-54bd696fwdw2l

Scheduled

Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-54bd696fwdw2l to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

stop-feature-test-kserve-7c64ccc5f7-jgr84

Scheduled

Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-jgr84 to ip-10-0-128-243.ec2.internal

kserve-ci-e2e-test

stop-feature-test-kserve-router-scheduler-7f74f857ff-5fvn8

Scheduled

Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5fvn8 to ip-10-0-128-226.ec2.internal

openshift-ingress

istiod-openshift-gateway-75c67f8887-qbmcr

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-75c67f8887-qbmcr to ip-10-0-141-25.ec2.internal

kserve-ci-e2e-test

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts to ip-10-0-141-25.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-67b657cbf5wbjmg

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-67b657cbf5wbjmg to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-3c960099-kserve-55868c9d74fpbf8

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-55868c9d74fpbf8 to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

auth-enabled-test-kserve-85d86d876c-vrqhw

Scheduled

Successfully assigned kserve-ci-e2e-test/auth-enabled-test-kserve-85d86d876c-vrqhw to ip-10-0-141-25.ec2.internal

kserve-ci-e2e-test

llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x to ip-10-0-128-243.ec2.internal

kserve-ci-e2e-test

llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8 to ip-10-0-128-243.ec2.internal

kserve-ci-e2e-test

llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd to ip-10-0-128-243.ec2.internal

kserve-ci-e2e-test

prestop-hook-test-kserve-6758474485-78tpc

Scheduled

Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-6758474485-78tpc to ip-10-0-128-243.ec2.internal

kserve-ci-e2e-test

stop-feature-test-kserve-7c64ccc5f7-hmdd6

Scheduled

Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-7c64ccc5f7-hmdd6 to ip-10-0-128-243.ec2.internal

kserve-ci-e2e-test

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegs79x

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegs79x to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

auth-enabled-test-kserve-router-scheduler-6c5d597fbb-nhwh9

Scheduled

Successfully assigned kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler-6c5d597fbb-nhwh9 to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrhrf

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrhrf to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg to ip-10-0-141-25.ec2.internal

kserve-ci-e2e-test

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz to ip-10-0-141-25.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw to ip-10-0-141-25.ec2.internal

kserve-ci-e2e-test

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schesgxzg

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schesgxzg to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk to ip-10-0-141-25.ec2.internal

kserve-ci-e2e-test

llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj to ip-10-0-141-25.ec2.internal

kserve-ci-e2e-test

auth-disabled-test-kserve-699694bb49-m6gc4

Scheduled

Successfully assigned kserve-ci-e2e-test/auth-disabled-test-kserve-699694bb49-m6gc4 to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n

Scheduled

Successfully assigned kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n to ip-10-0-128-243.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6dbc7ddb8d-c625w

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6dbc7ddb8d-c625w to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

lora-single-adapter-test-kserve-6878c54cbb-44tgc

Scheduled

Successfully assigned kserve-ci-e2e-test/lora-single-adapter-test-kserve-6878c54cbb-44tgc to ip-10-0-128-243.ec2.internal

kserve-ci-e2e-test

precise-prefix-cache-test-kserve-5c556785f6-67h82

Scheduled

Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-67h82 to ip-10-0-141-25.ec2.internal

kserve-ci-e2e-test

precise-prefix-cache-test-kserve-5c556785f6-h6wcn

Scheduled

Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-5c556785f6-h6wcn to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4 to ip-10-0-128-243.ec2.internal

kserve-ci-e2e-test

precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb

Scheduled

Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb to ip-10-0-141-25.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz to ip-10-0-141-25.ec2.internal

kserve-ci-e2e-test

prestop-hook-test-kserve-router-scheduler-8578fc44f9-fs8xv

Scheduled

Successfully assigned kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler-8578fc44f9-fs8xv to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd

Scheduled

Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd to ip-10-0-141-25.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 to ip-10-0-128-243.ec2.internal

kserve-ci-e2e-test

router-gateway-1-openshift-default-75dcfd69c9-dh6qf

Scheduled

Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-75dcfd69c9-dh6qf to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884959rf

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884959rf to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq to ip-10-0-128-243.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-864m467

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-864m467 to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx to ip-10-0-141-25.ec2.internal

kserve-ci-e2e-test

auth-invalid-token-test-kserve-f5744d7b7-gjb94

Scheduled

Successfully assigned kserve-ci-e2e-test/auth-invalid-token-test-kserve-f5744d7b7-gjb94 to ip-10-0-128-226.ec2.internal

kserve-ci-e2e-test

gw-section-name-router-with-gat-f1d92d0f-kserve-bc6865668-glklv

Scheduled

Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-bc6865668-glklv to ip-10-0-128-226.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-8bdfdcbd8 from 0 to 1

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x13)

openshift-ingress

replicaset-controller

router-default-8bdfdcbd8

FailedCreate

Error creating: pods "router-default-8bdfdcbd8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x16)

openshift-ingress

replicaset-controller

router-default-8bdfdcbd8

FailedCreate

Error creating: pods "router-default-8bdfdcbd8-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

replicaset-controller

router-default-8bdfdcbd8

SuccessfulCreate

Created pod: router-default-8bdfdcbd8-4fc26
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts
(x6)

openshift-ingress

kubelet

router-default-8bdfdcbd8-4fc26

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x6)

openshift-ingress

kubelet

router-default-8bdfdcbd8-4fc26

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

multus

router-default-8bdfdcbd8-4fc26

AddedInterface

Add eth0 [10.132.0.12/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-8bdfdcbd8-4fc26

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:68c43f6705263ac9281e11c8a7628b5a094439fd5433a540504fa88630506200" already present on machine

openshift-ingress

kubelet

router-default-8bdfdcbd8-4fc26

Started

Started container router

openshift-ingress

kubelet

router-default-8bdfdcbd8-4fc26

Created

Created container: router

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-75c67f8887 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-75c67f8887

SuccessfulCreate

Created pod: istiod-openshift-gateway-75c67f8887-qbmcr

openshift-ingress

multus

istiod-openshift-gateway-75c67f8887-qbmcr

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-75c67f8887-qbmcr

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:f118bf81f44443fbdab23b689c97e9801eba8799c7af85228f914d8cd8afe6c0"

openshift-ingress

kubelet

istiod-openshift-gateway-75c67f8887-qbmcr

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-75c67f8887-qbmcr

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:f118bf81f44443fbdab23b689c97e9801eba8799c7af85228f914d8cd8afe6c0" in 2.278s (2.278s including waiting). Image size: 179545389 bytes.

openshift-ingress

kubelet

istiod-openshift-gateway-75c67f8887-qbmcr

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-75c67f8887-qbmcr

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

kubelet

istiod-openshift-gateway-75c67f8887-qbmcr

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:40be785b9abecd641f3121855a066c0ea01aba66e1350f33d175f2351c54e371"

openshift-ingress

gateway_labeler_controller

openshift-ai-inference

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway openshift-ai-inference

openshift-ingress

multus

openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

openshift-ingress

service-controller

openshift-ai-inference-openshift-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-default

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-default-56ccbcff6d from 0 to 1

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-56ccbcff6d

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd

openshift-ingress

service-controller

openshift-ai-inference-openshift-default

EnsuredLoadBalancer

Ensured load balancer

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:40be785b9abecd641f3121855a066c0ea01aba66e1350f33d175f2351c54e371" in 2.346s (2.346s including waiting). Image size: 179625600 bytes.
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x2)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.0

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.0

RequirementsUnknown

requirements not yet checked

kuadrant-system

replicaset-controller

authorino-operator-6d75c86569

SuccessfulCreate

Created pod: authorino-operator-6d75c86569-cxdzr

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-6d75c86569 from 0 to 1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.0

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.0

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.0

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.0

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.0

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

multus

authorino-operator-6d75c86569-cxdzr

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-6d75c86569-cxdzr

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:1ebc76aad15cbaed4e24838005a68e3bd83353aaf341518d9846d419d6b65524"

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-65b49595d7 from 0 to 1

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.0

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

replicaset-controller

dns-operator-controller-manager-65b49595d7

SuccessfulCreate

Created pod: dns-operator-controller-manager-65b49595d7-knbkx

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.0

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.0

RequirementsUnknown

requirements not yet checked

kuadrant-system

multus

dns-operator-controller-manager-65b49595d7-knbkx

AddedInterface

Add eth0 [10.134.0.22/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-65b49595d7-knbkx

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ba46f54446ecd3ed1a3d877dcbb7359ff8f2d918827f3411a5cb0781915a65d5"

kuadrant-system

kubelet

authorino-operator-6d75c86569-cxdzr

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:1ebc76aad15cbaed4e24838005a68e3bd83353aaf341518d9846d419d6b65524" in 2.468s (2.468s including waiting). Image size: 168564707 bytes.

kuadrant-system

kubelet

authorino-operator-6d75c86569-cxdzr

Created

Created container: manager

kuadrant-system

authorino-operator-6d75c86569-cxdzr_40ac9c3f-981b-4018-a04c-dca48e739619

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-6d75c86569-cxdzr_40ac9c3f-981b-4018-a04c-dca48e739619 became leader

kuadrant-system

kubelet

authorino-operator-6d75c86569-cxdzr

Started

Started container manager

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.0

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.0

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

dns-operator-controller-manager-65b49595d7-knbkx_052f852f-f0c2-4b1a-9930-52b620eede3f

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-65b49595d7-knbkx_052f852f-f0c2-4b1a-9930-52b620eede3f became leader

kuadrant-system

kubelet

dns-operator-controller-manager-65b49595d7-knbkx

Started

Started container manager

kuadrant-system

kubelet

dns-operator-controller-manager-65b49595d7-knbkx

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ba46f54446ecd3ed1a3d877dcbb7359ff8f2d918827f3411a5cb0781915a65d5" in 1.881s (1.881s including waiting). Image size: 190472853 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-65b49595d7-knbkx

Created

Created container: manager

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.0

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-5c9bd5678d from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-5c9bd5678d

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-5c9bd5678d-xwtf4

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.0

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.0

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

kuadrant-operator-controller-manager-5c9bd5678d-xwtf4

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:63c62ca2971e5679da2d1e8615448a5653058d3a012ace13c3251ae295792bc5"

kuadrant-system

multus

kuadrant-operator-controller-manager-5c9bd5678d-xwtf4

AddedInterface

Add eth0 [10.134.0.23/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.0

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.0

RequirementsUnknown

requirements not yet checked

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.0

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-6f9f468797 from 0 to 1

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-6f9f468797

SuccessfulCreate

Created pod: limitador-operator-controller-manager-6f9f468797-cgn2h

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.0

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

multus

limitador-operator-controller-manager-6f9f468797-cgn2h

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-operator-controller-manager-6f9f468797-cgn2h

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:183bad2a6f5872aea38f54ad507f7e005d6facb02b18769e0407c82799f96a3e"

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.0

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

kubelet

limitador-operator-controller-manager-6f9f468797-cgn2h

Started

Started container manager

kuadrant-system

kubelet

limitador-operator-controller-manager-6f9f468797-cgn2h

Created

Created container: manager

kuadrant-system

kubelet

limitador-operator-controller-manager-6f9f468797-cgn2h

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:183bad2a6f5872aea38f54ad507f7e005d6facb02b18769e0407c82799f96a3e" in 1.495s (1.495s including waiting). Image size: 178538972 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-5c9bd5678d-xwtf4

Started

Started container manager

kuadrant-system

limitador-operator-controller-manager-6f9f468797-cgn2h_b658694a-84f6-4a05-8f5f-9afcc7fd475e

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-6f9f468797-cgn2h_b658694a-84f6-4a05-8f5f-9afcc7fd475e became leader

kuadrant-system

kubelet

kuadrant-operator-controller-manager-5c9bd5678d-xwtf4

Created

Created container: manager

kuadrant-system

kubelet

kuadrant-operator-controller-manager-5c9bd5678d-xwtf4

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:63c62ca2971e5679da2d1e8615448a5653058d3a012ace13c3251ae295792bc5" in 3.767s (3.767s including waiting). Image size: 425568012 bytes.

kuadrant-system

kuadrant-operator-controller-manager-5c9bd5678d-xwtf4_2af129b2-64f1-4f88-ae97-626811a3c004

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-5c9bd5678d-xwtf4_2af129b2-64f1-4f88-ae97-626811a3c004 became leader

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-7dbb555447 from 0 to 1

kuadrant-system

kubelet

kuadrant-console-plugin-7dbb555447-w6b6b

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:00e355f0ca6c08ef2866398e0f3d448353f6332ea61eb952c17d3ad41811862b"

kuadrant-system

multus

kuadrant-console-plugin-7dbb555447-w6b6b

AddedInterface

Add eth0 [10.132.0.37/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

kuadrant-console-plugin-7dbb555447

SuccessfulCreate

Created pod: kuadrant-console-plugin-7dbb555447-w6b6b

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.4.0

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.4.0

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-console-plugin-7dbb555447-w6b6b

Started

Started container kuadrant-console-plugin

kuadrant-system

kubelet

kuadrant-console-plugin-7dbb555447-w6b6b

Created

Created container: kuadrant-console-plugin

kuadrant-system

kubelet

kuadrant-console-plugin-7dbb555447-w6b6b

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:00e355f0ca6c08ef2866398e0f3d448353f6332ea61eb952c17d3ad41811862b" in 4.521s (4.521s including waiting). Image size: 342506618 bytes.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.4.0

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.4.0

InstallSucceeded

install strategy completed with no errors

kuadrant-system

replicaset-controller

limitador-limitador-69574b596d

SuccessfulCreate

Created pod: limitador-limitador-69574b596d-qnf8x

kuadrant-system

multus

limitador-limitador-ff68ff5cb-frnlb

AddedInterface

Add eth0 [10.134.0.24/23] from ovn-kubernetes

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-69574b596d from 0 to 1

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-ff68ff5cb from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-ff68ff5cb

SuccessfulCreate

Created pod: limitador-limitador-ff68ff5cb-frnlb

kuadrant-system

kubelet

limitador-limitador-ff68ff5cb-frnlb

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474"

kuadrant-system

replicaset-controller

authorino-88c64b96b

SuccessfulCreate

Created pod: authorino-88c64b96b-6kpcd

kuadrant-system

multus

authorino-88c64b96b-6kpcd

AddedInterface

Add eth0 [10.132.0.38/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-69574b596d-qnf8x

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474"

kuadrant-system

multus

limitador-limitador-69574b596d-qnf8x

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-544488d7bd from 0 to 1

kuadrant-system

replicaset-controller

authorino-544488d7bd

SuccessfulCreate

Created pod: authorino-544488d7bd-x96dr

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-88c64b96b from 0 to 1

kuadrant-system

kubelet

authorino-88c64b96b-6kpcd

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:76be3de77f8848f9e9f5ed0271b31255d35fdd486bb67eb6ca9ac792bc65b1ce"

kuadrant-system

kubelet

authorino-544488d7bd-x96dr

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:76be3de77f8848f9e9f5ed0271b31255d35fdd486bb67eb6ca9ac792bc65b1ce"

kuadrant-system

multus

authorino-544488d7bd-x96dr

AddedInterface

Add eth0 [10.132.0.39/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-544488d7bd-x96dr

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:76be3de77f8848f9e9f5ed0271b31255d35fdd486bb67eb6ca9ac792bc65b1ce" in 1.446s (1.446s including waiting). Image size: 202675450 bytes.

kuadrant-system

kubelet

authorino-88c64b96b-6kpcd

Started

Started container authorino

kuadrant-system

kubelet

authorino-544488d7bd-x96dr

Created

Created container: authorino

kuadrant-system

kubelet

authorino-544488d7bd-x96dr

Started

Started container authorino

kuadrant-system

kubelet

authorino-88c64b96b-6kpcd

Created

Created container: authorino

kuadrant-system

kubelet

authorino-88c64b96b-6kpcd

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:76be3de77f8848f9e9f5ed0271b31255d35fdd486bb67eb6ca9ac792bc65b1ce" in 1.781s (1.781s including waiting). Image size: 202675450 bytes.

kuadrant-system

kubelet

limitador-limitador-ff68ff5cb-frnlb

Started

Started container limitador

kuadrant-system

kubelet

limitador-limitador-69574b596d-qnf8x

Created

Created container: limitador

kuadrant-system

kubelet

limitador-limitador-69574b596d-qnf8x

Started

Started container limitador

kuadrant-system

replicaset-controller

authorino-88c64b96b

SuccessfulDelete

Deleted pod: authorino-88c64b96b-6kpcd

kuadrant-system

kubelet

limitador-limitador-69574b596d-qnf8x

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" in 3.343s (3.343s including waiting). Image size: 250499765 bytes.

kuadrant-system

kubelet

limitador-limitador-ff68ff5cb-frnlb

Created

Created container: limitador

kuadrant-system

kubelet

limitador-limitador-ff68ff5cb-frnlb

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:0b02c000d9a175235223ec5916345a1ccedeedc25c87cc0638e8554e6c318474" in 3.774s (3.774s including waiting). Image size: 250499765 bytes.

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-88c64b96b from 1 to 0

kuadrant-system

kubelet

authorino-88c64b96b-6kpcd

Killing

Stopping container authorino

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-ff68ff5cb from 1 to 0

kuadrant-system

kubelet

limitador-limitador-ff68ff5cb-frnlb

Killing

Stopping container limitador

kuadrant-system

replicaset-controller

limitador-limitador-ff68ff5cb

SuccessfulDelete

Deleted pod: limitador-limitador-ff68ff5cb-frnlb

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-686db986cb from 0 to 1

kuadrant-system

kubelet

authorino-686db986cb-n5rxl

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:76be3de77f8848f9e9f5ed0271b31255d35fdd486bb67eb6ca9ac792bc65b1ce"

kuadrant-system

multus

authorino-686db986cb-n5rxl

AddedInterface

Add eth0 [10.132.0.40/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-686db986cb-n5rxl

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:76be3de77f8848f9e9f5ed0271b31255d35fdd486bb67eb6ca9ac792bc65b1ce" in 323ms (323ms including waiting). Image size: 202675450 bytes.

kuadrant-system

kubelet

authorino-686db986cb-n5rxl

Created

Created container: authorino

kuadrant-system

kubelet

authorino-686db986cb-n5rxl

Started

Started container authorino

kuadrant-system

replicaset-controller

authorino-686db986cb

SuccessfulCreate

Created pod: authorino-686db986cb-n5rxl

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-544488d7bd from 1 to 0

kuadrant-system

replicaset-controller

authorino-544488d7bd

SuccessfulDelete

Deleted pod: authorino-544488d7bd-x96dr

kuadrant-system

kubelet

authorino-544488d7bd-x96dr

Killing

Stopping container authorino

kserve-ci-e2e-test

deployment-controller

router-gateway-1-openshift-default

ScalingReplicaSet

Scaled up replica set router-gateway-1-openshift-default-75dcfd69c9 from 0 to 1

kserve-ci-e2e-test

replicaset-controller

router-gateway-1-openshift-default-75dcfd69c9

SuccessfulCreate

Created pod: router-gateway-1-openshift-default-75dcfd69c9-dh6qf

kserve-ci-e2e-test

service-controller

router-gateway-1-openshift-default

EnsuringLoadBalancer

Ensuring load balancer

kserve-ci-e2e-test

multus

router-gateway-1-openshift-default-75dcfd69c9-dh6qf

AddedInterface

Add eth0 [10.134.0.28/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

router-gateway-1-openshift-default-75dcfd69c9-dh6qf

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:40be785b9abecd641f3121855a066c0ea01aba66e1350f33d175f2351c54e371"
(x10)

kserve-ci-e2e-test

OpenDataHubModelController

scheduler-ha-replicas-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-ha-replicas-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-ha-replicas-test-kserve-route" not found

kserve-ci-e2e-test

service-controller

router-gateway-1-openshift-default

EnsuredLoadBalancer

Ensured load balancer

kserve-ci-e2e-test

kubelet

router-gateway-1-openshift-default-75dcfd69c9-dh6qf

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:40be785b9abecd641f3121855a066c0ea01aba66e1350f33d175f2351c54e371" in 2.707s (2.707s including waiting). Image size: 179625600 bytes.

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb

kserve-ci-e2e-test

deployment-controller

scheduler-ha-replicas-test-kserve

ScalingReplicaSet

Scaled up replica set scheduler-ha-replicas-test-kserve-5d7479f884 from 0 to 1

kserve-ci-e2e-test

replicaset-controller

scheduler-ha-replicas-test-kserve-5d7479f884

SuccessfulCreate

Created pod: scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.Role kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-service

kserve-ci-e2e-test

replicaset-controller

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884fbb

SuccessfulCreate

Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884959rf

kserve-ci-e2e-test

multus

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884959rf

AddedInterface

Add eth0 [10.134.0.29/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1"

kserve-ci-e2e-test

multus

scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq

AddedInterface

Add eth0 [10.132.0.41/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler

kserve-ci-e2e-test

deployment-controller

scheduler-ha-replicas-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884fbb from 0 to 2

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884959rf

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1"

kserve-ci-e2e-test

multus

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

kserve-ci-e2e-test

replicaset-controller

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884fbb

SuccessfulCreate

Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884959rf

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884959rf

Pulling

Pulling image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1"

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884959rf

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" in 951ms (951ms including waiting). Image size: 87241021 bytes.

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.082s (1.082s including waiting). Image size: 98346788 bytes.

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" in 1.034s (1.034s including waiting). Image size: 87241021 bytes.

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884959rf

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts

Pulling

Pulling image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1"

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-2f0a622e

Created

Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-2f0a622e

Created

Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-2f0a622e

Created

Created v1.Secret kserve-ci-e2e-test/gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs

kserve-ci-e2e-test

deployment-controller

gw-section-name-router-with-gat-2f0a622e-kserve

ScalingReplicaSet

Scaled up replica set gw-section-name-router-with-gat-2f0a622e-kserve-779977f94c from 0 to 1

kserve-ci-e2e-test

replicaset-controller

gw-section-name-router-with-gat-2f0a622e-kserve-779977f94c

SuccessfulCreate

Created pod: gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-2f0a622e

Created

Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc

kserve-ci-e2e-test

multus

gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6

AddedInterface

Add eth0 [10.132.0.42/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6

Created

Created container: main

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-2f0a622e

Created

Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-route

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884959rf

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884959rf

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" in 30.592s (30.592s including waiting). Image size: 2907020949 bytes.

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884959rf

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" in 31.996s (31.996s including waiting). Image size: 2907020949 bytes.

kserve-ci-e2e-test

kubelet

router-gateway-1-openshift-default-75dcfd69c9-dh6qf

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:40be785b9abecd641f3121855a066c0ea01aba66e1350f33d175f2351c54e371" already present on machine
(x2)

kserve-ci-e2e-test

kubelet

router-gateway-1-openshift-default-75dcfd69c9-dh6qf

Started

Started container istio-proxy
(x2)

kserve-ci-e2e-test

kubelet

router-gateway-1-openshift-default-75dcfd69c9-dh6qf

Created

Created container: istio-proxy

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts

Unhealthy

Startup probe failed: Get "http://10.133.0.34:8082/healthz": dial tcp 10.133.0.34:8082: connect: connection refused
(x5)

kserve-ci-e2e-test

kubelet

router-gateway-1-openshift-default-75dcfd69c9-dh6qf

Unhealthy

Startup probe failed: Get "http://10.134.0.28:15021/healthz/ready": dial tcp 10.134.0.28:15021: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Updated

Updated v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-2f0a622e-kserve-779977f94cgh8n6

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

LLMInferenceServiceReady

LLMInferenceService [scheduler-ha-replicas-test] is Ready

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-f1d92d0f

Created

Created v1.Secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs

kserve-ci-e2e-test

deployment-controller

gw-section-name-router-with-gat-f1d92d0f-kserve

ScalingReplicaSet

Scaled up replica set gw-section-name-router-with-gat-f1d92d0f-kserve-bc6865668 from 0 to 1

kserve-ci-e2e-test

replicaset-controller

gw-section-name-router-with-gat-f1d92d0f-kserve-bc6865668

SuccessfulCreate

Created pod: gw-section-name-router-with-gat-f1d92d0f-kserve-bc6865668-glklv

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-f1d92d0f

Created

Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-f1d92d0f

Created

Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-f1d92d0f

Created

Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-route

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-f1d92d0f-kserve-bc6865668-glklv

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

gw-section-name-router-with-gat-f1d92d0f

Created

Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc

kserve-ci-e2e-test

multus

gw-section-name-router-with-gat-f1d92d0f-kserve-bc6865668-glklv

AddedInterface

Add eth0 [10.134.0.30/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884959rf

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-f1d92d0f-kserve-bc6865668-glklv

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.286s (1.286s including waiting). Image size: 98346788 bytes.

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-f1d92d0f-kserve-bc6865668-glklv

Created

Created container: main

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-f1d92d0f-kserve-bc6865668-glklv

Started

Started container main

kserve-ci-e2e-test

kubelet

gw-section-name-router-with-gat-f1d92d0f-kserve-bc6865668-glklv

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-5d7479f884-f4vfq

Killing

Stopping container main
(x9)

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884sbpts

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-5fb5884959rf

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/auth-enabled-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

Created v1.Role kserve-ci-e2e-test/auth-enabled-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

Created v1.Service kserve-ci-e2e-test/auth-enabled-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

Created v1.Deployment kserve-ci-e2e-test/auth-enabled-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

Created v1.Deployment kserve-ci-e2e-test/auth-enabled-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

Created v1.Service kserve-ci-e2e-test/auth-enabled-test-epp-service

kserve-ci-e2e-test

deployment-controller

auth-enabled-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set auth-enabled-test-kserve-router-scheduler-6c5d597fbb from 0 to 1

kserve-ci-e2e-test

replicaset-controller

auth-enabled-test-kserve-85d86d876c

SuccessfulCreate

Created pod: auth-enabled-test-kserve-85d86d876c-vrqhw

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-85d86d876c-vrqhw

Pulling

Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada"

kserve-ci-e2e-test

replicaset-controller

auth-enabled-test-kserve-router-scheduler-6c5d597fbb

SuccessfulCreate

Created pod: auth-enabled-test-kserve-router-scheduler-6c5d597fbb-nhwh9

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-enabled-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/auth-enabled-test-epp-sa

kserve-ci-e2e-test

deployment-controller

auth-enabled-test-kserve

ScalingReplicaSet

Scaled up replica set auth-enabled-test-kserve-85d86d876c from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

Created v1.Secret kserve-ci-e2e-test/auth-enabled-test-kserve-self-signed-certs

kserve-ci-e2e-test

multus

auth-enabled-test-kserve-85d86d876c-vrqhw

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-router-scheduler-6c5d597fbb-nhwh9

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

multus

auth-enabled-test-kserve-router-scheduler-6c5d597fbb-nhwh9

AddedInterface

Add eth0 [10.134.0.31/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-router-scheduler-6c5d597fbb-nhwh9

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-router-scheduler-6c5d597fbb-nhwh9

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-router-scheduler-6c5d597fbb-nhwh9

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-router-scheduler-6c5d597fbb-nhwh9

Started

Started container main

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-router-scheduler-6c5d597fbb-nhwh9

Created

Created container: main

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-router-scheduler-6c5d597fbb-nhwh9

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-router-scheduler-6c5d597fbb-nhwh9

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-router-scheduler-6c5d597fbb-nhwh9

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-85d86d876c-vrqhw

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" in 3.371s (3.371s including waiting). Image size: 299992506 bytes.

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-85d86d876c-vrqhw

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

auth-enabled-test-kserve-85d86d876c-vrqhw

Created

Created container: storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/auth-enabled-test-kserve-route
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-enabled-test-kserve-shadow-svc
(x2)

kserve-ci-e2e-test

LLMInferenceServiceController

auth-enabled-test

Updated

Updated v1.Secret kserve-ci-e2e-test/auth-enabled-test-kserve-self-signed-certs
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

scheduler-custom-template-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-custom-template-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-custom-template-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-custom-template-test-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

Created v1.Role kserve-ci-e2e-test/scheduler-custom-template-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-custom-template-test-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/scheduler-custom-template-test-epp-rb

kserve-ci-e2e-test

replicaset-controller

scheduler-custom-template-test-kserve-router-scheduler-9c4c7855f

SuccessfulCreate

Created pod: scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx

kserve-ci-e2e-test

replicaset-controller

scheduler-custom-template-test-kserve-96f8b89cb

SuccessfulCreate

Created pod: scheduler-custom-template-test-kserve-96f8b89cb-j7r99

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-custom-template-test-epp-auth-rb

kserve-ci-e2e-test

deployment-controller

scheduler-custom-template-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set scheduler-custom-template-test-kserve-router-scheduler-9c4c7855f from 0 to 1

kserve-ci-e2e-test

deployment-controller

scheduler-custom-template-test-kserve

ScalingReplicaSet

Scaled up replica set scheduler-custom-template-test-kserve-96f8b89cb from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-custom-template-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

Created v1.Secret kserve-ci-e2e-test/scheduler-custom-template-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-custom-template-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-custom-template-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-custom-template-test-epp-sa

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-96f8b89cb-j7r99

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-96f8b89cb-j7r99

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-96f8b89cb-j7r99

Started

Started container main

kserve-ci-e2e-test

multus

scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx

Created

Created container: main

kserve-ci-e2e-test

multus

scheduler-custom-template-test-kserve-96f8b89cb-j7r99

AddedInterface

Add eth0 [10.132.0.43/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx

Created

Created container: tokenizer
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-custom-template-test-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Updated

Updated v1.Secret kserve-ci-e2e-test/scheduler-custom-template-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-custom-template-test-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

LLMInferenceServiceReady

LLMInferenceService [scheduler-custom-template-test] is Ready

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-router-scheduler-9c4tp6hx

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

scheduler-custom-template-test-kserve-96f8b89cb-j7r99

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-custom-template-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-custom-template-test-epp-auth-rb
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

precise-prefix-cache-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy precise-prefix-cache-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "precise-prefix-cache-test-kserve-route" not found

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.Role kserve-ci-e2e-test/precise-prefix-cache-test-epp-role

kserve-ci-e2e-test

multus

precise-prefix-cache-test-kserve-5c556785f6-67h82

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-5c556785f6-67h82

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb

Created

Created container: storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve

kserve-ci-e2e-test

multus

precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/precise-prefix-cache-test-epp-sa

kserve-ci-e2e-test

replicaset-controller

precise-prefix-cache-test-kserve-router-scheduler-74dcd66d7b

SuccessfulCreate

Created pod: precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb

kserve-ci-e2e-test

replicaset-controller

precise-prefix-cache-test-kserve-5c556785f6

SuccessfulCreate

Created pod: precise-prefix-cache-test-kserve-5c556785f6-h6wcn

kserve-ci-e2e-test

replicaset-controller

precise-prefix-cache-test-kserve-5c556785f6

SuccessfulCreate

Created pod: precise-prefix-cache-test-kserve-5c556785f6-67h82

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-kserve-workload-svc

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-5c556785f6-67h82

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-5c556785f6-67h82

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-5c556785f6-h6wcn

Started

Started container storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/precise-prefix-cache-test-epp-rb

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-5c556785f6-h6wcn

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-5c556785f6-h6wcn

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

multus

precise-prefix-cache-test-kserve-5c556785f6-h6wcn

AddedInterface

Add eth0 [10.134.0.32/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-epp-service

kserve-ci-e2e-test

deployment-controller

precise-prefix-cache-test-kserve

ScalingReplicaSet

Scaled up replica set precise-prefix-cache-test-kserve-5c556785f6 from 0 to 2

kserve-ci-e2e-test

deployment-controller

precise-prefix-cache-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set precise-prefix-cache-test-kserve-router-scheduler-74dcd66d7b from 0 to 1

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb

Started

Started container main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb

Created

Created container: main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-5c556785f6-h6wcn

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Updated

Updated v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-5c556785f6-h6wcn

Created

Created container: main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-5c556785f6-h6wcn

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/precise-prefix-cache-test-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-5c556785f6-67h82

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2"

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-5c556785f6-67h82

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.023s (1.023s including waiting). Image size: 98346788 bytes.

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-5c556785f6-67h82

Started

Started container main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-5c556785f6-67h82

Created

Created container: main
(x2)

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb

Unhealthy

Liveness probe failed: timeout: failed to connect service "10.133.0.38:9003" within 1s: context deadline exceeded

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

LLMInferenceServiceReady

LLMInferenceService [precise-prefix-cache-test] is Ready

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-5c556785f6-67h82

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-5c556785f6-h6wcn

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-74dcd66dl8zmb

Killing

Stopping container main
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-router-managed-test-llm-e45d1f79

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-e45d1f79-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-e45d1f79-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-role

kserve-ci-e2e-test

deployment-controller

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler-7bc88f48bc from 0 to 1

kserve-ci-e2e-test

replicaset-controller

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheduler-7bc88f48bc

SuccessfulCreate

Created pod: llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz

kserve-ci-e2e-test

replicaset-controller

llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c

SuccessfulCreate

Created pod: llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd

kserve-ci-e2e-test

deployment-controller

llmisvc-router-managed-test-llm-e45d1f79-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

Created v1.Secret kserve-ci-e2e-test/llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-testef4d2875be14b30dc1561ed84d0d4bde-llmisvc-rout

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-epp-rb

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz

Created

Created container: tokenizer

kserve-ci-e2e-test

multus

llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd

AddedInterface

Add eth0 [10.132.0.44/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

multus

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv5c7e67b6c51568d1d6d13829a9337f2a-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-e45d1f79-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testef4d2875be14b30dc1561ed84d0d4bde-llmisvc-rout

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-e45d1f79

LLMInferenceServiceReady

LLMInferenceService [llmisvc-router-managed-test-llm-e45d1f79] is Ready

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-e45d1f79-kserve-598bf9c8c-g56wd

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc5c7e67b6c51568d1d6d13829a9337f2a-kserve-router-scheqcskz

Killing

Stopping container tokenizer
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-router-managed-test-llm-5b1e8f15

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-5b1e8f15-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-5b1e8f15-kserve-route" not found

kserve-ci-e2e-test

deployment-controller

llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler-68b6785c7d from 0 to 1

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

multus

llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj

Started

Started container tokenizer

kserve-ci-e2e-test

replicaset-controller

llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler-68b6785c7d

SuccessfulCreate

Created pod: llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-sche8fvcj

kserve-ci-e2e-test

replicaset-controller

llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44

SuccessfulCreate

Created pod: llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8

kserve-ci-e2e-test

multus

llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8

AddedInterface

Add eth0 [10.132.0.45/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8

Started

Started container main

kserve-ci-e2e-test

deployment-controller

llmisvc-router-managed-test-llm-5b1e8f15-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvce55ae740357a3a31a27cdb8b66ffe20f-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test7f54e84970003a6e7372bdbcb574f7ed-llmisvc-rout

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

Created v1.Secret kserve-ci-e2e-test/llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-5b1e8f15-kserve-7c5bd57d44b7wp8

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisve55ae740357a3a31a27cdb8b66ffe20f-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-5b1e8f15-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-5b1e8f15

LLMInferenceServiceReady

LLMInferenceService [llmisvc-router-managed-test-llm-5b1e8f15] is Ready

kserve-ci-e2e-test

replicaset-controller

auth-invalid-token-test-kserve-f5744d7b7

SuccessfulCreate

Created pod: auth-invalid-token-test-kserve-f5744d7b7-gjb94

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/auth-invalid-token-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

Created v1.Service kserve-ci-e2e-test/auth-invalid-token-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

Created v1.Deployment kserve-ci-e2e-test/auth-invalid-token-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

Created v1.Secret kserve-ci-e2e-test/auth-invalid-token-test-kserve-self-signed-certs

kserve-ci-e2e-test

deployment-controller

auth-invalid-token-test-kserve

ScalingReplicaSet

Scaled up replica set auth-invalid-token-test-kserve-f5744d7b7 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

Created v1.Service kserve-ci-e2e-test/auth-invalid-token-test-epp-service

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-f5744d7b7-gjb94

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/auth-invalid-token-test-epp-rb

kserve-ci-e2e-test

multus

auth-invalid-token-test-kserve-router-scheduler-7748b48dbdsc89b

AddedInterface

Add eth0 [10.134.0.34/23] from ovn-kubernetes

kserve-ci-e2e-test

deployment-controller

auth-invalid-token-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set auth-invalid-token-test-kserve-router-scheduler-7748b48dbd from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-invalid-token-test-epp-auth-rb

kserve-ci-e2e-test

multus

auth-invalid-token-test-kserve-f5744d7b7-gjb94

AddedInterface

Add eth0 [10.134.0.33/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

Created v1.Deployment kserve-ci-e2e-test/auth-invalid-token-test-kserve-router-scheduler

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-f5744d7b7-gjb94

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-f5744d7b7-gjb94

Started

Started container storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

Created v1.Role kserve-ci-e2e-test/auth-invalid-token-test-epp-role

kserve-ci-e2e-test

replicaset-controller

auth-invalid-token-test-kserve-router-scheduler-7748b48dbd

SuccessfulCreate

Created pod: auth-invalid-token-test-kserve-router-scheduler-7748b48dbdsc89b

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-7748b48dbdsc89b

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-7748b48dbdsc89b

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-7748b48dbdsc89b

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-7748b48dbdsc89b

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-7748b48dbdsc89b

Created

Created container: main

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-7748b48dbdsc89b

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-7748b48dbdsc89b

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-7748b48dbdsc89b

Started

Started container main

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-7748b48dbdsc89b

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-f5744d7b7-gjb94

Pulling

Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0"

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Updated

Updated v1.Secret kserve-ci-e2e-test/auth-invalid-token-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/auth-invalid-token-test-kserve-route

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-7748b48dbdsc89b

Unhealthy

Startup probe failed: Get "http://10.134.0.34:8082/healthz": dial tcp 10.134.0.34:8082: connect: connection refused
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-invalid-token-test-kserve-shadow-svc

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-f5744d7b7-gjb94

Started

Started container main

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-f5744d7b7-gjb94

Pulled

Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" in 27.36s (27.36s including waiting). Image size: 3531177328 bytes.

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-f5744d7b7-gjb94

Created

Created container: main
(x11)

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-f5744d7b7-gjb94

Unhealthy

Startup probe failed: Get "https://10.134.0.33:8000/health": dial tcp 10.134.0.33:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

LLMInferenceServiceReady

LLMInferenceService [auth-invalid-token-test] is Ready

kserve-ci-e2e-test

LLMInferenceServiceController

auth-invalid-token-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-invalid-token-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-7748b48dbdsc89b

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-router-scheduler-7748b48dbdsc89b

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

auth-invalid-token-test-kserve-f5744d7b7-gjb94

Killing

Stopping container main
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

auth-disabled-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy auth-disabled-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/auth-disabled-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "auth-disabled-test-kserve-route" not found

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-router-scheduler-b5799d8f5-l8kp6

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

replicaset-controller

auth-disabled-test-kserve-699694bb49

SuccessfulCreate

Created pod: auth-disabled-test-kserve-699694bb49-m6gc4

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

Created v1.Secret kserve-ci-e2e-test/auth-disabled-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

Created v1.Deployment kserve-ci-e2e-test/auth-disabled-test-kserve

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-699694bb49-m6gc4

Started

Started container storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

Created v1.Service kserve-ci-e2e-test/auth-disabled-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/auth-disabled-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-disabled-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

Created v1.Role kserve-ci-e2e-test/auth-disabled-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/auth-disabled-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

Created v1.Deployment kserve-ci-e2e-test/auth-disabled-test-kserve-router-scheduler

kserve-ci-e2e-test

multus

auth-disabled-test-kserve-699694bb49-m6gc4

AddedInterface

Add eth0 [10.134.0.35/23] from ovn-kubernetes

kserve-ci-e2e-test

multus

auth-disabled-test-kserve-router-scheduler-b5799d8f5-l8kp6

AddedInterface

Add eth0 [10.134.0.36/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-699694bb49-m6gc4

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-router-scheduler-b5799d8f5-l8kp6

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-router-scheduler-b5799d8f5-l8kp6

Started

Started container storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

Created v1.Service kserve-ci-e2e-test/auth-disabled-test-epp-service

kserve-ci-e2e-test

deployment-controller

auth-disabled-test-kserve

ScalingReplicaSet

Scaled up replica set auth-disabled-test-kserve-699694bb49 from 0 to 1

kserve-ci-e2e-test

deployment-controller

auth-disabled-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set auth-disabled-test-kserve-router-scheduler-b5799d8f5 from 0 to 1

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-699694bb49-m6gc4

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

replicaset-controller

auth-disabled-test-kserve-router-scheduler-b5799d8f5

SuccessfulCreate

Created pod: auth-disabled-test-kserve-router-scheduler-b5799d8f5-l8kp6

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-router-scheduler-b5799d8f5-l8kp6

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-router-scheduler-b5799d8f5-l8kp6

Started

Started container main

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-router-scheduler-b5799d8f5-l8kp6

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-router-scheduler-b5799d8f5-l8kp6

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-router-scheduler-b5799d8f5-l8kp6

Created

Created container: main

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-router-scheduler-b5799d8f5-l8kp6

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-699694bb49-m6gc4

Started

Started container main

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-699694bb49-m6gc4

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-699694bb49-m6gc4

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Updated

Updated v1.Secret kserve-ci-e2e-test/auth-disabled-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/auth-disabled-test-kserve-route
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/auth-disabled-test-kserve-shadow-svc
(x11)

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-699694bb49-m6gc4

Unhealthy

Startup probe failed: Get "https://10.134.0.35:8000/health": dial tcp 10.134.0.35:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

LLMInferenceServiceReady

LLMInferenceService [auth-disabled-test] is Ready

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-router-scheduler-b5799d8f5-l8kp6

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-router-scheduler-b5799d8f5-l8kp6

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

auth-disabled-test-kserve-699694bb49-m6gc4

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

auth-disabled-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-auth-disabled-test-epp-auth-rb
(x13)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-fb-opt-125m-route-e95b1dc1

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route" not found

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd4 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-e95b1dc1

Created

Created v1.Secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-e95b1dc1

Created

Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-e95b1dc1

Created

Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-e95b1dc1

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-workload-svc

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd4

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-e95b1dc1

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4

AddedInterface

Add eth0 [10.132.0.46/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-e95b1dc1

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-e95b1dc1

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-fb-opt-125m-route-e95b1dc1] is Ready

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4

Killing

Stopping container main
(x6)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-e95b1dc1-kserve-76859b4cd44w7x4

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "llmisv122f03714c5bdf915a2917fdf1262b98-kserve-self-signed-certs" not found
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-fb-opt-125m-route-87882a8e

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

Created v1.Secret kserve-ci-e2e-test/llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-6b87f7f5c5mv4vf

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test21fe6730fe484f3a92b1a16afe1bac8f-llmisvc-mode

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-sa

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-route-87882a8e-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-route-87882a8e-kserve-6b87f7f5c5 from 0 to 1

kserve-ci-e2e-test

replicaset-controller

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler-548bd48954

SuccessfulCreate

Created pod: llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schesgxzg

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-6b87f7f5c5mv4vf

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-6b87f7f5c5mv4vf

Created

Created container: storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-epp-role

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-6b87f7f5c5mv4vf

AddedInterface

Add eth0 [10.134.0.37/23] from ovn-kubernetes

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-6b87f7f5c5

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-route-87882a8e-kserve-6b87f7f5c5mv4vf

kserve-ci-e2e-test

deployment-controller

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-scheduler-548bd48954 from 0 to 1

kserve-ci-e2e-test

kubelet

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schesgxzg

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schesgxzg

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schesgxzg

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

multus

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schesgxzg

AddedInterface

Add eth0 [10.134.0.38/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schesgxzg

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schesgxzg

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schesgxzg

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schesgxzg

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schesgxzg

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schesgxzg

Started

Started container tokenizer

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisva690bbc929faec8bc98c767f16c003c1-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-87882a8e-kserve-route

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-6b87f7f5c5mv4vf

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-6b87f7f5c5mv4vf

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-6b87f7f5c5mv4vf

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test8ac8e3d2264ccb939eb021b0b835847c-llmisvc-rout

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

Created v1.Secret kserve-ci-e2e-test/llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-role

kserve-ci-e2e-test

replicaset-controller

llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44d

SuccessfulCreate

Created pod: llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-rb
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-router-managed-test-llm-4b931143

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-router-managed-test-llm-4b931143-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-router-managed-test-llm-4b931143-kserve-route" not found

kserve-ci-e2e-test

deployment-controller

llmisvc-router-managed-test-llm-4b931143-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44d from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler

kserve-ci-e2e-test

deployment-controller

llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler-5597d7fd6 from 0 to 1

kserve-ci-e2e-test

replicaset-controller

llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-scheduler-5597d7fd6

SuccessfulCreate

Created pod: llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-epp-service

kserve-ci-e2e-test

kubelet

llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

multus

llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x

AddedInterface

Add eth0 [10.132.0.47/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-router-managed-test-llm-4b931143-kserve-66f88bc44dcnc5x

Started

Started container main

kserve-ci-e2e-test

multus

llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

llmisvcca2d2d7d499abb359505529ebe02c136-kserve-router-schevgktk

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisvca2d2d7d499abb359505529ebe02c136-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-router-managed-test-llm-4b931143-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-router-managed-test-llm-4b931143

LLMInferenceServiceReady

LLMInferenceService [llmisvc-router-managed-test-llm-4b931143] is Ready
(x11)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-6b87f7f5c5mv4vf

Unhealthy

Startup probe failed: Get "https://10.134.0.37:8000/health": dial tcp 10.134.0.37:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-fb-opt-125m-route-87882a8e] is Ready

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-87882a8e

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test21fe6730fe484f3a92b1a16afe1bac8f-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schesgxzg

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-6b87f7f5c5mv4vf

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvca690bbc929faec8bc98c767f16c003c1-kserve-router-schesgxzg

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-87882a8e-kserve-6b87f7f5c5mv4vf

Unhealthy

Readiness probe failed: Get "https://10.134.0.37:8000/health": dial tcp 10.134.0.37:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.Role kserve-ci-e2e-test/custom-route-timeout-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb

kserve-ci-e2e-test

deployment-controller

custom-route-timeout-test-kserve

ScalingReplicaSet

Scaled up replica set custom-route-timeout-test-kserve-598d8c75cc from 0 to 1
(x10)

kserve-ci-e2e-test

OpenDataHubModelController

custom-route-timeout-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-test-kserve-route" not found

kserve-ci-e2e-test

replicaset-controller

custom-route-timeout-test-kserve-598d8c75cc

SuccessfulCreate

Created pod: custom-route-timeout-test-kserve-598d8c75cc-qw9md

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-54bd696fwdw2l

Created

Created container: storage-initializer

kserve-ci-e2e-test

multus

custom-route-timeout-test-kserve-598d8c75cc-qw9md

AddedInterface

Add eth0 [10.134.0.39/23] from ovn-kubernetes

kserve-ci-e2e-test

multus

custom-route-timeout-test-kserve-router-scheduler-54bd696fwdw2l

AddedInterface

Add eth0 [10.134.0.40/23] from ovn-kubernetes

kserve-ci-e2e-test

replicaset-controller

custom-route-timeout-test-kserve-router-scheduler-54bd696fdf

SuccessfulCreate

Created pod: custom-route-timeout-test-kserve-router-scheduler-54bd696fwdw2l

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-epp-service

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-54bd696fwdw2l

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

deployment-controller

custom-route-timeout-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set custom-route-timeout-test-kserve-router-scheduler-54bd696fdf from 0 to 1

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-54bd696fwdw2l

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-598d8c75cc-qw9md

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-598d8c75cc-qw9md

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-598d8c75cc-qw9md

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-test-epp-rb

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-54bd696fwdw2l

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-54bd696fwdw2l

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-54bd696fwdw2l

Started

Started container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-54bd696fwdw2l

Created

Created container: main

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-54bd696fwdw2l

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-54bd696fwdw2l

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-598d8c75cc-qw9md

Created

Created container: main

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-598d8c75cc-qw9md

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-598d8c75cc-qw9md

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Updated

Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-test-kserve-shadow-svc
(x11)

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-598d8c75cc-qw9md

Unhealthy

Startup probe failed: Get "https://10.134.0.39:8000/health": dial tcp 10.134.0.39:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

LLMInferenceServiceReady

LLMInferenceService [custom-route-timeout-test] is Ready

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-54bd696fwdw2l

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-598d8c75cc-qw9md

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-54bd696fwdw2l

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-598d8c75cc-qw9md

Unhealthy

Readiness probe failed: Get "https://10.134.0.39:8000/health": dial tcp 10.134.0.39:8000: connect: connection refused
(x4)

kserve-ci-e2e-test

gateway_labeler_controller

router-gateway-1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway router-gateway-1

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-578d595fc-gtvkx

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-578d595fc-gtvkx

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

replicaset-controller

router-with-refs-test-kserve-578d595fc

SuccessfulCreate

Created pod: router-with-refs-test-kserve-578d595fc-gtvkx

kserve-ci-e2e-test

replicaset-controller

router-with-refs-test-kserve-router-scheduler-7d4868d689

SuccessfulCreate

Created pod: router-with-refs-test-kserve-router-scheduler-7d4868d689-h4c76

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.Service kserve-ci-e2e-test/router-with-refs-test-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.Role kserve-ci-e2e-test/router-with-refs-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-test-epp-sa

kserve-ci-e2e-test

multus

router-with-refs-test-kserve-578d595fc-gtvkx

AddedInterface

Add eth0 [10.134.0.41/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.Service kserve-ci-e2e-test/router-with-refs-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs

kserve-ci-e2e-test

deployment-controller

router-with-refs-test-kserve

ScalingReplicaSet

Scaled up replica set router-with-refs-test-kserve-578d595fc from 0 to 1

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-578d595fc-gtvkx

Created

Created container: storage-initializer

kserve-ci-e2e-test

deployment-controller

router-with-refs-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set router-with-refs-test-kserve-router-scheduler-7d4868d689 from 0 to 1

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-7d4868d689-h4c76

Started

Started container storage-initializer

kserve-ci-e2e-test

multus

router-with-refs-test-kserve-router-scheduler-7d4868d689-h4c76

AddedInterface

Add eth0 [10.134.0.42/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-7d4868d689-h4c76

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine
(x4)

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-test-kserve-workload-svc

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-7d4868d689-h4c76

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-7d4868d689-h4c76

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-7d4868d689-h4c76

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-7d4868d689-h4c76

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-7d4868d689-h4c76

Started

Started container main

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-7d4868d689-h4c76

Created

Created container: main

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-7d4868d689-h4c76

Started

Started container tokenizer

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Updated

Updated v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-578d595fc-gtvkx

Started

Started container main

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-578d595fc-gtvkx

Created

Created container: main

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-578d595fc-gtvkx

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine
(x11)

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-578d595fc-gtvkx

Unhealthy

Startup probe failed: Get "https://10.134.0.41:8000/health": dial tcp 10.134.0.41:8000: connect: connection refused
(x13)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-fb-opt-125m-with-7ca60146

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler-7cdd64995b from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test5216bfd716f919dc046bc693ceb22e41-llmisvc-mode

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

Created v1.Secret kserve-ci-e2e-test/llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6dbc7ddb8d

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6dbc7ddb8d-c625w

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-with-7ca60146-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6dbc7ddb8d from 0 to 1

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-scheduler-7cdd64995b

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6dbc7ddb8d-c625w

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6dbc7ddb8d-c625w

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6dbc7ddb8d-c625w

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-6dbc7ddb8d-c625w

Started

Started container storage-initializer

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw

AddedInterface

Add eth0 [10.133.0.42/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-7ca60146-kserve-router-schengntw

Created

Created container: tokenizer
(x13)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-fb-opt-125m-route-50bc673d

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route" not found

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-route-50bc673d-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-route-50bc673d-kserve-67b657cbf5 from 0 to 1

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-67b657cbf5

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-route-50bc673d-kserve-67b657cbf5wbjmg

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-rb

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-role

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

Created v1.Secret kserve-ci-e2e-test/llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-864m467

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

kserve-ci-e2e-test

replicaset-controller

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler-57bd5888f4

SuccessfulCreate

Created pod: llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-67b657cbf5wbjmg

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-8649d9d4d8 from 0 to 1

kserve-ci-e2e-test

deployment-controller

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvc44d181485fad85e662eb092f3749502f-kserve-router-scheduler-57bd5888f4 from 0 to 1

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-67b657cbf5wbjmg

Pulling

Pulling image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.7.1"

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test00d7278d8a22c4e39146a6b0eb840f45-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-864m467

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-864m467

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-864m467

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-8649d9d4d8

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-864m467

kserve-ci-e2e-test

kubelet

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-67b657cbf5wbjmg

Started

Started container llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

multus

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg

AddedInterface

Add eth0 [10.133.0.43/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-67b657cbf5wbjmg

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-67b657cbf5wbjmg

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.7.1" in 867ms (867ms including waiting). Image size: 67767940 bytes.

kserve-ci-e2e-test

kubelet

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-67b657cbf5wbjmg

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-67b657cbf5wbjmg

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-67b657cbf5wbjmg

Created

Created container: llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-67b657cbf5wbjmg

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-67b657cbf5wbjmg

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-864m467

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-864m467

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-864m467

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-67b657cbf5wbjmg

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv3e414c2ba058a022dfd694dbcbac5b51-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-7ca60146

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-7ca60146-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv44d181485fad85e662eb092f3749502f-kserve-self-signed-certs
(x10)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-50bc673d-kserve-route
(x16)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-67b657cbf5wbjmg

Unhealthy

Startup probe failed: Get "https://10.134.0.44:8001/health": dial tcp 10.134.0.44:8001: connect: connection refused
(x16)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-864m467

Unhealthy

Startup probe failed: Get "https://10.134.0.45:8000/health": dial tcp 10.134.0.45:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-fb-opt-125m-route-50bc673d] is Ready

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-67b657cbf5wbjmg

Killing

Stopping container llm-d-routing-sidecar

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-50bc673d

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test00d7278d8a22c4e39146a6b0eb840f45-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

llmisvc44d181485fad85e662eb092f3749502f-kserve-router-sche6jhfg

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-67b657cbf5wbjmg

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-50bc673d-kserve-prefill-864m467

Killing

Stopping container main
(x2)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:40be785b9abecd641f3121855a066c0ea01aba66e1350f33d175f2351c54e371" already present on machine
(x3)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd

Created

Created container: istio-proxy
(x3)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd

Started

Started container istio-proxy
(x11)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd

Unhealthy

Startup probe failed: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused
(x11)

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd

ProbeError

Startup probe error: Get "http://10.133.0.29:15021/healthz/ready": dial tcp 10.133.0.29:15021: connect: connection refused body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd

ProbeError

Startup probe error: Get "http://10.133.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) body:

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-56ccbcff6d-t7hbd

Unhealthy

Startup probe failed: Get "http://10.133.0.29:15021/healthz/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers)
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

custom-route-timeout-pd-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-pd-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-pd-test-kserve-route" not found

kserve-ci-e2e-test

deployment-controller

custom-route-timeout-pd-test-kserve

ScalingReplicaSet

Scaled up replica set custom-route-timeout-pd-test-kserve-78b45dc7ff from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-rb

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.Role kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-role

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs

kserve-ci-e2e-test

multus

custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7

AddedInterface

Add eth0 [10.133.0.44/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-78b45dc7ff-nzkk7

Started

Started container llm-d-routing-sidecar

kserve-ci-e2e-test

replicaset-controller

custom-route-timeout-pd-test-kserve-router-scheduler-6b5b695dd4

SuccessfulCreate

Created pod: custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7

kserve-ci-e2e-test

deployment-controller

custom-route-timeout-pd-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set custom-route-timeout-pd-test-kserve-router-scheduler-6b5b695dd4 from 0 to 1

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-78b45dc7ff-nzkk7

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-78b45dc7ff-nzkk7

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-78b45dc7ff-nzkk7

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7

Created

Created container: storage-initializer

kserve-ci-e2e-test

multus

custom-route-timeout-pd-test-kserve-78b45dc7ff-nzkk7

AddedInterface

Add eth0 [10.134.0.46/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-78b45dc7ff-nzkk7

Pulled

Container image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-78b45dc7ff-nzkk7

Created

Created container: llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.Service kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-epp-sa

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7

Started

Started container storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-7b4cdcb48f-wnvss

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-7b4cdcb48f-wnvss

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-7b4cdcb48f-wnvss

Started

Started container storage-initializer

kserve-ci-e2e-test

replicaset-controller

custom-route-timeout-pd-test-kserve-prefill-7b4cdcb48f

SuccessfulCreate

Created pod: custom-route-timeout-pd-test-kserve-prefill-7b4cdcb48f-wnvss

kserve-ci-e2e-test

deployment-controller

custom-route-timeout-pd-test-kserve-prefill

ScalingReplicaSet

Scaled up replica set custom-route-timeout-pd-test-kserve-prefill-7b4cdcb48f from 0 to 1

kserve-ci-e2e-test

replicaset-controller

custom-route-timeout-pd-test-kserve-78b45dc7ff

SuccessfulCreate

Created pod: custom-route-timeout-pd-test-kserve-78b45dc7ff-nzkk7

kserve-ci-e2e-test

multus

custom-route-timeout-pd-test-kserve-prefill-7b4cdcb48f-wnvss

AddedInterface

Add eth0 [10.134.0.47/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7

Started

Started container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7

Created

Created container: main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-7b4cdcb48f-wnvss

Created

Created container: main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-7b4cdcb48f-wnvss

Started

Started container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-7b4cdcb48f-wnvss

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-78b45dc7ff-nzkk7

Created

Created container: main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-78b45dc7ff-nzkk7

Started

Started container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-78b45dc7ff-nzkk7

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Updated

Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs
(x10)

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-shadow-svc
(x16)

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-78b45dc7ff-nzkk7

Unhealthy

Startup probe failed: Get "https://10.134.0.46:8001/health": dial tcp 10.134.0.46:8001: connect: connection refused
(x16)

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-7b4cdcb48f-wnvss

Unhealthy

Startup probe failed: Get "https://10.134.0.47:8000/health": dial tcp 10.134.0.47:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

LLMInferenceServiceReady

LLMInferenceService [custom-route-timeout-pd-test] is Ready

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-78b45dc7ff-nzkk7

Killing

Stopping container llm-d-routing-sidecar

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-78b45dc7ff-nzkk7

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6b5b6588r7

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-7b4cdcb48f-wnvss

Killing

Stopping container main

kserve-ci-e2e-test

replicaset-controller

router-gateway-2-openshift-default-78c98f6f4c

SuccessfulCreate

Created pod: router-gateway-2-openshift-default-78c98f6f4c-ddrqp

kserve-ci-e2e-test

deployment-controller

router-gateway-2-openshift-default

ScalingReplicaSet

Scaled up replica set router-gateway-2-openshift-default-78c98f6f4c from 0 to 1

kserve-ci-e2e-test

service-controller

router-gateway-2-openshift-default

EnsuringLoadBalancer

Ensuring load balancer

kserve-ci-e2e-test

gateway_labeler_controller

router-gateway-2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway router-gateway-2

kserve-ci-e2e-test

multus

router-gateway-2-openshift-default-78c98f6f4c-ddrqp

AddedInterface

Add eth0 [10.132.0.48/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

router-gateway-2-openshift-default-78c98f6f4c-ddrqp

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:40be785b9abecd641f3121855a066c0ea01aba66e1350f33d175f2351c54e371"

kserve-ci-e2e-test

kubelet

router-gateway-2-openshift-default-78c98f6f4c-ddrqp

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:40be785b9abecd641f3121855a066c0ea01aba66e1350f33d175f2351c54e371" in 2.491s (2.491s including waiting). Image size: 179625600 bytes.

kserve-ci-e2e-test

service-controller

router-gateway-2-openshift-default

EnsuredLoadBalancer

Ensured load balancer
(x2)

kserve-ci-e2e-test

kubelet

router-gateway-2-openshift-default-78c98f6f4c-ddrqp

Created

Created container: istio-proxy
(x2)

kserve-ci-e2e-test

kubelet

router-gateway-2-openshift-default-78c98f6f4c-ddrqp

Started

Started container istio-proxy

kserve-ci-e2e-test

kubelet

router-gateway-2-openshift-default-78c98f6f4c-ddrqp

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:40be785b9abecd641f3121855a066c0ea01aba66e1350f33d175f2351c54e371" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-epp-sa

kserve-ci-e2e-test

deployment-controller

router-with-refs-pd-test-kserve-prefill

ScalingReplicaSet

Scaled up replica set router-with-refs-pd-test-kserve-prefill-5fc8578dd5 from 0 to 1

kserve-ci-e2e-test

deployment-controller

router-with-refs-pd-test-kserve

ScalingReplicaSet

Scaled up replica set router-with-refs-pd-test-kserve-6f78896447 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.Role kserve-ci-e2e-test/router-with-refs-pd-test-kserve-role

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-pd-test-kserve-rb

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-6f78896447-wshh4

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-6f78896447-wshh4

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-6f78896447-wshh4

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-6f78896447-wshh4

Started

Started container llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-6f78896447-wshh4

Created

Created container: llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-6f78896447-wshh4

Pulled

Container image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.7.1" already present on machine

kserve-ci-e2e-test

multus

router-with-refs-pd-test-kserve-6f78896447-wshh4

AddedInterface

Add eth0 [10.134.0.48/23] from ovn-kubernetes

kserve-ci-e2e-test

multus

router-with-refs-pd-test-kserve-prefill-5fc8578dd5-d6lhp

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-5fc8578dd5-d6lhp

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-5fc8578dd5-d6lhp

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-5fc8578dd5-d6lhp

Started

Started container storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.Service kserve-ci-e2e-test/router-with-refs-pd-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb

kserve-ci-e2e-test

replicaset-controller

router-with-refs-pd-test-kserve-6f78896447

SuccessfulCreate

Created pod: router-with-refs-pd-test-kserve-6f78896447-wshh4

kserve-ci-e2e-test

replicaset-controller

router-with-refs-pd-test-kserve-prefill-5fc8578dd5

SuccessfulCreate

Created pod: router-with-refs-pd-test-kserve-prefill-5fc8578dd5-d6lhp

kserve-ci-e2e-test

multus

router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b

AddedInterface

Add eth0 [10.133.0.45/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b

Started

Started container storage-initializer

kserve-ci-e2e-test

replicaset-controller

router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfb

SuccessfulCreate

Created pod: router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b

Created

Created container: storage-initializer

kserve-ci-e2e-test

deployment-controller

router-with-refs-pd-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfb from 0 to 1

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b

Created

Created container: main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b

Started

Started container main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-5f7487fdfmr99b

Started

Started container tokenizer
(x5)

kserve-ci-e2e-test

kubelet

router-gateway-2-openshift-default-78c98f6f4c-ddrqp

Unhealthy

Startup probe failed: Get "http://10.132.0.48:15021/healthz/ready": dial tcp 10.132.0.48:15021: connect: connection refused
(x8)

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-pd-test-kserve-workload-svc

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-6f78896447-wshh4

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-6f78896447-wshh4

Started

Started container main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-6f78896447-wshh4

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Updated

Updated v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-5fc8578dd5-d6lhp

Created

Created container: main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-5fc8578dd5-d6lhp

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-5fc8578dd5-d6lhp

Started

Started container main
(x12)

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-6f78896447-wshh4

Unhealthy

Startup probe failed: Get "https://10.134.0.48:8001/health": dial tcp 10.134.0.48:8001: connect: connection refused
(x11)

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-5fc8578dd5-d6lhp

Unhealthy

Startup probe failed: Get "https://10.134.0.49:8000/health": dial tcp 10.134.0.49:8000: connect: connection refused
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-fb-opt-125m-with-ba4d693a

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-rb

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-766cc944c5-85gl8

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-766cc944c5-85gl8

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler-86f69d9999 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

Created v1.Secret kserve-ci-e2e-test/llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-workload-svc

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-scheduler-86f69d9999

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test05addb65ba05195619f26ef266e8fc04-llmisvc-mode

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-role

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-766cc944c5

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-766cc944c5-85gl8

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-epp-service

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-766cc944c5 from 0 to 1

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz

AddedInterface

Add eth0 [10.133.0.46/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-766cc944c5-85gl8

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-766cc944c5-85gl8

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-router-schest4hz

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv77ff2528d3e9b4972cd9335229fce9f0-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-shadow-svc

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-766cc944c5-85gl8

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-766cc944c5-85gl8

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-766cc944c5-85gl8

Created

Created container: main
(x8)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-with-ba4d693a-kserve-766cc944c5-85gl8

Unhealthy

Startup probe failed: Get "https://10.134.0.50:8000/health": dial tcp 10.134.0.50:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-with-ba4d693a

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-fb-opt-125m-with-ba4d693a] is Ready
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-fb-opt-125m-route-3c960099

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-3c960099-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-3c960099-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-3c960099

Created

Created v1.Secret kserve-ci-e2e-test/llmisvd10b93c8eba12f87c3a350a5cae2ee0c-kserve-self-signed-certs

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-route-3c960099-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-route-3c960099-kserve-55868c9d74 from 0 to 1

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-3c960099-kserve-55868c9d74fpbf8

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-3c960099-kserve-55868c9d74fpbf8

Started

Started container storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-3c960099

Created

Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-3c960099

Created

Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-route

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-3c960099-kserve-55868c9d74fpbf8

Created

Created container: storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-3c960099

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-3c960099

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-3c960099-kserve

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-route-3c960099-kserve-55868c9d74

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-route-3c960099-kserve-55868c9d74fpbf8

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-3c960099-kserve-55868c9d74fpbf8

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-3c960099-kserve-55868c9d74fpbf8

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-3c960099-kserve-55868c9d74fpbf8

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-3c960099-kserve-55868c9d74fpbf8

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-3c960099

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisvd10b93c8eba12f87c3a350a5cae2ee0c-kserve-self-signed-certs
(x12)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-3c960099-kserve-55868c9d74fpbf8

Unhealthy

Startup probe failed: Get "https://10.134.0.51:8000/health": dial tcp 10.134.0.51:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-3c960099

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-fb-opt-125m-route-3c960099] is Ready

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-3c960099-kserve-55868c9d74fpbf8

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-3c960099-kserve-55868c9d74fpbf8

Unhealthy

Readiness probe failed: Get "https://10.134.0.51:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-role

kserve-ci-e2e-test

replicaset-controller

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler-7f6b44d55d

SuccessfulCreate

Created pod: llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegs79x

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn

CreatingRevision

Creating revision with key 588ff956b for a newly created LeaderWorkerSet

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn

GroupsProgressing

Created leader statefulset llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn

GroupsProgressing

Replicas are progressing, with 0 groups ready of total 1 groups

kserve-ci-e2e-test

deployment-controller

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-scheduler-7f6b44d55d from 0 to 1
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-fb-opt-125m-route-dc21cb14

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

Created v1.Secret kserve-ci-e2e-test/llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-scc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test386bd5808c5c450f11fd8632e1f821fb-llmisvc-mode

kserve-ci-e2e-test

statefulset-controller

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn

SuccessfulCreate

create Pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 in StatefulSet llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn successful

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegs79x

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

Pulling

Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada"

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegs79x

Created

Created container: storage-initializer

kserve-ci-e2e-test

statefulset-controller

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

SuccessfulCreate

create Pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1 in StatefulSet llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0 successful

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

AddedInterface

Add eth0 [10.132.0.49/23] from ovn-kubernetes

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn

GroupsProgressing

Created worker statefulset for leader pod llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

kserve-ci-e2e-test

multus

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegs79x

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegs79x

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegs79x

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegs79x

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegs79x

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegs79x

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegs79x

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegs79x

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" in 3.932s (3.932s including waiting). Image size: 299992506 bytes.

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

Pulling

Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0"

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-route
(x8)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-shadow-svc

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

Pulled

Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" in 27.461s (27.461s including waiting). Image size: 3531177328 bytes.

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

Created

Created container: main
(x10)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

Unhealthy

Startup probe failed: Get "https://10.134.0.53:8000/health": dial tcp 10.134.0.53:8000: connect: connection refused
(x2)

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn

AllGroupsReady

All replicas are ready, with 1 groups ready of total 1 groups

kserve-ci-e2e-test

LLMInferenceServiceController

conv-test-criticality

UpdateFailed

Failed to update status for LLMInferenceService "conv-test-criticality": Operation cannot be fulfilled on llminferenceservices.serving.kserve.io "conv-test-criticality": the object has been modified; please apply your changes to the latest version and try again

kserve-ci-e2e-test

LLMInferenceServiceController

conv-test-v1a2-to-v1a1

UpdateFailed

Failed to update status for LLMInferenceService "conv-test-v1a2-to-v1a1": Operation cannot be fulfilled on llminferenceservices.serving.kserve.io "conv-test-v1a2-to-v1a1": the object has been modified; please apply your changes to the latest version and try again

kserve-ci-e2e-test

multus

stop-feature-test-kserve-7c64ccc5f7-hmdd6

AddedInterface

Add eth0 [10.132.0.50/23] from ovn-kubernetes

kserve-ci-e2e-test

replicaset-controller

stop-feature-test-kserve-router-scheduler-7f74f857ff

SuccessfulCreate

Created pod: stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-7c64ccc5f7-hmdd6

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-7c64ccc5f7-hmdd6

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-7c64ccc5f7-hmdd6

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

multus

stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd

AddedInterface

Add eth0 [10.133.0.47/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc

kserve-ci-e2e-test

deployment-controller

stop-feature-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set stop-feature-test-kserve-router-scheduler-7f74f857ff from 0 to 1

kserve-ci-e2e-test

replicaset-controller

stop-feature-test-kserve-7c64ccc5f7

SuccessfulCreate

Created pod: stop-feature-test-kserve-7c64ccc5f7-hmdd6

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/stop-feature-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.Role kserve-ci-e2e-test/stop-feature-test-epp-role

kserve-ci-e2e-test

deployment-controller

stop-feature-test-kserve

ScalingReplicaSet

Scaled up replica set stop-feature-test-kserve-7c64ccc5f7 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-stop-feature-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd

Started

Started container main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd

Created

Created container: main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd

Created

Created container: tokenizer

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-fb-opt-125m-route-dc21cb14] is Ready

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/stop-feature-test-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Updated

Updated v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-dc21cb14

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test386bd5808c5c450f11fd8632e1f821fb-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegs79x

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc32fd5468e8138ec3cd54cf7b9c18cfb0-kserve-router-schegs79x

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-7c64ccc5f7-hmdd6

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-7c64ccc5f7-hmdd6

Created

Created container: main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-7c64ccc5f7-hmdd6

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-dc21cb14-kserve-mn-0-1

Killing

Stopping container main
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

scheduler-inline-config-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-inline-config-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-inline-config-test-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb

kserve-ci-e2e-test

replicaset-controller

scheduler-inline-config-test-kserve-router-scheduler-5484fd9dd

SuccessfulCreate

Created pod: scheduler-inline-config-test-kserve-router-scheduler-5484fkg45z

kserve-ci-e2e-test

multus

scheduler-inline-config-test-kserve-d5fb8b768-9kwjd

AddedInterface

Add eth0 [10.132.0.51/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-d5fb8b768-9kwjd

Created

Created container: main

kserve-ci-e2e-test

replicaset-controller

scheduler-inline-config-test-kserve-d5fb8b768

SuccessfulCreate

Created pod: scheduler-inline-config-test-kserve-d5fb8b768-9kwjd

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-d5fb8b768-9kwjd

Started

Started container main

kserve-ci-e2e-test

multus

scheduler-inline-config-test-kserve-router-scheduler-5484fkg45z

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-5484fkg45z

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

deployment-controller

scheduler-inline-config-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set scheduler-inline-config-test-kserve-router-scheduler-5484fd9dd from 0 to 1

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-d5fb8b768-9kwjd

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

deployment-controller

scheduler-inline-config-test-kserve

ScalingReplicaSet

Scaled up replica set scheduler-inline-config-test-kserve-d5fb8b768 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/scheduler-inline-config-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.Role kserve-ci-e2e-test/scheduler-inline-config-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-inline-config-test-epp-sa

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-5484fkg45z

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-5484fkg45z

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-5484fkg45z

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-5484fkg45z

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-5484fkg45z

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Updated

Updated v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-inline-config-test-kserve-shadow-svc

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-5484fkg45z

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-5484fkg45z

Killing

Stopping container tokenizer

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

LLMInferenceServiceReady

LLMInferenceService [scheduler-inline-config-test] is Ready

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-d5fb8b768-9kwjd

Killing

Stopping container main
(x11)

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-7c64ccc5f7-hmdd6

Unhealthy

Startup probe failed: Get "https://10.132.0.50:8000/health": dial tcp 10.132.0.50:8000: connect: connection refused
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

Created v1.Secret kserve-ci-e2e-test/llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-service

kserve-ci-e2e-test

replicaset-controller

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler-568b7cf555

SuccessfulCreate

Created pod: llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrhrf

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler

kserve-ci-e2e-test

deployment-controller

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-scheduler-568b7cf555 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test80f99418f0f3eb4c80f02e6144a6d4f2-llmisvc-mode

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674

SuccessfulCreate

Created pod: llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-epp-rb

kserve-ci-e2e-test

deployment-controller

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-workload-svc

kserve-ci-e2e-test

kubelet

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrhrf

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrhrf

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr

Created

Created container: main

kserve-ci-e2e-test

multus

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrhrf

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrhrf

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

multus

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr

AddedInterface

Add eth0 [10.132.0.52/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrhrf

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrhrf

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrhrf

Started

Started container tokenizer

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv431d7e30f13554296364403a5b6365f5-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-7c64ccc5f7-hmdd6

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5ppbd

Killing

Stopping container tokenizer

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.InferencePool kserve-ci-e2e-test/stop-feature-test-inference-pool

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

LLMInferenceServiceNotReady

LLMInferenceService [stop-feature-test] is no longer Ready because of: GatewaysReady, HTTPRoutesReady, InferencePoolReady, MainWorkloadReady, PrefillWorkerWorkloadReady, PrefillWorkloadReady, RouterReady, SchedulerWorkloadReady, WorkerWorkloadReady, WorkloadsReady
(x25)

kserve-ci-e2e-test

OpenDataHubModelController

stop-feature-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy stop-feature-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "stop-feature-test-kserve-route" not found

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5fvn8

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5fvn8

Created

Created container: storage-initializer

kserve-ci-e2e-test

deployment-controller

stop-feature-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set stop-feature-test-kserve-router-scheduler-7f74f857ff from 0 to 1

kserve-ci-e2e-test

replicaset-controller

stop-feature-test-kserve-router-scheduler-7f74f857ff

SuccessfulCreate

Created pod: stop-feature-test-kserve-router-scheduler-7f74f857ff-5fvn8

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-7c64ccc5f7-jgr84

Started

Started container storage-initializer

kserve-ci-e2e-test

deployment-controller

stop-feature-test-kserve

ScalingReplicaSet

Scaled up replica set stop-feature-test-kserve-7c64ccc5f7 from 0 to 1

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-7c64ccc5f7-jgr84

Created

Created container: storage-initializer

kserve-ci-e2e-test

multus

stop-feature-test-kserve-7c64ccc5f7-jgr84

AddedInterface

Add eth0 [10.132.0.53/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-7c64ccc5f7-jgr84

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

replicaset-controller

stop-feature-test-kserve-7c64ccc5f7

SuccessfulCreate

Created pod: stop-feature-test-kserve-7c64ccc5f7-jgr84

kserve-ci-e2e-test

multus

stop-feature-test-kserve-router-scheduler-7f74f857ff-5fvn8

AddedInterface

Add eth0 [10.134.0.56/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5fvn8

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5fvn8

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5fvn8

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5fvn8

Created

Created container: main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5fvn8

Started

Started container main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5fvn8

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5fvn8

Started

Started container tokenizer

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

LLMInferenceServiceReady

LLMInferenceService [llmisvc-model-qwen2-5-0-5b-rout-4c1ba212] is Ready

kserve-ci-e2e-test

kubelet

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212-kserve-7c94bd674-cpqpr

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-qwen2-5-0-5b-rout-4c1ba212

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test80f99418f0f3eb4c80f02e6144a6d4f2-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrhrf

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrhrf

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

llmisvc431d7e30f13554296364403a5b6365f5-kserve-router-schegrhrf

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.55:9003" within 1s: context deadline exceeded

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-7c64ccc5f7-jgr84

Started

Started container main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-7c64ccc5f7-jgr84

Created

Created container: main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-7c64ccc5f7-jgr84

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

scheduler-configmap-ref-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-configmap-ref-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-configmap-ref-test-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.Role kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-role

kserve-ci-e2e-test

multus

scheduler-configmap-ref-test-kserve-67776fd94d-4b46z

AddedInterface

Add eth0 [10.132.0.54/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-67776fd94d-4b46z

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine

kserve-ci-e2e-test

replicaset-controller

scheduler-configmap-ref-test-kserve-67776fd94d

SuccessfulCreate

Created pod: scheduler-configmap-ref-test-kserve-67776fd94d-4b46z

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-rb

kserve-ci-e2e-test

replicaset-controller

scheduler-configmap-ref-test-kserve-router-scheduler-5596f7bfb6

SuccessfulCreate

Created pod: scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs

kserve-ci-e2e-test

deployment-controller

scheduler-configmap-ref-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set scheduler-configmap-ref-test-kserve-router-scheduler-5596f7bfb6 from 0 to 1

kserve-ci-e2e-test

deployment-controller

scheduler-configmap-ref-test-kserve

ScalingReplicaSet

Scaled up replica set scheduler-configmap-ref-test-kserve-67776fd94d from 0 to 1

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-67776fd94d-4b46z

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

multus

scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj

AddedInterface

Add eth0 [10.133.0.48/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-67776fd94d-4b46z

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Updated

Updated v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

LLMInferenceServiceReady

LLMInferenceService [scheduler-configmap-ref-test] is Ready

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-67776fd94d-4b46z

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-5596f8xhlj

Killing

Stopping container tokenizer
(x10)

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-7c64ccc5f7-jgr84

Unhealthy

Startup probe failed: Get "https://10.132.0.53:8000/health": dial tcp 10.132.0.53:8000: connect: connection refused
(x2)

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

LLMInferenceServiceReady

LLMInferenceService [stop-feature-test] is Ready

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5fvn8

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5fvn8

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5fvn8

Unhealthy

Readiness probe failed: Get "http://10.134.0.56:8082/healthz": dial tcp 10.134.0.56:8082: connect: connection refused

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-7c64ccc5f7-jgr84

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7f74f857ff-5fvn8

Unhealthy

Readiness probe failed: timeout: failed to connect service "10.134.0.56:9003" within 1s: context deadline exceeded
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

lora-single-adapter-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy lora-single-adapter-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/lora-single-adapter-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "lora-single-adapter-test-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

lora-single-adapter-test

Created

Created v1.Secret kserve-ci-e2e-test/lora-single-adapter-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

lora-single-adapter-test

Created

Created v1.Deployment kserve-ci-e2e-test/lora-single-adapter-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

lora-single-adapter-test

Created

Created v1.HTTPRoute kserve-ci-e2e-test/lora-single-adapter-test-kserve-route

kserve-ci-e2e-test

deployment-controller

lora-single-adapter-test-kserve

ScalingReplicaSet

Scaled up replica set lora-single-adapter-test-kserve-6878c54cbb from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

lora-single-adapter-test

Created

Created v1.DestinationRule kserve-ci-e2e-test/lora-single-adapter-test-kserve-workload-svc

kserve-ci-e2e-test

multus

lora-single-adapter-test-kserve-6878c54cbb-44tgc

AddedInterface

Add eth0 [10.132.0.55/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

lora-single-adapter-test-kserve-6878c54cbb-44tgc

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

kubelet

lora-single-adapter-test-kserve-6878c54cbb-44tgc

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

lora-single-adapter-test-kserve-6878c54cbb-44tgc

Started

Started container storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

lora-single-adapter-test

Created

Created v1.Service kserve-ci-e2e-test/lora-single-adapter-test-kserve-workload-svc

kserve-ci-e2e-test

replicaset-controller

lora-single-adapter-test-kserve-6878c54cbb

SuccessfulCreate

Created pod: lora-single-adapter-test-kserve-6878c54cbb-44tgc

kserve-ci-e2e-test

kubelet

lora-single-adapter-test-kserve-6878c54cbb-44tgc

Started

Started container main

kserve-ci-e2e-test

kubelet

lora-single-adapter-test-kserve-6878c54cbb-44tgc

Created

Created container: main

kserve-ci-e2e-test

kubelet

lora-single-adapter-test-kserve-6878c54cbb-44tgc

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

lora-single-adapter-test

Updated

Updated v1.Secret kserve-ci-e2e-test/lora-single-adapter-test-kserve-self-signed-certs
(x7)

kserve-ci-e2e-test

kubelet

lora-single-adapter-test-kserve-6878c54cbb-44tgc

Unhealthy

Startup probe failed: Get "https://10.132.0.55:8000/health": dial tcp 10.132.0.55:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

lora-single-adapter-test

LLMInferenceServiceReady

LLMInferenceService [lora-single-adapter-test] is Ready

kserve-ci-e2e-test

kubelet

lora-single-adapter-test-kserve-6878c54cbb-44tgc

Killing

Stopping container main
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

lora-multiple-adapters-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy lora-multiple-adapters-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "lora-multiple-adapters-test-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

lora-multiple-adapters-test

Created

Created v1.Service kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-workload-svc

kserve-ci-e2e-test

kubelet

lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n

Created

Created container: storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

lora-multiple-adapters-test

Created

Created v1.DestinationRule kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

lora-multiple-adapters-test

Created

Created v1.HTTPRoute kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-route

kserve-ci-e2e-test

multus

lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n

AddedInterface

Add eth0 [10.132.0.56/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

lora-multiple-adapters-test

Created

Created v1.Deployment kserve-ci-e2e-test/lora-multiple-adapters-test-kserve

kserve-ci-e2e-test

kubelet

lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

replicaset-controller

lora-multiple-adapters-test-kserve-5879d5bfc

SuccessfulCreate

Created pod: lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n

kserve-ci-e2e-test

kubelet

lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n

Started

Started container storage-initializer

kserve-ci-e2e-test

deployment-controller

lora-multiple-adapters-test-kserve

ScalingReplicaSet

Scaled up replica set lora-multiple-adapters-test-kserve-5879d5bfc from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

lora-multiple-adapters-test

Created

Created v1.Secret kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n

Started

Started container main

kserve-ci-e2e-test

kubelet

lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n

Created

Created container: main

kserve-ci-e2e-test

kubelet

lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

lora-multiple-adapters-test

Updated

Updated v1.Secret kserve-ci-e2e-test/lora-multiple-adapters-test-kserve-self-signed-certs
(x7)

kserve-ci-e2e-test

kubelet

lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n

Unhealthy

Startup probe failed: Get "https://10.132.0.56:8000/health": dial tcp 10.132.0.56:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

lora-multiple-adapters-test

LLMInferenceServiceReady

LLMInferenceService [lora-multiple-adapters-test] is Ready

kserve-ci-e2e-test

kubelet

lora-multiple-adapters-test-kserve-5879d5bfc-s9g2n

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

Created v1.Role kserve-ci-e2e-test/prestop-hook-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/prestop-hook-test-epp-sa

kserve-ci-e2e-test

replicaset-controller

prestop-hook-test-kserve-6758474485

SuccessfulCreate

Created pod: prestop-hook-test-kserve-6758474485-78tpc

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-prestop-hook-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

Created v1.Secret kserve-ci-e2e-test/prestop-hook-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

Created v1.Deployment kserve-ci-e2e-test/prestop-hook-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

Created v1.Service kserve-ci-e2e-test/prestop-hook-test-kserve-workload-svc

kserve-ci-e2e-test

deployment-controller

prestop-hook-test-kserve

ScalingReplicaSet

Scaled up replica set prestop-hook-test-kserve-6758474485 from 0 to 1

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6758474485-78tpc

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-router-scheduler-8578fc44f9-fs8xv

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

multus

prestop-hook-test-kserve-router-scheduler-8578fc44f9-fs8xv

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/prestop-hook-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

Created v1.Deployment kserve-ci-e2e-test/prestop-hook-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

Created v1.Service kserve-ci-e2e-test/prestop-hook-test-epp-service

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-router-scheduler-8578fc44f9-fs8xv

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-router-scheduler-8578fc44f9-fs8xv

Created

Created container: storage-initializer

kserve-ci-e2e-test

multus

prestop-hook-test-kserve-6758474485-78tpc

AddedInterface

Add eth0 [10.132.0.57/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6758474485-78tpc

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6758474485-78tpc

Started

Started container storage-initializer

kserve-ci-e2e-test

replicaset-controller

prestop-hook-test-kserve-router-scheduler-8578fc44f9

SuccessfulCreate

Created pod: prestop-hook-test-kserve-router-scheduler-8578fc44f9-fs8xv

kserve-ci-e2e-test

deployment-controller

prestop-hook-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set prestop-hook-test-kserve-router-scheduler-8578fc44f9 from 0 to 1

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-router-scheduler-8578fc44f9-fs8xv

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-router-scheduler-8578fc44f9-fs8xv

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-router-scheduler-8578fc44f9-fs8xv

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-router-scheduler-8578fc44f9-fs8xv

Started

Started container main

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-router-scheduler-8578fc44f9-fs8xv

Created

Created container: main

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-router-scheduler-8578fc44f9-fs8xv

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6758474485-78tpc

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6758474485-78tpc

Created

Created container: main

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6758474485-78tpc

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Updated

Updated v1.HTTPRoute kserve-ci-e2e-test/prestop-hook-test-kserve-route
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/prestop-hook-test-kserve-shadow-svc
(x11)

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6758474485-78tpc

Unhealthy

Startup probe failed: Get "https://10.132.0.57:8000/health": dial tcp 10.132.0.57:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

LLMInferenceServiceReady

LLMInferenceService [prestop-hook-test] is Ready

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6758474485-mt9pm

Created

Created container: storage-initializer

kserve-ci-e2e-test

replicaset-controller

prestop-hook-test-kserve-6758474485

SuccessfulCreate

Created pod: prestop-hook-test-kserve-6758474485-mt9pm

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6758474485-78tpc

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6758474485-mt9pm

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6758474485-mt9pm

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:ba8edcbfb3f9312d158be16483785d7654e60c7090f262c42214fd2b29effada" already present on machine

kserve-ci-e2e-test

multus

prestop-hook-test-kserve-6758474485-mt9pm

AddedInterface

Add eth0 [10.132.0.58/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6758474485-mt9pm

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6758474485-mt9pm

Started

Started container main

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6758474485-mt9pm

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

LLMInferenceServiceNotReady

LLMInferenceService [prestop-hook-test] is no longer Ready because of: MainWorkloadReady, WorkloadsReady

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6758474485-mt9pm

Unhealthy

Startup probe failed: Get "https://10.132.0.58:8000/health": dial tcp 10.132.0.58:8000: connect: connection refused

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-6758474485-mt9pm

Killing

Stopping container main
(x3)

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Updated

Updated v1.Secret kserve-ci-e2e-test/prestop-hook-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-router-scheduler-8578fc44f9-fs8xv

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

prestop-hook-test-kserve-router-scheduler-8578fc44f9-fs8xv

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

prestop-hook-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-prestop-hook-test-epp-auth-rb