Time Namespace Component RelatedObject Reason Message

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-8547b4b7ccrvpvg

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-8547b4b7ccrvpvg to ip-10-0-130-165.ec2.internal

kuadrant-system

limitador-limitador-64c8f475fb-jkpnq

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-64c8f475fb-jkpnq to ip-10-0-132-246.ec2.internal

kserve-ci-e2e-test

router-gateway-1-openshift-default-6c59fbf55c-vfv42

Scheduled

Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-6c59fbf55c-vfv42 to ip-10-0-130-165.ec2.internal

kserve-ci-e2e-test

custom-route-timeout-pd-test-kserve-58fbddc65d-2b7r9

Scheduled

Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-58fbddc65d-2b7r9 to ip-10-0-130-165.ec2.internal

kserve-ci-e2e-test

scheduler-inline-config-test-kserve-58544ffb65-tdgdw

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-58544ffb65-tdgdw to ip-10-0-132-246.ec2.internal

kserve-ci-e2e-test

scheduler-inline-config-test-kserve-router-scheduler-7599bzdpq7

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7599bzdpq7 to ip-10-0-138-125.ec2.internal

kserve-ci-e2e-test

stop-feature-test-kserve-5f6c45bb9b-pnzp2

Scheduled

Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-5f6c45bb9b-pnzp2 to ip-10-0-130-165.ec2.internal

kserve-ci-e2e-test

stop-feature-test-kserve-5f6c45bb9b-slkzd

Scheduled

Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-5f6c45bb9b-slkzd to ip-10-0-130-165.ec2.internal

kserve-ci-e2e-test

stop-feature-test-kserve-router-scheduler-7b969df585-d5k7p

Scheduled

Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7b969df585-d5k7p to ip-10-0-138-125.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-5d687994f-pdkfx

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-5d687994f-pdkfx to ip-10-0-130-165.ec2.internal

kserve-ci-e2e-test

router-with-refs-pd-test-kserve-router-scheduler-55f8fdb599zwbj

Scheduled

Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-55f8fdb599zwbj to ip-10-0-132-246.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 to ip-10-0-138-125.ec2.internal

kuadrant-system

dns-operator-controller-manager-844548ff4c-g7ll6

Scheduled

Successfully assigned kuadrant-system/dns-operator-controller-manager-844548ff4c-g7ll6 to ip-10-0-130-165.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 to ip-10-0-130-165.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-88d57bfd-x8x5k

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-88d57bfd-x8x5k to ip-10-0-130-165.ec2.internal

kserve-ci-e2e-test

scheduler-configmap-ref-test-kserve-f6cb4c9b9-thlbk

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-f6cb4c9b9-thlbk to ip-10-0-138-125.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-5c6f4f9f98762tc

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-5c6f4f9f98762tc to ip-10-0-130-165.ec2.internal

kuadrant-system

limitador-operator-controller-manager-c7fb4c8d5-bkfpn

Scheduled

Successfully assigned kuadrant-system/limitador-operator-controller-manager-c7fb4c8d5-bkfpn to ip-10-0-132-246.ec2.internal

kserve-ci-e2e-test

stop-feature-test-kserve-router-scheduler-7b969df585-rfb4b

Scheduled

Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-7b969df585-rfb4b to ip-10-0-138-125.ec2.internal

openshift-ingress

router-default-6db657d5cd-98k8d

Scheduled

Successfully assigned openshift-ingress/router-default-6db657d5cd-98k8d to ip-10-0-138-125.ec2.internal

kserve-ci-e2e-test

router-with-refs-test-kserve-router-scheduler-cc4b6bc7f-tpxf6

Scheduled

Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-cc4b6bc7f-tpxf6 to ip-10-0-132-246.ec2.internal

kserve-ci-e2e-test

precise-prefix-cache-test-kserve-router-scheduler-85554c459kw9w

Scheduled

Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-85554c459kw9w to ip-10-0-138-125.ec2.internal

kserve-ci-e2e-test

router-with-refs-test-kserve-575fcb7644-7xbkj

Scheduled

Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-575fcb7644-7xbkj to ip-10-0-130-165.ec2.internal

kserve-ci-e2e-test

custom-route-timeout-test-kserve-router-scheduler-6986d4b88629p

Scheduled

Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-6986d4b88629p to ip-10-0-132-246.ec2.internal

kserve-ci-e2e-test

scheduler-ha-replicas-test-kserve-router-scheduler-84cf845rzwp4

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-84cf845rzwp4 to ip-10-0-138-125.ec2.internal

kuadrant-system

kuadrant-console-plugin-6c886788f8-ncp8v

Scheduled

Successfully assigned kuadrant-system/kuadrant-console-plugin-6c886788f8-ncp8v to ip-10-0-138-125.ec2.internal

kuadrant-system

authorino-operator-7587b89b76-wj5hp

Scheduled

Successfully assigned kuadrant-system/authorino-operator-7587b89b76-wj5hp to ip-10-0-130-165.ec2.internal

kserve-ci-e2e-test

scheduler-configmap-ref-test-kserve-router-scheduler-7f6f582p8v

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-7f6f582p8v to ip-10-0-132-246.ec2.internal

kuadrant-system

authorino-79cbc94b89-dx9cb

Scheduled

Successfully assigned kuadrant-system/authorino-79cbc94b89-dx9cb to ip-10-0-138-125.ec2.internal

kserve-ci-e2e-test

llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheffvmc

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheffvmc to ip-10-0-138-125.ec2.internal

openshift-ingress

openshift-ai-inference-openshift-default-7c5447bb76-fd2h8

Scheduled

Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-fd2h8 to ip-10-0-130-165.ec2.internal

kserve-ci-e2e-test

custom-route-timeout-pd-test-kserve-router-scheduler-6869fqgjgd

Scheduled

Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6869fqgjgd to ip-10-0-132-246.ec2.internal

kserve-ci-e2e-test

precise-prefix-cache-test-kserve-554b968997-qxqzt

Scheduled

Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-554b968997-qxqzt to ip-10-0-130-165.ec2.internal

kserve-ci-e2e-test

router-gateway-2-openshift-default-6866b85949-4p7m7

Scheduled

Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-4p7m7 to ip-10-0-138-125.ec2.internal

kserve-ci-e2e-test

router-with-refs-pd-test-kserve-prefill-588f9994fc-pmxz5

Scheduled

Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-588f9994fc-pmxz5 to ip-10-0-138-125.ec2.internal

kserve-ci-e2e-test

scheduler-ha-replicas-test-kserve-router-scheduler-84cf8456d2m2

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-84cf8456d2m2 to ip-10-0-132-246.ec2.internal

kuadrant-system

authorino-68bd676465-s6qwr

Scheduled

Successfully assigned kuadrant-system/authorino-68bd676465-s6qwr to ip-10-0-132-246.ec2.internal

kserve-ci-e2e-test

llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevmnpt

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevmnpt to ip-10-0-132-246.ec2.internal

kuadrant-system

authorino-674b59b84c-d4kjz

Scheduled

Successfully assigned kuadrant-system/authorino-674b59b84c-d4kjz to ip-10-0-138-125.ec2.internal

kserve-ci-e2e-test

scheduler-ha-replicas-test-kserve-c467c496f-t4nb2

Scheduled

Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-c467c496f-t4nb2 to ip-10-0-138-125.ec2.internal

kserve-ci-e2e-test

custom-route-timeout-test-kserve-786fb6d9fb-f28dj

Scheduled

Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-786fb6d9fb-f28dj to ip-10-0-130-165.ec2.internal

kuadrant-system

limitador-limitador-67566c68b4-j55fq

Scheduled

Successfully assigned kuadrant-system/limitador-limitador-67566c68b4-j55fq to ip-10-0-130-165.ec2.internal

kserve-ci-e2e-test

precise-prefix-cache-test-kserve-554b968997-wxzbs

Scheduled

Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-554b968997-wxzbs to ip-10-0-138-125.ec2.internal

kuadrant-system

kuadrant-operator-controller-manager-6ddf9554fc-vbzpd

Scheduled

Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-6ddf9554fc-vbzpd to ip-10-0-132-246.ec2.internal

kserve-ci-e2e-test

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6d5xjpk

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6d5xjpk to ip-10-0-130-165.ec2.internal

openshift-ingress

istiod-openshift-gateway-55ff986f96-cq89s

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-55ff986f96-cq89s to ip-10-0-132-246.ec2.internal

kserve-ci-e2e-test

llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche68s48

Scheduled

Successfully assigned kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche68s48 to ip-10-0-132-246.ec2.internal

openshift-ingress

istiod-openshift-gateway-7cd77c7ffd-f2zw6

Scheduled

Successfully assigned openshift-ingress/istiod-openshift-gateway-7cd77c7ffd-f2zw6 to ip-10-0-132-246.ec2.internal

kserve-ci-e2e-test

router-with-refs-pd-test-kserve-5557b45666-skg9c

Scheduled

Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-5557b45666-skg9c to ip-10-0-138-125.ec2.internal

kserve-ci-e2e-test

custom-route-timeout-pd-test-kserve-prefill-55c8678f5c-k4nbq

Scheduled

Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-55c8678f5c-k4nbq to ip-10-0-130-165.ec2.internal

openshift-ingress

deployment-controller

router-default

ScalingReplicaSet

Scaled up replica set router-default-6db657d5cd from 0 to 1
(x11)

openshift-ingress

replicaset-controller

router-default-6db657d5cd

FailedCreate

Error creating: pods "router-default-6db657d5cd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes

openshift-ingress

service-controller

router-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

service-controller

router-default

UnAvailableLoadBalancer

There are no available nodes for LoadBalancer

openshift-ingress

service-controller

router-default

EnsuredLoadBalancer

Ensured load balancer
(x16)

openshift-ingress

replicaset-controller

router-default-6db657d5cd

FailedCreate

Error creating: pods "router-default-6db657d5cd-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes
(x3)

openshift-ingress

service-controller

router-default

UpdatedLoadBalancer

Updated load balancer with new hosts

openshift-ingress

replicaset-controller

router-default-6db657d5cd

SuccessfulCreate

Created pod: router-default-6db657d5cd-98k8d
(x5)

openshift-ingress

kubelet

router-default-6db657d5cd-98k8d

FailedMount

MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found
(x5)

openshift-ingress

kubelet

router-default-6db657d5cd-98k8d

FailedMount

MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt

openshift-ingress

kubelet

router-default-6db657d5cd-98k8d

Created

Created container: router

openshift-ingress

kubelet

router-default-6db657d5cd-98k8d

Pulled

Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f2e4763905898d3870f64ebc9721d8d43ae2973f4ba295d48f84e36e6f72d013" already present on machine

openshift-ingress

multus

router-default-6db657d5cd-98k8d

AddedInterface

Add eth0 [10.134.0.10/23] from ovn-kubernetes

openshift-ingress

kubelet

router-default-6db657d5cd-98k8d

Started

Started container router

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-7cd77c7ffd from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7cd77c7ffd

SuccessfulCreate

Created pod: istiod-openshift-gateway-7cd77c7ffd-f2zw6

openshift-ingress

kubelet

istiod-openshift-gateway-7cd77c7ffd-f2zw6

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:028e10651db0d1ddb769a27c9483c6d41be6ac597f253afd9d599f395d9c82d8"

openshift-ingress

multus

istiod-openshift-gateway-7cd77c7ffd-f2zw6

AddedInterface

Add eth0 [10.132.0.17/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7cd77c7ffd-f2zw6

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7cd77c7ffd-f2zw6

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-7cd77c7ffd-f2zw6

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:028e10651db0d1ddb769a27c9483c6d41be6ac597f253afd9d599f395d9c82d8" in 2.531s (2.531s including waiting). Image size: 179322965 bytes.
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7cd77c7ffd-f2zw6

Unhealthy

Readiness probe failed: HTTP probe failed with statuscode: 503
(x2)

openshift-ingress

kubelet

istiod-openshift-gateway-7cd77c7ffd-f2zw6

ProbeError

Readiness probe error: HTTP probe failed with statuscode: 503 body:

openshift-ingress

replicaset-controller

openshift-ai-inference-openshift-default-7c5447bb76

SuccessfulCreate

Created pod: openshift-ai-inference-openshift-default-7c5447bb76-fd2h8

openshift-ingress

deployment-controller

openshift-ai-inference-openshift-default

ScalingReplicaSet

Scaled up replica set openshift-ai-inference-openshift-default-7c5447bb76 from 0 to 1

openshift-ingress

service-controller

openshift-ai-inference-openshift-default

EnsuringLoadBalancer

Ensuring load balancer

openshift-ingress

gateway_labeler_controller

openshift-ai-inference

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway openshift-ai-inference

openshift-ingress

multus

openshift-ai-inference-openshift-default-7c5447bb76-fd2h8

AddedInterface

Add eth0 [10.133.0.24/23] from ovn-kubernetes

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-7c5447bb76-fd2h8

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:d518f3d1539f45e1253c5c9fa22062802804601d4998cd50344e476a3cc388fe"

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-7c5447bb76-fd2h8

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:d518f3d1539f45e1253c5c9fa22062802804601d4998cd50344e476a3cc388fe" in 2.443s (2.443s including waiting). Image size: 163191192 bytes.

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-7c5447bb76-fd2h8

Created

Created container: istio-proxy

openshift-ingress

kubelet

openshift-ai-inference-openshift-default-7c5447bb76-fd2h8

Started

Started container istio-proxy

openshift-ingress

service-controller

openshift-ai-inference-openshift-default

EnsuredLoadBalancer

Ensured load balancer

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.3.0

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.3.0

RequirementsUnknown

requirements not yet checked

kuadrant-system

replicaset-controller

dns-operator-controller-manager-844548ff4c

SuccessfulCreate

Created pod: dns-operator-controller-manager-844548ff4c-g7ll6

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.3.0

InstallWaiting

installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.3.0

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.3.0

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.3.2

RequirementsUnknown

requirements not yet checked

kuadrant-system

deployment-controller

dns-operator-controller-manager

ScalingReplicaSet

Scaled up replica set dns-operator-controller-manager-844548ff4c from 0 to 1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.3.2

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

dns-operator-controller-manager-844548ff4c-g7ll6

Pulling

Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:b4e7ba67509320ca9ac5d63cc4add987fad05b098c4a7cd8dd91f264731177cf"

kuadrant-system

multus

dns-operator-controller-manager-844548ff4c-g7ll6

AddedInterface

Add eth0 [10.133.0.25/23] from ovn-kubernetes

kuadrant-system

kubelet

dns-operator-controller-manager-844548ff4c-g7ll6

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:b4e7ba67509320ca9ac5d63cc4add987fad05b098c4a7cd8dd91f264731177cf" in 2.516s (2.516s including waiting). Image size: 186790172 bytes.

kuadrant-system

kubelet

dns-operator-controller-manager-844548ff4c-g7ll6

Created

Created container: manager

kuadrant-system

kubelet

dns-operator-controller-manager-844548ff4c-g7ll6

Started

Started container manager

kuadrant-system

dns-operator-controller-manager-844548ff4c-g7ll6_af0071bb-ee2e-42d8-acee-559141a29222

a3f98d6c.kuadrant.io

LeaderElection

dns-operator-controller-manager-844548ff4c-g7ll6_af0071bb-ee2e-42d8-acee-559141a29222 became leader

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.3.0

RequirementsUnknown

requirements not yet checked

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6ddf9554fc-vbzpd

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:7aa6d6dbbde488260789adb94fa232a06d1e635cc2aaf86af24f8cf14a17eef8"

kuadrant-system

replicaset-controller

kuadrant-operator-controller-manager-6ddf9554fc

SuccessfulCreate

Created pod: kuadrant-operator-controller-manager-6ddf9554fc-vbzpd

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.3.2

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

kuadrant-operator-controller-manager

ScalingReplicaSet

Scaled up replica set kuadrant-operator-controller-manager-6ddf9554fc from 0 to 1

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.3.2

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

multus

kuadrant-operator-controller-manager-6ddf9554fc-vbzpd

AddedInterface

Add eth0 [10.132.0.18/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.3.0

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.3.2

InstallWaiting

installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.3.0

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.3.0

RequirementsUnknown

requirements not yet checked

kuadrant-system

replicaset-controller

limitador-operator-controller-manager-c7fb4c8d5

SuccessfulCreate

Created pod: limitador-operator-controller-manager-c7fb4c8d5-bkfpn
(x2)

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.3.0

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.3.0

InstallWaiting

installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability.

kuadrant-system

deployment-controller

limitador-operator-controller-manager

ScalingReplicaSet

Scaled up replica set limitador-operator-controller-manager-c7fb4c8d5 from 0 to 1

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.3.0

RequirementsNotMet

one or more requirements couldn't be found

kuadrant-system

kubelet

limitador-operator-controller-manager-c7fb4c8d5-bkfpn

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:9a3ccb54bc904521277b87e1d178d8134cc6ef744eb4ec5b64177355fd5a9e66"

kuadrant-system

multus

limitador-operator-controller-manager-c7fb4c8d5-bkfpn

AddedInterface

Add eth0 [10.132.0.19/23] from ovn-kubernetes

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.3.0

AllRequirementsMet

all requirements found, attempting install

kuadrant-system

deployment-controller

authorino-operator

ScalingReplicaSet

Scaled up replica set authorino-operator-7587b89b76 from 0 to 1

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.3.0

InstallSucceeded

waiting for install components to report healthy

kuadrant-system

replicaset-controller

authorino-operator-7587b89b76

SuccessfulCreate

Created pod: authorino-operator-7587b89b76-wj5hp

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.3.0

InstallWaiting

installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability.

kuadrant-system

multus

authorino-operator-7587b89b76-wj5hp

AddedInterface

Add eth0 [10.133.0.26/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-operator-7587b89b76-wj5hp

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:4e581c0172549df72c6ef8978e96d771645bc36298d2ccf9240af4e71c088733"

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6ddf9554fc-vbzpd

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:7aa6d6dbbde488260789adb94fa232a06d1e635cc2aaf86af24f8cf14a17eef8" in 5.944s (5.944s including waiting). Image size: 411782238 bytes.

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6ddf9554fc-vbzpd

Started

Started container manager

kuadrant-system

kubelet

kuadrant-operator-controller-manager-6ddf9554fc-vbzpd

Created

Created container: manager

kuadrant-system

limitador-operator-controller-manager-c7fb4c8d5-bkfpn_b8388ab0-cd46-489d-ab26-d4decce787e8

3745a16e.kuadrant.io

LeaderElection

limitador-operator-controller-manager-c7fb4c8d5-bkfpn_b8388ab0-cd46-489d-ab26-d4decce787e8 became leader

kuadrant-system

kubelet

limitador-operator-controller-manager-c7fb4c8d5-bkfpn

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:9a3ccb54bc904521277b87e1d178d8134cc6ef744eb4ec5b64177355fd5a9e66" in 3.507s (3.507s including waiting). Image size: 175506011 bytes.

kuadrant-system

kubelet

limitador-operator-controller-manager-c7fb4c8d5-bkfpn

Created

Created container: manager

kuadrant-system

kubelet

limitador-operator-controller-manager-c7fb4c8d5-bkfpn

Started

Started container manager

kuadrant-system

kubelet

authorino-operator-7587b89b76-wj5hp

Created

Created container: manager

kuadrant-system

authorino-operator-7587b89b76-wj5hp_f658d139-ecf7-49dd-a150-23b26c541424

aac3a15d.authorino.kuadrant.io

LeaderElection

authorino-operator-7587b89b76-wj5hp_f658d139-ecf7-49dd-a150-23b26c541424 became leader

kuadrant-system

kuadrant-operator-controller-manager-6ddf9554fc-vbzpd_09b0b16c-553c-4d72-a0c2-79cda389cd75

f139389e.kuadrant.io

LeaderElection

kuadrant-operator-controller-manager-6ddf9554fc-vbzpd_09b0b16c-553c-4d72-a0c2-79cda389cd75 became leader

kuadrant-system

kubelet

authorino-operator-7587b89b76-wj5hp

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:4e581c0172549df72c6ef8978e96d771645bc36298d2ccf9240af4e71c088733" in 1.627s (1.627s including waiting). Image size: 161991975 bytes.

kuadrant-system

kubelet

authorino-operator-7587b89b76-wj5hp

Started

Started container manager

kuadrant-system

deployment-controller

kuadrant-console-plugin

ScalingReplicaSet

Scaled up replica set kuadrant-console-plugin-6c886788f8 from 0 to 1

kuadrant-system

replicaset-controller

kuadrant-console-plugin-6c886788f8

SuccessfulCreate

Created pod: kuadrant-console-plugin-6c886788f8-ncp8v

kuadrant-system

multus

kuadrant-console-plugin-6c886788f8-ncp8v

AddedInterface

Add eth0 [10.134.0.43/23] from ovn-kubernetes

kuadrant-system

kubelet

kuadrant-console-plugin-6c886788f8-ncp8v

Pulling

Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:41755d5e16ee5409cfe8888cf5883b262820baea4eae449fcf61f06ab1756f57"

kuadrant-system

operator-lifecycle-manager

dns-operator.v1.3.0

InstallSucceeded

install strategy completed with no errors

kuadrant-system

kubelet

kuadrant-console-plugin-6c886788f8-ncp8v

Created

Created container: kuadrant-console-plugin

kuadrant-system

kubelet

kuadrant-console-plugin-6c886788f8-ncp8v

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:41755d5e16ee5409cfe8888cf5883b262820baea4eae449fcf61f06ab1756f57" in 4.383s (4.383s including waiting). Image size: 339541674 bytes.

kuadrant-system

kubelet

kuadrant-console-plugin-6c886788f8-ncp8v

Started

Started container kuadrant-console-plugin

kuadrant-system

operator-lifecycle-manager

limitador-operator.v1.3.0

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

rhcl-operator.v1.3.2

InstallSucceeded

install strategy completed with no errors

kuadrant-system

operator-lifecycle-manager

authorino-operator.v1.3.0

InstallSucceeded

install strategy completed with no errors

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-64c8f475fb from 0 to 1

kuadrant-system

replicaset-controller

limitador-limitador-64c8f475fb

SuccessfulCreate

Created pod: limitador-limitador-64c8f475fb-jkpnq

kuadrant-system

multus

limitador-limitador-67566c68b4-j55fq

AddedInterface

Add eth0 [10.133.0.27/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

limitador-limitador-67566c68b4

SuccessfulCreate

Created pod: limitador-limitador-67566c68b4-j55fq

kuadrant-system

multus

limitador-limitador-64c8f475fb-jkpnq

AddedInterface

Add eth0 [10.132.0.20/23] from ovn-kubernetes

kuadrant-system

kubelet

limitador-limitador-64c8f475fb-jkpnq

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:43bc4021bb30c7ef305e01c11e22ca5584c7e2c192b4db0a5646f04f715ee3b0"

kuadrant-system

kubelet

limitador-limitador-67566c68b4-j55fq

Pulling

Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:43bc4021bb30c7ef305e01c11e22ca5584c7e2c192b4db0a5646f04f715ee3b0"

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled up replica set limitador-limitador-67566c68b4 from 0 to 1

kuadrant-system

kubelet

limitador-limitador-67566c68b4-j55fq

Started

Started container limitador

kuadrant-system

kubelet

limitador-limitador-67566c68b4-j55fq

Created

Created container: limitador

kuadrant-system

kubelet

limitador-limitador-64c8f475fb-jkpnq

Created

Created container: limitador

kuadrant-system

kubelet

limitador-limitador-64c8f475fb-jkpnq

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:43bc4021bb30c7ef305e01c11e22ca5584c7e2c192b4db0a5646f04f715ee3b0" in 4.111s (4.111s including waiting). Image size: 249943843 bytes.

kuadrant-system

kubelet

limitador-limitador-67566c68b4-j55fq

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:43bc4021bb30c7ef305e01c11e22ca5584c7e2c192b4db0a5646f04f715ee3b0" in 4.039s (4.039s including waiting). Image size: 249943843 bytes.

kuadrant-system

kubelet

limitador-limitador-64c8f475fb-jkpnq

Started

Started container limitador

kuadrant-system

kubelet

limitador-limitador-64c8f475fb-jkpnq

Killing

Stopping container limitador

kuadrant-system

deployment-controller

limitador-limitador

ScalingReplicaSet

Scaled down replica set limitador-limitador-64c8f475fb from 1 to 0

kuadrant-system

replicaset-controller

limitador-limitador-64c8f475fb

SuccessfulDelete

Deleted pod: limitador-limitador-64c8f475fb-jkpnq

kuadrant-system

multus

authorino-674b59b84c-d4kjz

AddedInterface

Add eth0 [10.134.0.44/23] from ovn-kubernetes

kuadrant-system

replicaset-controller

authorino-79cbc94b89

SuccessfulCreate

Created pod: authorino-79cbc94b89-dx9cb

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-79cbc94b89 from 0 to 1

kuadrant-system

kubelet

authorino-674b59b84c-d4kjz

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c2208382e16c501e4ed58aea83f54d108567f36853cf79f7ffdf8ee54ff4ace8"

kuadrant-system

replicaset-controller

authorino-674b59b84c

SuccessfulCreate

Created pod: authorino-674b59b84c-d4kjz

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-674b59b84c from 0 to 1

kuadrant-system

kubelet

authorino-79cbc94b89-dx9cb

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c2208382e16c501e4ed58aea83f54d108567f36853cf79f7ffdf8ee54ff4ace8"

kuadrant-system

multus

authorino-79cbc94b89-dx9cb

AddedInterface

Add eth0 [10.134.0.45/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-79cbc94b89-dx9cb

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c2208382e16c501e4ed58aea83f54d108567f36853cf79f7ffdf8ee54ff4ace8" in 2.709s (2.709s including waiting). Image size: 199256829 bytes.

kuadrant-system

kubelet

authorino-674b59b84c-d4kjz

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c2208382e16c501e4ed58aea83f54d108567f36853cf79f7ffdf8ee54ff4ace8" in 2.973s (2.973s including waiting). Image size: 199256829 bytes.

kuadrant-system

kubelet

authorino-674b59b84c-d4kjz

Started

Started container authorino

kuadrant-system

replicaset-controller

authorino-674b59b84c

SuccessfulDelete

Deleted pod: authorino-674b59b84c-d4kjz

kuadrant-system

kubelet

authorino-674b59b84c-d4kjz

Created

Created container: authorino

kuadrant-system

kubelet

authorino-79cbc94b89-dx9cb

Created

Created container: authorino

kuadrant-system

kubelet

authorino-79cbc94b89-dx9cb

Started

Started container authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-674b59b84c from 1 to 0

kuadrant-system

kubelet

authorino-674b59b84c-d4kjz

Killing

Stopping container authorino

kuadrant-system

replicaset-controller

authorino-68bd676465

SuccessfulCreate

Created pod: authorino-68bd676465-s6qwr

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled up replica set authorino-68bd676465 from 0 to 1

kuadrant-system

kubelet

authorino-68bd676465-s6qwr

Pulling

Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c2208382e16c501e4ed58aea83f54d108567f36853cf79f7ffdf8ee54ff4ace8"

kuadrant-system

multus

authorino-68bd676465-s6qwr

AddedInterface

Add eth0 [10.132.0.21/23] from ovn-kubernetes

kuadrant-system

kubelet

authorino-68bd676465-s6qwr

Pulled

Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c2208382e16c501e4ed58aea83f54d108567f36853cf79f7ffdf8ee54ff4ace8" in 1.76s (1.76s including waiting). Image size: 199256829 bytes.

kuadrant-system

kubelet

authorino-68bd676465-s6qwr

Started

Started container authorino

kuadrant-system

kubelet

authorino-68bd676465-s6qwr

Created

Created container: authorino

kuadrant-system

deployment-controller

authorino

ScalingReplicaSet

Scaled down replica set authorino-79cbc94b89 from 1 to 0

kuadrant-system

replicaset-controller

authorino-79cbc94b89

SuccessfulDelete

Deleted pod: authorino-79cbc94b89-dx9cb

kuadrant-system

kubelet

authorino-79cbc94b89-dx9cb

Killing

Stopping container authorino

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled up replica set istiod-openshift-gateway-55ff986f96 from 0 to 1

openshift-ingress

replicaset-controller

istiod-openshift-gateway-55ff986f96

SuccessfulCreate

Created pod: istiod-openshift-gateway-55ff986f96-cq89s

openshift-ingress

kubelet

istiod-openshift-gateway-55ff986f96-cq89s

Created

Created container: discovery

openshift-ingress

kubelet

istiod-openshift-gateway-55ff986f96-cq89s

Started

Started container discovery

openshift-ingress

kubelet

istiod-openshift-gateway-55ff986f96-cq89s

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:028e10651db0d1ddb769a27c9483c6d41be6ac597f253afd9d599f395d9c82d8" already present on machine

openshift-ingress

multus

istiod-openshift-gateway-55ff986f96-cq89s

AddedInterface

Add eth0 [10.132.0.22/23] from ovn-kubernetes

openshift-ingress

kubelet

istiod-openshift-gateway-7cd77c7ffd-f2zw6

Killing

Stopping container discovery

openshift-ingress

deployment-controller

istiod-openshift-gateway

ScalingReplicaSet

Scaled down replica set istiod-openshift-gateway-7cd77c7ffd from 1 to 0

openshift-ingress

replicaset-controller

istiod-openshift-gateway-7cd77c7ffd

SuccessfulDelete

Deleted pod: istiod-openshift-gateway-7cd77c7ffd-f2zw6
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedGetResourceMetric

failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API
(x5)

openshift-ingress

horizontal-pod-autoscaler

istiod-openshift-gateway

FailedComputeMetricsReplicas

invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API

kserve-ci-e2e-test

deployment-controller

router-gateway-1-openshift-default

ScalingReplicaSet

Scaled up replica set router-gateway-1-openshift-default-6c59fbf55c from 0 to 1

kserve-ci-e2e-test

service-controller

router-gateway-1-openshift-default

EnsuringLoadBalancer

Ensuring load balancer

kserve-ci-e2e-test

replicaset-controller

router-gateway-1-openshift-default-6c59fbf55c

SuccessfulCreate

Created pod: router-gateway-1-openshift-default-6c59fbf55c-vfv42

kserve-ci-e2e-test

kubelet

router-gateway-1-openshift-default-6c59fbf55c-vfv42

Pulled

Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:d518f3d1539f45e1253c5c9fa22062802804601d4998cd50344e476a3cc388fe" already present on machine

kserve-ci-e2e-test

multus

router-gateway-1-openshift-default-6c59fbf55c-vfv42

AddedInterface

Add eth0 [10.133.0.28/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

router-gateway-1-openshift-default-6c59fbf55c-vfv42

Started

Started container istio-proxy

kserve-ci-e2e-test

kubelet

router-gateway-1-openshift-default-6c59fbf55c-vfv42

Created

Created container: istio-proxy

kserve-ci-e2e-test

service-controller

router-gateway-1-openshift-default

EnsuredLoadBalancer

Ensured load balancer
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

scheduler-configmap-ref-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-configmap-ref-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-configmap-ref-test-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.Role kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler

kserve-ci-e2e-test

replicaset-controller

scheduler-configmap-ref-test-kserve-router-scheduler-7f6f546996

SuccessfulCreate

Created pod: scheduler-configmap-ref-test-kserve-router-scheduler-7f6f582p8v

kserve-ci-e2e-test

deployment-controller

scheduler-configmap-ref-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set scheduler-configmap-ref-test-kserve-router-scheduler-7f6f546996 from 0 to 1

kserve-ci-e2e-test

deployment-controller

scheduler-configmap-ref-test-kserve

ScalingReplicaSet

Scaled up replica set scheduler-configmap-ref-test-kserve-f6cb4c9b9 from 0 to 1

kserve-ci-e2e-test

replicaset-controller

scheduler-configmap-ref-test-kserve-f6cb4c9b9

SuccessfulCreate

Created pod: scheduler-configmap-ref-test-kserve-f6cb4c9b9-thlbk

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-rb

kserve-ci-e2e-test

multus

scheduler-configmap-ref-test-kserve-f6cb4c9b9-thlbk

AddedInterface

Add eth0 [10.134.0.49/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-f6cb4c9b9-thlbk

Pulling

Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808"

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-sa
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-shadow-svc

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-7f6f582p8v

Pulling

Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808"

kserve-ci-e2e-test

multus

scheduler-configmap-ref-test-kserve-router-scheduler-7f6f582p8v

AddedInterface

Add eth0 [10.132.0.27/23] from ovn-kubernetes
(x14)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-fb-opt-125m-route-6fa1027a

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-route" not found

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-f6cb4c9b9-thlbk

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" in 3.769s (3.769s including waiting). Image size: 300960178 bytes.

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-f6cb4c9b9-thlbk

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-f6cb4c9b9-thlbk

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-7f6f582p8v

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-7f6f582p8v

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-7f6f582p8v

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" in 3.167s (3.167s including waiting). Image size: 300960178 bytes.

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-7f6f582p8v

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.6.0"

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-7f6f582p8v

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-7f6f582p8v

Pulling

Pulling image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.6.0"

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-7f6f582p8v

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-7f6f582p8v

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.6.0" in 1.287s (1.287s including waiting). Image size: 215136441 bytes.

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-f6cb4c9b9-thlbk

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.5.1"

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-route-6fa1027a-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-5d687994f from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-6fa1027a

Created

Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-workload-svc

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-5d687994f-pdkfx

AddedInterface

Add eth0 [10.133.0.29/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-f6cb4c9b9-thlbk

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-f6cb4c9b9-thlbk

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-f6cb4c9b9-thlbk

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.5.1" in 2.599s (2.599s including waiting). Image size: 252996841 bytes.

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-5d687994f-pdkfx

Pulling

Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808"

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-5d687994f

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-5d687994f-pdkfx

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-6fa1027a

Created

Created v1.Secret kserve-ci-e2e-test/llmisvad71fa5348b85aebd404221bba611457-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-6fa1027a

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-6fa1027a

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-workload-svc

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-7f6f582p8v

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.6.0" in 4.929s (4.929s including waiting). Image size: 452603245 bytes.

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-7f6f582p8v

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-7f6f582p8v

Started

Started container tokenizer

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-6fa1027a

Created

Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-route

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-5d687994f-pdkfx

Pulled

Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" in 3.971s (3.971s including waiting). Image size: 300960178 bytes.

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-5d687994f-pdkfx

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-5d687994f-pdkfx

Started

Started container storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Updated

Updated v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-5d687994f-pdkfx

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.5.1"

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-5d687994f-pdkfx

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-5d687994f-pdkfx

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-5d687994f-pdkfx

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.5.1" in 2.594s (2.594s including waiting). Image size: 252996841 bytes.
(x2)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-6fa1027a

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisvad71fa5348b85aebd404221bba611457-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-f6cb4c9b9-thlbk

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-configmap-ref-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-7f6f582p8v

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

scheduler-configmap-ref-test-kserve-router-scheduler-7f6f582p8v

Killing

Stopping container tokenizer
(x10)

kserve-ci-e2e-test

OpenDataHubModelController

scheduler-ha-replicas-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-ha-replicas-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-ha-replicas-test-kserve-route" not found

kserve-ci-e2e-test

deployment-controller

scheduler-ha-replicas-test-kserve

ScalingReplicaSet

Scaled up replica set scheduler-ha-replicas-test-kserve-c467c496f from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.Role kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs

kserve-ci-e2e-test

replicaset-controller

scheduler-ha-replicas-test-kserve-c467c496f

SuccessfulCreate

Created pod: scheduler-ha-replicas-test-kserve-c467c496f-t4nb2

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-c467c496f-t4nb2

Started

Started container storage-initializer

kserve-ci-e2e-test

replicaset-controller

scheduler-ha-replicas-test-kserve-router-scheduler-84cf845f8

SuccessfulCreate

Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-84cf8456d2m2

kserve-ci-e2e-test

multus

scheduler-ha-replicas-test-kserve-router-scheduler-84cf845rzwp4

AddedInterface

Add eth0 [10.134.0.51/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf845rzwp4

Created

Created container: storage-initializer

kserve-ci-e2e-test

multus

scheduler-ha-replicas-test-kserve-router-scheduler-84cf8456d2m2

AddedInterface

Add eth0 [10.132.0.28/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf8456d2m2

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

replicaset-controller

scheduler-ha-replicas-test-kserve-router-scheduler-84cf845f8

SuccessfulCreate

Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-84cf845rzwp4

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf8456d2m2

Created

Created container: storage-initializer

kserve-ci-e2e-test

deployment-controller

scheduler-ha-replicas-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set scheduler-ha-replicas-test-kserve-router-scheduler-84cf845f8 from 0 to 2

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf845rzwp4

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf845rzwp4

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-c467c496f-t4nb2

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-c467c496f-t4nb2

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

multus

scheduler-ha-replicas-test-kserve-c467c496f-t4nb2

AddedInterface

Add eth0 [10.134.0.50/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf8456d2m2

Started

Started container storage-initializer
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-rb

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf8456d2m2

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf8456d2m2

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf8456d2m2

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf8456d2m2

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf8456d2m2

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf8456d2m2

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf845rzwp4

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.6.0"

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf845rzwp4

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf845rzwp4

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf845rzwp4

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.6.0" in 2.597s (2.597s including waiting). Image size: 215136441 bytes.

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf845rzwp4

Pulling

Pulling image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.6.0"

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-c467c496f-t4nb2

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.5.1" already present on machine

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-c467c496f-t4nb2

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-c467c496f-t4nb2

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf845rzwp4

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf845rzwp4

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf845rzwp4

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.6.0" in 4.999s (4.999s including waiting). Image size: 452603245 bytes.

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Updated

Updated v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-5d687994f-pdkfx

Killing

Stopping container main
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-fb-opt-125m-route-55f7ae4a

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-55f7ae4a

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-workload-svc

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-5c6f4f9f98 from 0 to 1

kserve-ci-e2e-test

replicaset-controller

llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheduler-578dc7d59c

SuccessfulCreate

Created pod: llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevmnpt

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-55f7ae4a

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-epp-sa

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-5c6f4f9f98762tc

AddedInterface

Add eth0 [10.133.0.30/23] from ovn-kubernetes

kserve-ci-e2e-test

multus

llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevmnpt

AddedInterface

Add eth0 [10.132.0.29/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-55f7ae4a

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-teste2c0c7deeb42f8b9846a7a45d2caecd2-llmisvc-mode

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-55f7ae4a

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-55f7ae4a

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve

kserve-ci-e2e-test

kubelet

llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevmnpt

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

kubelet

llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevmnpt

Created

Created container: storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-55f7ae4a

Created

Created v1.Secret kserve-ci-e2e-test/llmisvdde380eaa9fe1facad32d45131f9e34d-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevmnpt

Started

Started container storage-initializer

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-5c6f4f9f98

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-5c6f4f9f98762tc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-55f7ae4a

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-epp-role

kserve-ci-e2e-test

deployment-controller

llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheduler-578dc7d59c from 0 to 1

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-5c6f4f9f98762tc

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-55f7ae4a

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-55f7ae4a

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-epp-service

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-5c6f4f9f98762tc

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-5c6f4f9f98762tc

Created

Created container: storage-initializer
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-55f7ae4a

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-shadow-svc

kserve-ci-e2e-test

kubelet

llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevmnpt

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevmnpt

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevmnpt

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevmnpt

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevmnpt

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevmnpt

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-5c6f4f9f98762tc

Pulling

Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1"

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-55f7ae4a

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisvdde380eaa9fe1facad32d45131f9e34d-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-ha-replicas-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf845rzwp4

Unhealthy

Readiness probe failed: service unhealthy (responded with "NOT_SERVING")

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf8456d2m2

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf845rzwp4

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf845rzwp4

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-router-scheduler-84cf8456d2m2

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

scheduler-ha-replicas-test-kserve-c467c496f-t4nb2

Killing

Stopping container main
(x12)

kserve-ci-e2e-test

OpenDataHubModelController

precise-prefix-cache-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy precise-prefix-cache-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "precise-prefix-cache-test-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/precise-prefix-cache-test-epp-sa

kserve-ci-e2e-test

replicaset-controller

precise-prefix-cache-test-kserve-554b968997

SuccessfulCreate

Created pod: precise-prefix-cache-test-kserve-554b968997-qxqzt

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/precise-prefix-cache-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler

kserve-ci-e2e-test

deployment-controller

precise-prefix-cache-test-kserve

ScalingReplicaSet

Scaled up replica set precise-prefix-cache-test-kserve-554b968997 from 0 to 2

kserve-ci-e2e-test

deployment-controller

precise-prefix-cache-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set precise-prefix-cache-test-kserve-router-scheduler-85554c4598 from 0 to 1

kserve-ci-e2e-test

multus

precise-prefix-cache-test-kserve-554b968997-wxzbs

AddedInterface

Add eth0 [10.134.0.52/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-554b968997-wxzbs

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-epp-service

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-554b968997-wxzbs

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-554b968997-wxzbs

Started

Started container storage-initializer

kserve-ci-e2e-test

replicaset-controller

precise-prefix-cache-test-kserve-554b968997

SuccessfulCreate

Created pod: precise-prefix-cache-test-kserve-554b968997-wxzbs

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

Created v1.Role kserve-ci-e2e-test/precise-prefix-cache-test-epp-role

kserve-ci-e2e-test

replicaset-controller

precise-prefix-cache-test-kserve-router-scheduler-85554c4598

SuccessfulCreate

Created pod: precise-prefix-cache-test-kserve-router-scheduler-85554c459kw9w

kserve-ci-e2e-test

multus

precise-prefix-cache-test-kserve-router-scheduler-85554c459kw9w

AddedInterface

Add eth0 [10.134.0.53/23] from ovn-kubernetes
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/precise-prefix-cache-test-kserve-shadow-svc

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-85554c459kw9w

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-85554c459kw9w

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-85554c459kw9w

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-85554c459kw9w

Started

Started container main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-85554c459kw9w

Created

Created container: main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-85554c459kw9w

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-85554c459kw9w

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-85554c459kw9w

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-85554c459kw9w

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-554b968997-wxzbs

Started

Started container main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-554b968997-wxzbs

Created

Created container: main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-554b968997-wxzbs

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.5.1" already present on machine

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-554b968997-qxqzt

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-5c6f4f9f98762tc

Pulled

Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" in 26.704s (26.704s including waiting). Image size: 3458932386 bytes.

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-554b968997-qxqzt

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-554b968997-qxqzt

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-5c6f4f9f98762tc

Started

Started container main

kserve-ci-e2e-test

multus

precise-prefix-cache-test-kserve-554b968997-qxqzt

AddedInterface

Add eth0 [10.133.0.31/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-5c6f4f9f98762tc

Created

Created container: main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-554b968997-qxqzt

Started

Started container main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-554b968997-qxqzt

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.5.1" already present on machine

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-554b968997-qxqzt

Created

Created container: main
(x2)

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Updated

Updated v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-85554c459kw9w

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-554b968997-qxqzt

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

precise-prefix-cache-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-router-scheduler-85554c459kw9w

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

precise-prefix-cache-test-kserve-554b968997-wxzbs

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

conv-test-lora-crit

Error

Reconciliation failed: failed to combine base-configurations: failed to get LLMInferenceServiceConfig "conv-test-lora-crit-config" from namespaces ["kserve-ci-e2e-test", "kserve"]: LLMInferenceServiceConfig.serving.kserve.io "conv-test-lora-crit-config" not found

kserve-ci-e2e-test

LLMInferenceServiceController

conv-test-v1a1-to-v1a2

Error

Reconciliation failed: failed to combine base-configurations: failed to get LLMInferenceServiceConfig "conv-test-v1a1-to-v1a2-config" from namespaces ["kserve-ci-e2e-test", "kserve"]: LLMInferenceServiceConfig.serving.kserve.io "conv-test-v1a1-to-v1a2-config" not found

kserve-ci-e2e-test

LLMInferenceServiceController

conv-test-round-trip

Error

Reconciliation failed: failed to combine base-configurations: failed to get LLMInferenceServiceConfig "conv-test-round-trip-config" from namespaces ["kserve-ci-e2e-test", "kserve"]: LLMInferenceServiceConfig.serving.kserve.io "conv-test-round-trip-config" not found

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc

kserve-ci-e2e-test

deployment-controller

stop-feature-test-kserve

ScalingReplicaSet

Scaled up replica set stop-feature-test-kserve-5f6c45bb9b from 0 to 1

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-d5k7p

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

deployment-controller

stop-feature-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set stop-feature-test-kserve-router-scheduler-7b969df585 from 0 to 1

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-5f6c45bb9b-pnzp2

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-5f6c45bb9b-pnzp2

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-5f6c45bb9b-pnzp2

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

multus

stop-feature-test-kserve-5f6c45bb9b-pnzp2

AddedInterface

Add eth0 [10.133.0.32/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve

kserve-ci-e2e-test

replicaset-controller

stop-feature-test-kserve-router-scheduler-7b969df585

SuccessfulCreate

Created pod: stop-feature-test-kserve-router-scheduler-7b969df585-d5k7p

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service

kserve-ci-e2e-test

multus

stop-feature-test-kserve-router-scheduler-7b969df585-d5k7p

AddedInterface

Add eth0 [10.134.0.54/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/stop-feature-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.Role kserve-ci-e2e-test/stop-feature-test-epp-role

kserve-ci-e2e-test

replicaset-controller

stop-feature-test-kserve-5f6c45bb9b

SuccessfulCreate

Created pod: stop-feature-test-kserve-5f6c45bb9b-pnzp2

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-stop-feature-test-epp-auth-rb
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/stop-feature-test-kserve-shadow-svc

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-d5k7p

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-d5k7p

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-d5k7p

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-d5k7p

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-d5k7p

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-d5k7p

Started

Started container main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-d5k7p

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-d5k7p

Created

Created container: main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-5f6c45bb9b-pnzp2

Created

Created container: main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-5f6c45bb9b-pnzp2

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-5f6c45bb9b-pnzp2

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Updated

Updated v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs
(x9)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-5c6f4f9f98762tc

Unhealthy

Startup probe failed: Get "https://10.133.0.30:8000/health": dial tcp 10.133.0.30:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-55f7ae4a

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-teste2c0c7deeb42f8b9846a7a45d2caecd2-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-5c6f4f9f98762tc

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevmnpt

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevmnpt

Killing

Stopping container main
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

custom-route-timeout-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-test-kserve-route" not found

kserve-ci-e2e-test

replicaset-controller

custom-route-timeout-test-kserve-786fb6d9fb

SuccessfulCreate

Created pod: custom-route-timeout-test-kserve-786fb6d9fb-f28dj

kserve-ci-e2e-test

deployment-controller

custom-route-timeout-test-kserve

ScalingReplicaSet

Scaled up replica set custom-route-timeout-test-kserve-786fb6d9fb from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs

kserve-ci-e2e-test

deployment-controller

custom-route-timeout-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set custom-route-timeout-test-kserve-router-scheduler-6986d4b879 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.Role kserve-ci-e2e-test/custom-route-timeout-test-epp-role
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-test-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-test-epp-rb

kserve-ci-e2e-test

multus

custom-route-timeout-test-kserve-786fb6d9fb-f28dj

AddedInterface

Add eth0 [10.133.0.33/23] from ovn-kubernetes

kserve-ci-e2e-test

replicaset-controller

custom-route-timeout-test-kserve-router-scheduler-6986d4b879

SuccessfulCreate

Created pod: custom-route-timeout-test-kserve-router-scheduler-6986d4b88629p

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-786fb6d9fb-f28dj

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-786fb6d9fb-f28dj

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-786fb6d9fb-f28dj

Started

Started container storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Created

Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-epp-service

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-6986d4b88629p

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-6986d4b88629p

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-6986d4b88629p

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

multus

custom-route-timeout-test-kserve-router-scheduler-6986d4b88629p

AddedInterface

Add eth0 [10.132.0.30/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-6986d4b88629p

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-6986d4b88629p

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-6986d4b88629p

Created

Created container: main

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-6986d4b88629p

Started

Started container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-6986d4b88629p

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-6986d4b88629p

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-786fb6d9fb-f28dj

Started

Started container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-786fb6d9fb-f28dj

Created

Created container: main

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-786fb6d9fb-f28dj

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Updated

Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs
(x10)

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-5f6c45bb9b-pnzp2

Unhealthy

Startup probe failed: Get "https://10.133.0.32:8000/health": dial tcp 10.133.0.32:8000: connect: connection refused

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1alpha2.InferencePool kserve-ci-e2e-test/stop-feature-test-inference-pool

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.InferencePool kserve-ci-e2e-test/stop-feature-test-inference-pool

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-d5k7p

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-d5k7p

Killing

Stopping container tokenizer

kserve-ci-e2e-test

LLMInferenceServiceController

stop-feature-test

Deleted

Deleted v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-5f6c45bb9b-pnzp2

Killing

Stopping container main
(x6)

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-5f6c45bb9b-pnzp2

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : secret "stop-feature-test-kserve-self-signed-certs" not found
(x25)

kserve-ci-e2e-test

OpenDataHubModelController

stop-feature-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy stop-feature-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "stop-feature-test-kserve-route" not found

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-5f6c45bb9b-slkzd

Created

Created container: storage-initializer

kserve-ci-e2e-test

replicaset-controller

stop-feature-test-kserve-router-scheduler-7b969df585

SuccessfulCreate

Created pod: stop-feature-test-kserve-router-scheduler-7b969df585-rfb4b

kserve-ci-e2e-test

multus

stop-feature-test-kserve-5f6c45bb9b-slkzd

AddedInterface

Add eth0 [10.133.0.34/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-5f6c45bb9b-slkzd

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

replicaset-controller

stop-feature-test-kserve-5f6c45bb9b

SuccessfulCreate

Created pod: stop-feature-test-kserve-5f6c45bb9b-slkzd

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-5f6c45bb9b-slkzd

Started

Started container storage-initializer

kserve-ci-e2e-test

deployment-controller

stop-feature-test-kserve

ScalingReplicaSet

Scaled up replica set stop-feature-test-kserve-5f6c45bb9b from 0 to 1

kserve-ci-e2e-test

deployment-controller

stop-feature-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set stop-feature-test-kserve-router-scheduler-7b969df585 from 0 to 1

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-rfb4b

FailedMount

MountVolume.SetUp failed for volume "tls-certs" : failed to sync secret cache: timed out waiting for the condition

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-rfb4b

FailedMount

MountVolume.SetUp failed for volume "kube-api-access-cfrxz" : failed to sync configmap cache: timed out waiting for the condition

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-rfb4b

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

multus

stop-feature-test-kserve-router-scheduler-7b969df585-rfb4b

AddedInterface

Add eth0 [10.134.0.55/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-rfb4b

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-rfb4b

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-rfb4b

Created

Created container: main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-rfb4b

Started

Started container main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-rfb4b

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-rfb4b

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-rfb4b

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-rfb4b

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-5f6c45bb9b-slkzd

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-5f6c45bb9b-slkzd

Created

Created container: main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-5f6c45bb9b-slkzd

Started

Started container main
(x9)

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-786fb6d9fb-f28dj

Unhealthy

Startup probe failed: Get "https://10.133.0.33:8000/health": dial tcp 10.133.0.33:8000: connect: connection refused
(x2)

kserve-ci-e2e-test

gateway_labeler_controller

router-gateway-1

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway router-gateway-1

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-6986d4b88629p

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-router-scheduler-6986d4b88629p

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-test-kserve-786fb6d9fb-f28dj

Killing

Stopping container main

kserve-ci-e2e-test

replicaset-controller

router-with-refs-test-kserve-575fcb7644

SuccessfulCreate

Created pod: router-with-refs-test-kserve-575fcb7644-7xbkj

kserve-ci-e2e-test

deployment-controller

router-with-refs-test-kserve

ScalingReplicaSet

Scaled up replica set router-with-refs-test-kserve-575fcb7644 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.Service kserve-ci-e2e-test/router-with-refs-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.Role kserve-ci-e2e-test/router-with-refs-test-epp-role

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-575fcb7644-7xbkj

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

deployment-controller

router-with-refs-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set router-with-refs-test-kserve-router-scheduler-cc4b6bc7f from 0 to 1

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-575fcb7644-7xbkj

Started

Started container storage-initializer
(x5)

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-test-kserve-shadow-svc

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.Service kserve-ci-e2e-test/router-with-refs-test-epp-service

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-test-epp-rb

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-cc4b6bc7f-tpxf6

Started

Started container storage-initializer

kserve-ci-e2e-test

replicaset-controller

router-with-refs-test-kserve-router-scheduler-cc4b6bc7f

SuccessfulCreate

Created pod: router-with-refs-test-kserve-router-scheduler-cc4b6bc7f-tpxf6

kserve-ci-e2e-test

multus

router-with-refs-test-kserve-575fcb7644-7xbkj

AddedInterface

Add eth0 [10.133.0.35/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-575fcb7644-7xbkj

Created

Created container: storage-initializer

kserve-ci-e2e-test

multus

router-with-refs-test-kserve-router-scheduler-cc4b6bc7f-tpxf6

AddedInterface

Add eth0 [10.132.0.31/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-cc4b6bc7f-tpxf6

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-cc4b6bc7f-tpxf6

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-cc4b6bc7f-tpxf6

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-cc4b6bc7f-tpxf6

Created

Created container: main

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-cc4b6bc7f-tpxf6

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-cc4b6bc7f-tpxf6

Started

Started container main

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-cc4b6bc7f-tpxf6

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-cc4b6bc7f-tpxf6

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-575fcb7644-7xbkj

Created

Created container: main

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-575fcb7644-7xbkj

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-575fcb7644-7xbkj

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Updated

Updated v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs
(x10)

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-5f6c45bb9b-slkzd

Unhealthy

Startup probe failed: Get "https://10.133.0.34:8000/health": dial tcp 10.133.0.34:8000: connect: connection refused

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-rfb4b

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-5f6c45bb9b-slkzd

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

stop-feature-test-kserve-router-scheduler-7b969df585-rfb4b

Killing

Stopping container main
(x10)

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-575fcb7644-7xbkj

Unhealthy

Startup probe failed: Get "https://10.133.0.35:8000/health": dial tcp 10.133.0.35:8000: connect: connection refused

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-575fcb7644-7xbkj

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-cc4b6bc7f-tpxf6

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

router-with-refs-test-kserve-router-scheduler-cc4b6bc7f-tpxf6

Killing

Stopping container tokenizer

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-fb-opt-125m-route-05aa9bba

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-05aa9bba

Created

Created v1.Secret kserve-ci-e2e-test/llmisv8f1a6f044e8c7a4d31a250e0c4861caf-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-05aa9bba

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-05aa9bba

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-8547b4b7cc

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-8547b4b7ccrvpvg

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-05aa9bba

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-role

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-05aa9bba

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-rb

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-05aa9bba

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-8547b4b7cc from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-05aa9bba

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-epp-sa

kserve-ci-e2e-test

replicaset-controller

llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scheduler-bdddfb6d9

SuccessfulCreate

Created pod: llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche68s48

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-05aa9bba

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test4ce8108fb3d8aff064c322bee6e173f5-llmisvc-mode
(x10)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-05aa9bba

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-shadow-svc

kserve-ci-e2e-test

kubelet

llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche68s48

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche68s48

Created

Created container: storage-initializer

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-8547b4b7ccrvpvg

AddedInterface

Add eth0 [10.133.0.36/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-8547b4b7ccrvpvg

Pulling

Pulling image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.6.0"

kserve-ci-e2e-test

kubelet

llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche68s48

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-05aa9bba

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-workload-svc

kserve-ci-e2e-test

deployment-controller

llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scheduler-bdddfb6d9 from 0 to 1

kserve-ci-e2e-test

multus

llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche68s48

AddedInterface

Add eth0 [10.132.0.32/23] from ovn-kubernetes

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6dbb84b574 from 0 to 1

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6dbb84b574

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6d5xjpk

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6d5xjpk

AddedInterface

Add eth0 [10.133.0.37/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6d5xjpk

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6d5xjpk

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6d5xjpk

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche68s48

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-8547b4b7ccrvpvg

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.6.0" in 1.314s (1.314s including waiting). Image size: 90135294 bytes.

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-8547b4b7ccrvpvg

Started

Started container llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-8547b4b7ccrvpvg

Created

Created container: llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche68s48

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche68s48

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche68s48

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.6.0" already present on machine
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-fb-opt-125m-route-02ac88e7

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-route" not found

kserve-ci-e2e-test

kubelet

llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche68s48

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche68s48

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-8547b4b7ccrvpvg

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-8547b4b7ccrvpvg

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-8547b4b7ccrvpvg

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-02ac88e7

Created

Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-workload-svc

kserve-ci-e2e-test

replicaset-controller

llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-88d57bfd

SuccessfulCreate

Created pod: llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-88d57bfd-x8x5k

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-88d57bfd-x8x5k

AddedInterface

Add eth0 [10.133.0.38/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-02ac88e7

Created

Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-route

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-02ac88e7

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-02ac88e7

Created

Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-02ac88e7

Created

Created v1.Secret kserve-ci-e2e-test/llmisv8de1d74aab16d9cabd8b5aafeb5248e8-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-88d57bfd-x8x5k

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

deployment-controller

llmisvc-model-fb-opt-125m-route-02ac88e7-kserve

ScalingReplicaSet

Scaled up replica set llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-88d57bfd from 0 to 1

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-88d57bfd-x8x5k

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-88d57bfd-x8x5k

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6d5xjpk

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6d5xjpk

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6d5xjpk

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-8547b4b7ccrvpvg

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-8547b4b7ccrvpvg

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-8547b4b7ccrvpvg

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-88d57bfd-x8x5k

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-88d57bfd-x8x5k

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-88d57bfd-x8x5k

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-05aa9bba

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv8f1a6f044e8c7a4d31a250e0c4861caf-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-02ac88e7

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv8de1d74aab16d9cabd8b5aafeb5248e8-kserve-self-signed-certs
(x18)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-88d57bfd-x8x5k

Unhealthy

Startup probe failed: Get "https://10.133.0.38:8000/health": dial tcp 10.133.0.38:8000: connect: connection refused
(x19)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-8547b4b7ccrvpvg

Unhealthy

Startup probe failed: Get "https://10.133.0.36:8001/health": dial tcp 10.133.0.36:8001: connect: connection refused
(x19)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6d5xjpk

Unhealthy

Startup probe failed: Get "https://10.133.0.37:8000/health": dial tcp 10.133.0.37:8000: connect: connection refused

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-88d57bfd-x8x5k

Killing

Stopping container main
(x10)

kserve-ci-e2e-test

OpenDataHubModelController

llmisvc-model-fb-opt-125m-route-f312f5ec

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-route" not found

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn

GroupsProgressing

Created leader statefulset llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-f312f5ec

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-scc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-f312f5ec

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-f312f5ec

Created

Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-f312f5ec

Created

Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-f312f5ec

Created

Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-f312f5ec

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-testc9aefdf01a18c3acb55ce247710ebb71-llmisvc-mode

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-f312f5ec

Created

Created v1.Secret kserve-ci-e2e-test/llmisv4e643bc258191ffc517a31cd1d0ddd27-kserve-self-signed-certs

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn

CreatingRevision

Creating revision with key 94b56b8b6 for a newly created LeaderWorkerSet

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

deployment-controller

llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheduler-858849d579 from 0 to 1

kserve-ci-e2e-test

multus

llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheffvmc

AddedInterface

Add eth0 [10.134.0.58/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheffvmc

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheffvmc

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheffvmc

Started

Started container storage-initializer

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0

AddedInterface

Add eth0 [10.133.0.39/23] from ovn-kubernetes

kserve-ci-e2e-test

statefulset-controller

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0

SuccessfulCreate

create Pod llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 in StatefulSet llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 successful

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1

Created

Created container: storage-initializer

kserve-ci-e2e-test

replicaset-controller

llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheduler-858849d579

SuccessfulCreate

Created pod: llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheffvmc

kserve-ci-e2e-test

multus

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1

AddedInterface

Add eth0 [10.134.0.57/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0

Created

Created container: storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-f312f5ec

Created

Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-f312f5ec

Created

Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-epp-role

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn

GroupsProgressing

Created worker statefulset for leader pod llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0

kserve-ci-e2e-test

statefulset-controller

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn

SuccessfulCreate

create Pod llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 in StatefulSet llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn successful
(x2)

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn

GroupsProgressing

Replicas are progressing, with 0 groups ready of total 1 groups

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0

Started

Started container storage-initializer
(x8)

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-f312f5ec

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-shadow-svc

kserve-ci-e2e-test

kubelet

llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheffvmc

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheffvmc

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheffvmc

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheffvmc

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheffvmc

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheffvmc

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1

Pulling

Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1"

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-f312f5ec

Updated

Updated v1.Secret kserve-ci-e2e-test/llmisv4e643bc258191ffc517a31cd1d0ddd27-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche68s48

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-sche68s48

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6d5xjpk

Killing

Stopping container main

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-05aa9bba

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test4ce8108fb3d8aff064c322bee6e173f5-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-8547b4b7ccrvpvg

Killing

Stopping container llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-8547b4b7ccrvpvg

Killing

Stopping container main
(x10)

kserve-ci-e2e-test

OpenDataHubModelController

custom-route-timeout-pd-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-pd-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-pd-test-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-rb

kserve-ci-e2e-test

multus

custom-route-timeout-pd-test-kserve-58fbddc65d-2b7r9

AddedInterface

Add eth0 [10.133.0.40/23] from ovn-kubernetes

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-55c8678f5c-k4nbq

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

multus

custom-route-timeout-pd-test-kserve-prefill-55c8678f5c-k4nbq

AddedInterface

Add eth0 [10.133.0.41/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-58fbddc65d-2b7r9

Pulled

Container image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.6.0" already present on machine

kserve-ci-e2e-test

replicaset-controller

custom-route-timeout-pd-test-kserve-58fbddc65d

SuccessfulCreate

Created pod: custom-route-timeout-pd-test-kserve-58fbddc65d-2b7r9

kserve-ci-e2e-test

deployment-controller

custom-route-timeout-pd-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set custom-route-timeout-pd-test-kserve-router-scheduler-6869f95954 from 0 to 1

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.Role kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-role

kserve-ci-e2e-test

replicaset-controller

custom-route-timeout-pd-test-kserve-prefill-55c8678f5c

SuccessfulCreate

Created pod: custom-route-timeout-pd-test-kserve-prefill-55c8678f5c-k4nbq

kserve-ci-e2e-test

deployment-controller

custom-route-timeout-pd-test-kserve-prefill

ScalingReplicaSet

Scaled up replica set custom-route-timeout-pd-test-kserve-prefill-55c8678f5c from 0 to 1

kserve-ci-e2e-test

replicaset-controller

custom-route-timeout-pd-test-kserve-router-scheduler-6869f95954

SuccessfulCreate

Created pod: custom-route-timeout-pd-test-kserve-router-scheduler-6869fqgjgd

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.Service kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-workload-svc

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-epp-sa

kserve-ci-e2e-test

deployment-controller

custom-route-timeout-pd-test-kserve

ScalingReplicaSet

Scaled up replica set custom-route-timeout-pd-test-kserve-58fbddc65d from 0 to 1
(x10)

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-shadow-svc

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-58fbddc65d-2b7r9

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-58fbddc65d-2b7r9

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-55c8678f5c-k4nbq

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-55c8678f5c-k4nbq

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-58fbddc65d-2b7r9

Created

Created container: llm-d-routing-sidecar

kserve-ci-e2e-test

multus

custom-route-timeout-pd-test-kserve-router-scheduler-6869fqgjgd

AddedInterface

Add eth0 [10.132.0.33/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6869fqgjgd

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6869fqgjgd

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6869fqgjgd

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-58fbddc65d-2b7r9

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-58fbddc65d-2b7r9

Started

Started container llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6869fqgjgd

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6869fqgjgd

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6869fqgjgd

Created

Created container: tokenizer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6869fqgjgd

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6869fqgjgd

Started

Started container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6869fqgjgd

Created

Created container: main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-58fbddc65d-2b7r9

Started

Started container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-58fbddc65d-2b7r9

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-55c8678f5c-k4nbq

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-55c8678f5c-k4nbq

Started

Started container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-58fbddc65d-2b7r9

Created

Created container: main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-55c8678f5c-k4nbq

Created

Created container: main

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Updated

Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1

Started

Started container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1

Created

Created container: main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1

Pulled

Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" in 26.692s (26.692s including waiting). Image size: 3458932386 bytes.
(x15)

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0

Unhealthy

Startup probe failed: Get "https://10.133.0.39:8000/health": dial tcp 10.133.0.39:8000: connect: connection refused

kserve-ci-e2e-test

leaderworkerset

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn

AllGroupsReady

All replicas are ready, with 1 groups ready of total 1 groups

kserve-ci-e2e-test

kubelet

llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheffvmc

Killing

Stopping container tokenizer

kserve-ci-e2e-test

LLMInferenceServiceController

llmisvc-model-fb-opt-125m-route-f312f5ec

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testc9aefdf01a18c3acb55ce247710ebb71-llmisvc-mode

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheffvmc

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1

Killing

Stopping container main
(x11)

kserve-ci-e2e-test

OpenDataHubModelController

scheduler-inline-config-test

ReconcileError

Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-inline-config-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-inline-config-test-kserve-route" not found

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-kserve-workload-svc

kserve-ci-e2e-test

deployment-controller

scheduler-inline-config-test-kserve

ScalingReplicaSet

Scaled up replica set scheduler-inline-config-test-kserve-58544ffb65 from 0 to 1

kserve-ci-e2e-test

replicaset-controller

scheduler-inline-config-test-kserve-58544ffb65

SuccessfulCreate

Created pod: scheduler-inline-config-test-kserve-58544ffb65-tdgdw

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-inline-config-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.Role kserve-ci-e2e-test/scheduler-inline-config-test-epp-role

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/scheduler-inline-config-test-epp-rb

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-epp-service

kserve-ci-e2e-test

multus

scheduler-inline-config-test-kserve-58544ffb65-tdgdw

AddedInterface

Add eth0 [10.132.0.34/23] from ovn-kubernetes

kserve-ci-e2e-test

deployment-controller

scheduler-inline-config-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set scheduler-inline-config-test-kserve-router-scheduler-7599bcc4d6 from 0 to 1

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-7599bzdpq7

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-7599bzdpq7

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

multus

scheduler-inline-config-test-kserve-router-scheduler-7599bzdpq7

AddedInterface

Add eth0 [10.134.0.59/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-58544ffb65-tdgdw

Started

Started container storage-initializer
(x6)

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-inline-config-test-kserve-shadow-svc

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-7599bzdpq7

Started

Started container storage-initializer

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Created

Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-58544ffb65-tdgdw

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-58544ffb65-tdgdw

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

replicaset-controller

scheduler-inline-config-test-kserve-router-scheduler-7599bcc4d6

SuccessfulCreate

Created pod: scheduler-inline-config-test-kserve-router-scheduler-7599bzdpq7

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-7599bzdpq7

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-7599bzdpq7

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-7599bzdpq7

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-7599bzdpq7

Started

Started container main

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-7599bzdpq7

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-7599bzdpq7

Created

Created container: tokenizer
(x17)

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-58fbddc65d-2b7r9

Unhealthy

Startup probe failed: Get "https://10.133.0.40:8001/health": dial tcp 10.133.0.40:8001: connect: connection refused
(x17)

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-55c8678f5c-k4nbq

Unhealthy

Startup probe failed: Get "https://10.133.0.41:8000/health": dial tcp 10.133.0.41:8000: connect: connection refused

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-58544ffb65-tdgdw

Pulling

Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.5.1"

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-58544ffb65-tdgdw

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.5.1" in 2.64s (2.64s including waiting). Image size: 252996841 bytes.

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-58544ffb65-tdgdw

Created

Created container: main

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-58544ffb65-tdgdw

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Updated

Updated v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-58544ffb65-tdgdw

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-7599bzdpq7

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

scheduler-inline-config-test-kserve-router-scheduler-7599bzdpq7

Killing

Stopping container tokenizer

kserve-ci-e2e-test

LLMInferenceServiceController

scheduler-inline-config-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb

kserve-ci-e2e-test

service-controller

router-gateway-2-openshift-default

EnsuringLoadBalancer

Ensuring load balancer

kserve-ci-e2e-test

multus

router-gateway-2-openshift-default-6866b85949-4p7m7

AddedInterface

Add eth0 [10.134.0.60/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

router-gateway-2-openshift-default-6866b85949-4p7m7

Pulling

Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:d518f3d1539f45e1253c5c9fa22062802804601d4998cd50344e476a3cc388fe"

kserve-ci-e2e-test

replicaset-controller

router-gateway-2-openshift-default-6866b85949

SuccessfulCreate

Created pod: router-gateway-2-openshift-default-6866b85949-4p7m7

kserve-ci-e2e-test

deployment-controller

router-gateway-2-openshift-default

ScalingReplicaSet

Scaled up replica set router-gateway-2-openshift-default-6866b85949 from 0 to 1

kserve-ci-e2e-test

gateway_labeler_controller

router-gateway-2

AddedLabel

Added label istio.io/rev=openshift-gateway to gateway router-gateway-2

kserve-ci-e2e-test

kubelet

router-gateway-2-openshift-default-6866b85949-4p7m7

Pulled

Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:d518f3d1539f45e1253c5c9fa22062802804601d4998cd50344e476a3cc388fe" in 2.46s (2.46s including waiting). Image size: 163191192 bytes.

kserve-ci-e2e-test

kubelet

router-gateway-2-openshift-default-6866b85949-4p7m7

Started

Started container istio-proxy

kserve-ci-e2e-test

kubelet

router-gateway-2-openshift-default-6866b85949-4p7m7

Created

Created container: istio-proxy

kserve-ci-e2e-test

service-controller

router-gateway-2-openshift-default

EnsuredLoadBalancer

Ensured load balancer
(x2)

kserve-ci-e2e-test

kubelet

router-gateway-2-openshift-default-6866b85949-4p7m7

Unhealthy

Startup probe failed: Get "http://10.134.0.60:15021/healthz/ready": dial tcp 10.134.0.60:15021: connect: connection refused

kserve-ci-e2e-test

replicaset-controller

router-with-refs-pd-test-kserve-prefill-588f9994fc

SuccessfulCreate

Created pod: router-with-refs-pd-test-kserve-prefill-588f9994fc-pmxz5

kserve-ci-e2e-test

replicaset-controller

router-with-refs-pd-test-kserve-5557b45666

SuccessfulCreate

Created pod: router-with-refs-pd-test-kserve-5557b45666-skg9c

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.Role kserve-ci-e2e-test/router-with-refs-pd-test-kserve-role

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-pd-test-kserve-rb

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-epp-sa

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

Created v1.Service kserve-ci-e2e-test/router-with-refs-pd-test-kserve-workload-svc

kserve-ci-e2e-test

deployment-controller

router-with-refs-pd-test-kserve-router-scheduler

ScalingReplicaSet

Scaled up replica set router-with-refs-pd-test-kserve-router-scheduler-55f8fdb598 from 0 to 1

kserve-ci-e2e-test

deployment-controller

router-with-refs-pd-test-kserve

ScalingReplicaSet

Scaled up replica set router-with-refs-pd-test-kserve-5557b45666 from 0 to 1

kserve-ci-e2e-test

deployment-controller

router-with-refs-pd-test-kserve-prefill

ScalingReplicaSet

Scaled up replica set router-with-refs-pd-test-kserve-prefill-588f9994fc from 0 to 1

kserve-ci-e2e-test

replicaset-controller

router-with-refs-pd-test-kserve-router-scheduler-55f8fdb598

SuccessfulCreate

Created pod: router-with-refs-pd-test-kserve-router-scheduler-55f8fdb599zwbj
(x9)

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Created

(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-pd-test-kserve-shadow-svc

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-55f8fdb599zwbj

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-55f8fdb599zwbj

Started

Started container storage-initializer

kserve-ci-e2e-test

multus

router-with-refs-pd-test-kserve-router-scheduler-55f8fdb599zwbj

AddedInterface

Add eth0 [10.132.0.35/23] from ovn-kubernetes

kserve-ci-e2e-test

multus

router-with-refs-pd-test-kserve-5557b45666-skg9c

AddedInterface

Add eth0 [10.134.0.61/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-5557b45666-skg9c

Pulling

Pulling image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.6.0"

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-588f9994fc-pmxz5

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-55f8fdb599zwbj

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

multus

router-with-refs-pd-test-kserve-prefill-588f9994fc-pmxz5

AddedInterface

Add eth0 [10.134.0.62/23] from ovn-kubernetes

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-588f9994fc-pmxz5

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-588f9994fc-pmxz5

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-55f8fdb599zwbj

Started

Started container main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-55f8fdb599zwbj

Pulled

Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-55f8fdb599zwbj

Started

Started container tokenizer

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6869fqgjgd

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-55f8fdb599zwbj

Created

Created container: tokenizer

kserve-ci-e2e-test

LLMInferenceServiceController

custom-route-timeout-pd-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-55f8fdb599zwbj

Created

Created container: main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-55f8fdb599zwbj

Pulled

Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.6.0" already present on machine

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-58fbddc65d-2b7r9

Killing

Stopping container llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-58fbddc65d-2b7r9

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-prefill-55c8678f5c-k4nbq

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

custom-route-timeout-pd-test-kserve-router-scheduler-6869fqgjgd

Killing

Stopping container tokenizer

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-5557b45666-skg9c

Started

Started container storage-initializer

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-5557b45666-skg9c

Created

Created container: storage-initializer

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-5557b45666-skg9c

Pulled

Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:9cb363f3a01ee53202c49d182f025a6cf697ac6f3bd0a3c8aef7b04a0a53d808" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-5557b45666-skg9c

Started

Started container llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-5557b45666-skg9c

Created

Created container: llm-d-routing-sidecar

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-5557b45666-skg9c

Pulled

Successfully pulled image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.6.0" in 1.129s (1.129s including waiting). Image size: 90135294 bytes.

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-588f9994fc-pmxz5

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-588f9994fc-pmxz5

Created

Created container: main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-588f9994fc-pmxz5

Started

Started container main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-5557b45666-skg9c

Pulled

Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-5557b45666-skg9c

Created

Created container: main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-5557b45666-skg9c

Started

Started container main

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Updated

Updated v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs
(x14)

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-5557b45666-skg9c

Unhealthy

Startup probe failed: Get "https://10.134.0.61:8001/health": dial tcp 10.134.0.61:8001: connect: connection refused
(x14)

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-588f9994fc-pmxz5

Unhealthy

Startup probe failed: Get "https://10.134.0.62:8000/health": dial tcp 10.134.0.62:8000: connect: connection refused

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-5557b45666-skg9c

Killing

Stopping container llm-d-routing-sidecar

kserve-ci-e2e-test

LLMInferenceServiceController

router-with-refs-pd-test

Deleted

Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-5557b45666-skg9c

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-prefill-588f9994fc-pmxz5

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-55f8fdb599zwbj

Killing

Stopping container main

kserve-ci-e2e-test

kubelet

router-with-refs-pd-test-kserve-router-scheduler-55f8fdb599zwbj

Killing

Stopping container tokenizer