| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
stop-feature-test-kserve-5bdb8cb8b8-fbpm6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-5bdb8cb8b8-fbpm6 to ip-10-0-135-245.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-77b55c8fc-lb4z9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-77b55c8fc-lb4z9 to ip-10-0-133-60.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-test-kserve-58bf87d84-c8qcm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-58bf87d84-c8qcm to ip-10-0-135-245.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-configmap-ref-test-kserve-router-scheduler-8784fvjwjs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-8784fvjwjs to ip-10-0-135-245.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-router-scheduler-76b559dddsfsrm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-76b559dddsfsrm to ip-10-0-143-253.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-6c5b68d549-fd5qh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-6c5b68d549-fd5qh to ip-10-0-133-60.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-prefill-57c6dbf7f7-6q7sf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-57c6dbf7f7-6q7sf to ip-10-0-135-245.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756hz4df |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756hz4df to ip-10-0-143-253.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-54b886bf4d-vdz6d |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-54b886bf4d-vdz6d to ip-10-0-135-245.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756jtcsn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756jtcsn to ip-10-0-133-60.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-2-openshift-default-6866b85949-lmpz4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-lmpz4 to ip-10-0-135-245.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-6c59fbf55c-q4nx6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-6c59fbf55c-q4nx6 to ip-10-0-135-245.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-router-scheduler-78bd4f5fhf4xw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-78bd4f5fhf4xw to ip-10-0-133-60.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-6b6978488d-7z2x6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-6b6978488d-7z2x6 to ip-10-0-133-60.ec2.internal | ||
kuadrant-system |
authorino-operator-7587b89b76-7bw52 |
Scheduled |
Successfully assigned kuadrant-system/authorino-operator-7587b89b76-7bw52 to ip-10-0-143-253.ec2.internal | ||
openshift-ingress |
istiod-openshift-gateway-7cd77c7ffd-v8zwm |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-7cd77c7ffd-v8zwm to ip-10-0-135-245.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schez9lx7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schez9lx7 to ip-10-0-143-253.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-test-kserve-router-scheduler-75c866f69d-2xq9x |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-75c866f69d-2xq9x to ip-10-0-133-60.ec2.internal | ||
kuadrant-system |
authorino-68bd676465-8xzwg |
Scheduled |
Successfully assigned kuadrant-system/authorino-68bd676465-8xzwg to ip-10-0-133-60.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-test-kserve-5c998f8fc6-rjndf |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-5c998f8fc6-rjndf to ip-10-0-135-245.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-test-kserve-router-scheduler-dbdb7c5b6ddnr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-dbdb7c5b6ddnr to ip-10-0-133-60.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-inline-config-test-kserve-router-scheduler-5c87d8j5db |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-5c87d8j5db to ip-10-0-135-245.ec2.internal | ||
kuadrant-system |
limitador-operator-controller-manager-c7fb4c8d5-skkk9 |
Scheduled |
Successfully assigned kuadrant-system/limitador-operator-controller-manager-c7fb4c8d5-skkk9 to ip-10-0-135-245.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-5bdb8cb8b8-kglzl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-5bdb8cb8b8-kglzl to ip-10-0-135-245.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-router-scheduler-8755cc8d4-jfz47 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-8755cc8d4-jfz47 to ip-10-0-143-253.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-7d7dgs6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-7d7dgs6 to ip-10-0-135-245.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 to ip-10-0-133-60.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-798f86c66f445pd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-798f86c66f445pd to ip-10-0-143-253.ec2.internal | ||
openshift-ingress |
router-default-5ff55498bb-hwmkq |
Scheduled |
Successfully assigned openshift-ingress/router-default-5ff55498bb-hwmkq to ip-10-0-133-60.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-prefill-7584c7665-gs4hw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-7584c7665-gs4hw to ip-10-0-133-60.ec2.internal | ||
openshift-ingress |
router-default-5ff55498bb-hwmkq |
FailedScheduling |
0/3 nodes are available: 3 node(s) had untolerated taint {node.kubernetes.io/not-ready: }. preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. | ||
kuadrant-system |
kuadrant-console-plugin-6c886788f8-k62gr |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-console-plugin-6c886788f8-k62gr to ip-10-0-133-60.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-94f88d545-wwswl |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-94f88d545-wwswl to ip-10-0-135-245.ec2.internal | ||
kuadrant-system |
kuadrant-operator-controller-manager-6ddf9554fc-8tvn5 |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-6ddf9554fc-8tvn5 to ip-10-0-135-245.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-788494645dwrzt8 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-788494645dwrzt8 to ip-10-0-135-245.ec2.internal | ||
kuadrant-system |
limitador-limitador-64c8f475fb-p728h |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-64c8f475fb-p728h to ip-10-0-135-245.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-configmap-ref-test-kserve-5d9df7d95c-vc4h6 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-5d9df7d95c-vc4h6 to ip-10-0-133-60.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 to ip-10-0-135-245.ec2.internal | ||
kuadrant-system |
dns-operator-controller-manager-844548ff4c-khzl8 |
Scheduled |
Successfully assigned kuadrant-system/dns-operator-controller-manager-844548ff4c-khzl8 to ip-10-0-135-245.ec2.internal | ||
kuadrant-system |
authorino-674b59b84c-dkll2 |
Scheduled |
Successfully assigned kuadrant-system/authorino-674b59b84c-dkll2 to ip-10-0-133-60.ec2.internal | ||
kuadrant-system |
limitador-limitador-67566c68b4-x98p9 |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-67566c68b4-x98p9 to ip-10-0-143-253.ec2.internal | ||
openshift-ingress |
openshift-ai-inference-openshift-default-7c5447bb76-w9nb5 |
Scheduled |
Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-7c5447bb76-w9nb5 to ip-10-0-135-245.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-router-scheduler-6d485k9sd4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6d485k9sd4 to ip-10-0-143-253.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-router-scheduler-8755cc8d4-4nqql |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-8755cc8d4-4nqql to ip-10-0-143-253.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-77b55c8fc-5vjbr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-77b55c8fc-5vjbr to ip-10-0-143-253.ec2.internal | ||
kuadrant-system |
authorino-79cbc94b89-fvftr |
Scheduled |
Successfully assigned kuadrant-system/authorino-79cbc94b89-fvftr to ip-10-0-133-60.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-57b5445dc8vzgpp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-57b5445dc8vzgpp to ip-10-0-135-245.ec2.internal | ||
kserve-ci-e2e-test |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-sche2n4ng |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-sche2n4ng to ip-10-0-135-245.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherqwz7 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherqwz7 to ip-10-0-133-60.ec2.internal | ||
openshift-ingress |
istiod-openshift-gateway-55ff986f96-92qlr |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-55ff986f96-92qlr to ip-10-0-135-245.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-inline-config-test-kserve-67fd5c8857-rgq99 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-67fd5c8857-rgq99 to ip-10-0-135-245.ec2.internal | ||
kserve-ci-e2e-test |
conv-test-lora-crit-kserve-84cd5c895-6wj54 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/conv-test-lora-crit-kserve-84cd5c895-6wj54 to ip-10-0-133-60.ec2.internal | ||
openshift-ingress |
deployment-controller |
router-default |
ScalingReplicaSet |
Scaled up replica set router-default-5ff55498bb from 0 to 1 | |
openshift-ingress |
service-controller |
router-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
service-controller |
router-default |
UnAvailableLoadBalancer |
There are no available nodes for LoadBalancer | |
openshift-ingress |
service-controller |
router-default |
EnsuredLoadBalancer |
Ensured load balancer | |
| (x13) | openshift-ingress |
replicaset-controller |
router-default-5ff55498bb |
FailedCreate |
Error creating: pods "router-default-5ff55498bb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
| (x15) | openshift-ingress |
replicaset-controller |
router-default-5ff55498bb |
FailedCreate |
Error creating: pods "router-default-5ff55498bb-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
| (x3) | openshift-ingress |
service-controller |
router-default |
UpdatedLoadBalancer |
Updated load balancer with new hosts |
openshift-ingress |
replicaset-controller |
router-default-5ff55498bb |
SuccessfulCreate |
Created pod: router-default-5ff55498bb-hwmkq | |
| (x6) | openshift-ingress |
kubelet |
router-default-5ff55498bb-hwmkq |
FailedMount |
MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found |
| (x6) | openshift-ingress |
kubelet |
router-default-5ff55498bb-hwmkq |
FailedMount |
MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt |
openshift-ingress |
multus |
router-default-5ff55498bb-hwmkq |
AddedInterface |
Add eth0 [10.132.0.18/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
router-default-5ff55498bb-hwmkq |
Started |
Started container router | |
openshift-ingress |
kubelet |
router-default-5ff55498bb-hwmkq |
Created |
Created container: router | |
openshift-ingress |
kubelet |
router-default-5ff55498bb-hwmkq |
Pulled |
Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:294af5c64228434d1ed6ee8ea3ac802e3c999aa847223e3b2efa18425a9fe421" already present on machine | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-7cd77c7ffd from 0 to 1 | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7cd77c7ffd-v8zwm |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:028e10651db0d1ddb769a27c9483c6d41be6ac597f253afd9d599f395d9c82d8" | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-7cd77c7ffd |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-7cd77c7ffd-v8zwm | |
openshift-ingress |
multus |
istiod-openshift-gateway-7cd77c7ffd-v8zwm |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7cd77c7ffd-v8zwm |
Started |
Started container discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7cd77c7ffd-v8zwm |
Created |
Created container: discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7cd77c7ffd-v8zwm |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:028e10651db0d1ddb769a27c9483c6d41be6ac597f253afd9d599f395d9c82d8" in 3.61s (3.61s including waiting). Image size: 179322965 bytes. | |
openshift-ingress |
gateway_labeler_controller |
openshift-ai-inference |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway openshift-ai-inference | |
openshift-ingress |
replicaset-controller |
openshift-ai-inference-openshift-default-7c5447bb76 |
SuccessfulCreate |
Created pod: openshift-ai-inference-openshift-default-7c5447bb76-w9nb5 | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
deployment-controller |
openshift-ai-inference-openshift-default |
ScalingReplicaSet |
Scaled up replica set openshift-ai-inference-openshift-default-7c5447bb76 from 0 to 1 | |
openshift-ingress |
multus |
openshift-ai-inference-openshift-default-7c5447bb76-w9nb5 |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-7c5447bb76-w9nb5 |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:d518f3d1539f45e1253c5c9fa22062802804601d4998cd50344e476a3cc388fe" | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-7c5447bb76-w9nb5 |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:d518f3d1539f45e1253c5c9fa22062802804601d4998cd50344e476a3cc388fe" in 3.101s (3.101s including waiting). Image size: 163191192 bytes. | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-7c5447bb76-w9nb5 |
Created |
Created container: istio-proxy | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-7c5447bb76-w9nb5 |
Started |
Started container istio-proxy | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.3.0 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.3.0 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
replicaset-controller |
dns-operator-controller-manager-844548ff4c |
SuccessfulCreate |
Created pod: dns-operator-controller-manager-844548ff4c-khzl8 | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.3.2 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.3.2 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-844548ff4c-khzl8 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:b4e7ba67509320ca9ac5d63cc4add987fad05b098c4a7cd8dd91f264731177cf" | |
kuadrant-system |
multus |
dns-operator-controller-manager-844548ff4c-khzl8 |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
dns-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set dns-operator-controller-manager-844548ff4c from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.3.0 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.3.0 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.3.0 |
InstallWaiting |
installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.3.0 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-844548ff4c-khzl8 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:b4e7ba67509320ca9ac5d63cc4add987fad05b098c4a7cd8dd91f264731177cf" in 3.175s (3.175s including waiting). Image size: 186790172 bytes. | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-844548ff4c-khzl8 |
Started |
Started container manager | |
kuadrant-system |
replicaset-controller |
kuadrant-operator-controller-manager-6ddf9554fc |
SuccessfulCreate |
Created pod: kuadrant-operator-controller-manager-6ddf9554fc-8tvn5 | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.3.2 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
deployment-controller |
kuadrant-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set kuadrant-operator-controller-manager-6ddf9554fc from 0 to 1 | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-844548ff4c-khzl8 |
Created |
Created container: manager | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.3.2 |
InstallWaiting |
installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.3.2 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.3.0 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
dns-operator-controller-manager-844548ff4c-khzl8_f78624c2-c228-4895-ad43-077d8facc48a |
a3f98d6c.kuadrant.io |
LeaderElection |
dns-operator-controller-manager-844548ff4c-khzl8_f78624c2-c228-4895-ad43-077d8facc48a became leader | |
kuadrant-system |
multus |
kuadrant-operator-controller-manager-6ddf9554fc-8tvn5 |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-6ddf9554fc-8tvn5 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:7aa6d6dbbde488260789adb94fa232a06d1e635cc2aaf86af24f8cf14a17eef8" | |
kuadrant-system |
replicaset-controller |
authorino-operator-7587b89b76 |
SuccessfulCreate |
Created pod: authorino-operator-7587b89b76-7bw52 | |
kuadrant-system |
kubelet |
authorino-operator-7587b89b76-7bw52 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:4e581c0172549df72c6ef8978e96d771645bc36298d2ccf9240af4e71c088733" | |
kuadrant-system |
deployment-controller |
authorino-operator |
ScalingReplicaSet |
Scaled up replica set authorino-operator-7587b89b76 from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.3.0 |
RequirementsNotMet |
one or more requirements couldn't be found | |
| (x2) | kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.3.0 |
InstallSucceeded |
waiting for install components to report healthy |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.3.0 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.3.0 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.3.0 |
InstallWaiting |
installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability. | |
kuadrant-system |
multus |
authorino-operator-7587b89b76-7bw52 |
AddedInterface |
Add eth0 [10.133.0.23/23] from ovn-kubernetes | |
kuadrant-system |
replicaset-controller |
limitador-operator-controller-manager-c7fb4c8d5 |
SuccessfulCreate |
Created pod: limitador-operator-controller-manager-c7fb4c8d5-skkk9 | |
kuadrant-system |
deployment-controller |
limitador-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set limitador-operator-controller-manager-c7fb4c8d5 from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.3.0 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.3.0 |
InstallWaiting |
installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.3.0 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
kuadrant-operator-controller-manager-6ddf9554fc-8tvn5_25cdb612-6537-41ef-a3c3-cb2f1d323398 |
f139389e.kuadrant.io |
LeaderElection |
kuadrant-operator-controller-manager-6ddf9554fc-8tvn5_25cdb612-6537-41ef-a3c3-cb2f1d323398 became leader | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-c7fb4c8d5-skkk9 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:9a3ccb54bc904521277b87e1d178d8134cc6ef744eb4ec5b64177355fd5a9e66" | |
kuadrant-system |
kubelet |
authorino-operator-7587b89b76-7bw52 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:4e581c0172549df72c6ef8978e96d771645bc36298d2ccf9240af4e71c088733" in 3.219s (3.219s including waiting). Image size: 161991975 bytes. | |
kuadrant-system |
kubelet |
authorino-operator-7587b89b76-7bw52 |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
authorino-operator-7587b89b76-7bw52 |
Started |
Started container manager | |
kuadrant-system |
multus |
limitador-operator-controller-manager-c7fb4c8d5-skkk9 |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-6ddf9554fc-8tvn5 |
Started |
Started container manager | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-6ddf9554fc-8tvn5 |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-6ddf9554fc-8tvn5 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:7aa6d6dbbde488260789adb94fa232a06d1e635cc2aaf86af24f8cf14a17eef8" in 5.232s (5.232s including waiting). Image size: 411782238 bytes. | |
kuadrant-system |
authorino-operator-7587b89b76-7bw52_d5c01a5f-7ac1-45ee-81bd-3ba349b95d52 |
aac3a15d.authorino.kuadrant.io |
LeaderElection |
authorino-operator-7587b89b76-7bw52_d5c01a5f-7ac1-45ee-81bd-3ba349b95d52 became leader | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-c7fb4c8d5-skkk9 |
Started |
Started container manager | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-c7fb4c8d5-skkk9 |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-c7fb4c8d5-skkk9 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:9a3ccb54bc904521277b87e1d178d8134cc6ef744eb4ec5b64177355fd5a9e66" in 1.949s (1.949s including waiting). Image size: 175506011 bytes. | |
kuadrant-system |
limitador-operator-controller-manager-c7fb4c8d5-skkk9_fd6507ef-104f-4dda-8d62-6066d405bafb |
3745a16e.kuadrant.io |
LeaderElection |
limitador-operator-controller-manager-c7fb4c8d5-skkk9_fd6507ef-104f-4dda-8d62-6066d405bafb became leader | |
kuadrant-system |
deployment-controller |
kuadrant-console-plugin |
ScalingReplicaSet |
Scaled up replica set kuadrant-console-plugin-6c886788f8 from 0 to 1 | |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kuadrant-system |
replicaset-controller |
kuadrant-console-plugin-6c886788f8 |
SuccessfulCreate |
Created pod: kuadrant-console-plugin-6c886788f8-k62gr | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-6c886788f8-k62gr |
FailedMount |
MountVolume.SetUp failed for volume "plugin-serving-cert" : secret "plugin-serving-cert" not found | |
kuadrant-system |
multus |
kuadrant-console-plugin-6c886788f8-k62gr |
AddedInterface |
Add eth0 [10.132.0.24/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-6c886788f8-k62gr |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:41755d5e16ee5409cfe8888cf5883b262820baea4eae449fcf61f06ab1756f57" | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.3.0 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-6c886788f8-k62gr |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:41755d5e16ee5409cfe8888cf5883b262820baea4eae449fcf61f06ab1756f57" in 5.117s (5.117s including waiting). Image size: 339541674 bytes. | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-6c886788f8-k62gr |
Started |
Started container kuadrant-console-plugin | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-6c886788f8-k62gr |
Created |
Created container: kuadrant-console-plugin | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.3.0 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.3.2 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.3.0 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
replicaset-controller |
limitador-limitador-67566c68b4 |
SuccessfulCreate |
Created pod: limitador-limitador-67566c68b4-x98p9 | |
kuadrant-system |
multus |
limitador-limitador-67566c68b4-x98p9 |
AddedInterface |
Add eth0 [10.133.0.24/23] from ovn-kubernetes | |
kuadrant-system |
replicaset-controller |
authorino-674b59b84c |
SuccessfulCreate |
Created pod: authorino-674b59b84c-dkll2 | |
kuadrant-system |
replicaset-controller |
limitador-limitador-64c8f475fb |
SuccessfulCreate |
Created pod: limitador-limitador-64c8f475fb-p728h | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-67566c68b4 from 0 to 1 | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-674b59b84c from 0 to 1 | |
kuadrant-system |
kubelet |
limitador-limitador-67566c68b4-x98p9 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:43bc4021bb30c7ef305e01c11e22ca5584c7e2c192b4db0a5646f04f715ee3b0" | |
kuadrant-system |
kubelet |
limitador-limitador-64c8f475fb-p728h |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:43bc4021bb30c7ef305e01c11e22ca5584c7e2c192b4db0a5646f04f715ee3b0" | |
kuadrant-system |
multus |
limitador-limitador-64c8f475fb-p728h |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-64c8f475fb from 0 to 1 | |
kuadrant-system |
multus |
authorino-674b59b84c-dkll2 |
AddedInterface |
Add eth0 [10.132.0.25/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-79cbc94b89 from 0 to 1 | |
kuadrant-system |
replicaset-controller |
authorino-79cbc94b89 |
SuccessfulCreate |
Created pod: authorino-79cbc94b89-fvftr | |
kuadrant-system |
kubelet |
authorino-79cbc94b89-fvftr |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c2208382e16c501e4ed58aea83f54d108567f36853cf79f7ffdf8ee54ff4ace8" | |
kuadrant-system |
kubelet |
authorino-674b59b84c-dkll2 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c2208382e16c501e4ed58aea83f54d108567f36853cf79f7ffdf8ee54ff4ace8" | |
kuadrant-system |
multus |
authorino-79cbc94b89-fvftr |
AddedInterface |
Add eth0 [10.132.0.26/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-674b59b84c-dkll2 |
Started |
Started container authorino | |
kuadrant-system |
kubelet |
authorino-674b59b84c-dkll2 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c2208382e16c501e4ed58aea83f54d108567f36853cf79f7ffdf8ee54ff4ace8" in 2.809s (2.809s including waiting). Image size: 199256829 bytes. | |
kuadrant-system |
kubelet |
authorino-79cbc94b89-fvftr |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-79cbc94b89-fvftr |
Started |
Started container authorino | |
kuadrant-system |
kubelet |
limitador-limitador-67566c68b4-x98p9 |
Started |
Started container limitador | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-674b59b84c from 1 to 0 | |
kuadrant-system |
replicaset-controller |
authorino-674b59b84c |
SuccessfulDelete |
Deleted pod: authorino-674b59b84c-dkll2 | |
kuadrant-system |
kubelet |
limitador-limitador-67566c68b4-x98p9 |
Created |
Created container: limitador | |
kuadrant-system |
kubelet |
limitador-limitador-67566c68b4-x98p9 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:43bc4021bb30c7ef305e01c11e22ca5584c7e2c192b4db0a5646f04f715ee3b0" in 3.631s (3.631s including waiting). Image size: 249943843 bytes. | |
kuadrant-system |
kubelet |
authorino-79cbc94b89-fvftr |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c2208382e16c501e4ed58aea83f54d108567f36853cf79f7ffdf8ee54ff4ace8" in 2.688s (2.688s including waiting). Image size: 199256829 bytes. | |
kuadrant-system |
kubelet |
limitador-limitador-64c8f475fb-p728h |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:43bc4021bb30c7ef305e01c11e22ca5584c7e2c192b4db0a5646f04f715ee3b0" in 3.896s (3.896s including waiting). Image size: 249943843 bytes. | |
kuadrant-system |
kubelet |
limitador-limitador-64c8f475fb-p728h |
Started |
Started container limitador | |
kuadrant-system |
kubelet |
limitador-limitador-64c8f475fb-p728h |
Created |
Created container: limitador | |
kuadrant-system |
kubelet |
authorino-674b59b84c-dkll2 |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-674b59b84c-dkll2 |
Killing |
Stopping container authorino | |
kuadrant-system |
kubelet |
limitador-limitador-64c8f475fb-p728h |
Killing |
Stopping container limitador | |
kuadrant-system |
replicaset-controller |
limitador-limitador-64c8f475fb |
SuccessfulDelete |
Deleted pod: limitador-limitador-64c8f475fb-p728h | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled down replica set limitador-limitador-64c8f475fb from 1 to 0 | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-68bd676465 from 0 to 1 | |
kuadrant-system |
replicaset-controller |
authorino-68bd676465 |
SuccessfulCreate |
Created pod: authorino-68bd676465-8xzwg | |
kuadrant-system |
multus |
authorino-68bd676465-8xzwg |
AddedInterface |
Add eth0 [10.132.0.27/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-68bd676465-8xzwg |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c2208382e16c501e4ed58aea83f54d108567f36853cf79f7ffdf8ee54ff4ace8" in 380ms (380ms including waiting). Image size: 199256829 bytes. | |
kuadrant-system |
kubelet |
authorino-68bd676465-8xzwg |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c2208382e16c501e4ed58aea83f54d108567f36853cf79f7ffdf8ee54ff4ace8" | |
kuadrant-system |
kubelet |
authorino-68bd676465-8xzwg |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-68bd676465-8xzwg |
Started |
Started container authorino | |
kuadrant-system |
replicaset-controller |
authorino-79cbc94b89 |
SuccessfulDelete |
Deleted pod: authorino-79cbc94b89-fvftr | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-79cbc94b89 from 1 to 0 | |
kuadrant-system |
kubelet |
authorino-79cbc94b89-fvftr |
Killing |
Stopping container authorino | |
openshift-ingress |
multus |
istiod-openshift-gateway-55ff986f96-92qlr |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-55ff986f96 from 0 to 1 | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-55ff986f96-92qlr |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:028e10651db0d1ddb769a27c9483c6d41be6ac597f253afd9d599f395d9c82d8" already present on machine | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-55ff986f96 |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-55ff986f96-92qlr | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-55ff986f96-92qlr |
Started |
Started container discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-55ff986f96-92qlr |
Created |
Created container: discovery | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled down replica set istiod-openshift-gateway-7cd77c7ffd from 1 to 0 | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-7cd77c7ffd |
SuccessfulDelete |
Deleted pod: istiod-openshift-gateway-7cd77c7ffd-v8zwm | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7cd77c7ffd-v8zwm |
Killing |
Stopping container discovery | |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-6c59fbf55c |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-6c59fbf55c-q4nx6 | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-1-openshift-default-6c59fbf55c from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-6c59fbf55c-q4nx6 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:d518f3d1539f45e1253c5c9fa22062802804601d4998cd50344e476a3cc388fe" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-6c59fbf55c-q4nx6 |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-6c59fbf55c-q4nx6 |
AddedInterface |
Add eth0 [10.134.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-6c59fbf55c-q4nx6 |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-configmap-ref-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-configmap-ref-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-configmap-ref-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-configmap-ref-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-configmap-ref-test-kserve-5d9df7d95c from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-configmap-ref-test-kserve-router-scheduler-8784fcb67 |
SuccessfulCreate |
Created pod: scheduler-configmap-ref-test-kserve-router-scheduler-8784fvjwjs | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-configmap-ref-test-kserve-5d9df7d95c |
SuccessfulCreate |
Created pod: scheduler-configmap-ref-test-kserve-5d9df7d95c-vc4h6 | |
kserve-ci-e2e-test |
multus |
scheduler-configmap-ref-test-kserve-5d9df7d95c-vc4h6 |
AddedInterface |
Add eth0 [10.132.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-5d9df7d95c-vc4h6 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-rb | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-configmap-ref-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-configmap-ref-test-kserve-router-scheduler-8784fcb67 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-role | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-8784fvjwjs |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-shadow-svc |
kserve-ci-e2e-test |
multus |
scheduler-configmap-ref-test-kserve-router-scheduler-8784fvjwjs |
AddedInterface |
Add eth0 [10.134.0.51/23] from ovn-kubernetes | |
| (x14) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-8784fvjwjs |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" in 3.442s (3.442s including waiting). Image size: 300957093 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-8784fvjwjs |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-5d9df7d95c-vc4h6 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" in 3.327s (3.327s including waiting). Image size: 300957093 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-5d9df7d95c-vc4h6 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-5d9df7d95c-vc4h6 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-8784fvjwjs |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-8784fvjwjs |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-8784fvjwjs |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-8784fvjwjs |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-8784fvjwjs |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" in 996ms (996ms including waiting). Image size: 87241021 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-8784fvjwjs |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-5d9df7d95c-vc4h6 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-5d9df7d95c-vc4h6 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.141s (1.141s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-5d9df7d95c-vc4h6 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-5d9df7d95c-vc4h6 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-798f86c66f |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-798f86c66f445pd | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-798f86c66f445pd |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-798f86c66f from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvad71fa5348b85aebd404221bba611457-kserve-self-signed-certs | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-798f86c66f445pd |
AddedInterface |
Add eth0 [10.133.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-route | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-798f86c66f445pd |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" in 3.162s (3.162s including waiting). Image size: 300957093 bytes. | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-798f86c66f445pd |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-798f86c66f445pd |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvad71fa5348b85aebd404221bba611457-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-8784fvjwjs |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-8784fvjwjs |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-8784fvjwjs |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" in 31.221s (31.221s including waiting). Image size: 2907020949 bytes. | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-798f86c66f445pd |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-798f86c66f445pd |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.003s (1.003s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-798f86c66f445pd |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-798f86c66f445pd |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-6c5b68d549 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-6c5b68d549-fd5qh | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-ha-replicas-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-ha-replicas-test-kserve-6c5b68d549 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b7568c7 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756hz4df | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-role | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-ha-replicas-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-ha-replicas-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-ha-replicas-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-ha-replicas-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-ha-replicas-test-kserve-router-scheduler-7c5b7568c7 from 0 to 2 | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-6c5b68d549-fd5qh |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-6c5b68d549-fd5qh |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756jtcsn |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756hz4df |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756hz4df |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756jtcsn |
AddedInterface |
Add eth0 [10.132.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-6c5b68d549-fd5qh |
AddedInterface |
Add eth0 [10.132.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-6c5b68d549-fd5qh |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756hz4df |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756hz4df |
AddedInterface |
Add eth0 [10.133.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756jtcsn |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756jtcsn |
Created |
Created container: storage-initializer | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-shadow-svc |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b7568c7 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756jtcsn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-8784fvjwjs |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-8784fvjwjs |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-5d9df7d95c-vc4h6 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756hz4df |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756jtcsn |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756jtcsn |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" in 1.067s (1.067s including waiting). Image size: 87241021 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756jtcsn |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756jtcsn |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756jtcsn |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-8784fvjwjs |
Unhealthy |
Readiness probe failed: timeout: failed to connect service "10.134.0.51:9003" within 1s: context deadline exceeded | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756hz4df |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" in 1.445s (1.445s including waiting). Image size: 87241021 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756hz4df |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756hz4df |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756hz4df |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-6c5b68d549-fd5qh |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-6c5b68d549-fd5qh |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-6c5b68d549-fd5qh |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-798f86c66f445pd |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756jtcsn |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" in 29.374s (29.374s including waiting). Image size: 2907020949 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756jtcsn |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756jtcsn |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756hz4df |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" in 29.904s (29.904s including waiting). Image size: 2907020949 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756hz4df |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756hz4df |
Started |
Started container tokenizer | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheduler-7774b46666 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-epp-service | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-57b5445dc8 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-57b5445dc8vzgpp | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvdde380eaa9fe1facad32d45131f9e34d-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-57b5445dc8 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-teste2c0c7deeb42f8b9846a7a45d2caecd2-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheduler-7774b46666 |
SuccessfulCreate |
Created pod: llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-sche2n4ng | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-epp-rb | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-sche2n4ng |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-57b5445dc8vzgpp |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-57b5445dc8vzgpp |
AddedInterface |
Add eth0 [10.134.0.52/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-57b5445dc8vzgpp |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-57b5445dc8vzgpp |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-sche2n4ng |
AddedInterface |
Add eth0 [10.134.0.53/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756hz4df |
Unhealthy |
Startup probe failed: Get "http://10.133.0.26:8082/healthz": dial tcp 10.133.0.26:8082: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-sche2n4ng |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-sche2n4ng |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-sche2n4ng |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-sche2n4ng |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-sche2n4ng |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-sche2n4ng |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-sche2n4ng |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-sche2n4ng |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-57b5445dc8vzgpp |
Pulling |
Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" | |
| (x4) | kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756hz4df |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-6c5b68d549-fd5qh |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756jtcsn |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756jtcsn |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvdde380eaa9fe1facad32d45131f9e34d-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756hz4df |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-7c5b756hz4df |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-shadow-svc |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
precise-prefix-cache-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy precise-prefix-cache-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "precise-prefix-cache-test-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-sche2n4ng |
Unhealthy |
Startup probe failed: Get "http://10.134.0.53:8082/healthz": dial tcp 10.134.0.53:8082: connect: connection refused | |
kserve-ci-e2e-test |
deployment-controller |
precise-prefix-cache-test-kserve |
ScalingReplicaSet |
Scaled up replica set precise-prefix-cache-test-kserve-77b55c8fc from 0 to 2 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Role kserve-ci-e2e-test/precise-prefix-cache-test-epp-role | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-77b55c8fc-lb4z9 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-77b55c8fc-lb4z9 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
precise-prefix-cache-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set precise-prefix-cache-test-kserve-router-scheduler-78bd4f5ff9 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-77b55c8fc |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-77b55c8fc-5vjbr | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-router-scheduler-78bd4f5ff9 |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-router-scheduler-78bd4f5fhf4xw | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-77b55c8fc |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-77b55c8fc-lb4z9 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/precise-prefix-cache-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-epp-service | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-77b55c8fc-lb4z9 |
AddedInterface |
Add eth0 [10.132.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-77b55c8fc-5vjbr |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-77b55c8fc-5vjbr |
AddedInterface |
Add eth0 [10.133.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/precise-prefix-cache-test-epp-rb | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-77b55c8fc-5vjbr |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-77b55c8fc-5vjbr |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-78bd4f5fhf4xw |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-78bd4f5fhf4xw |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-78bd4f5fhf4xw |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-router-scheduler-78bd4f5fhf4xw |
AddedInterface |
Add eth0 [10.132.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-77b55c8fc-lb4z9 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-78bd4f5fhf4xw |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-78bd4f5fhf4xw |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-78bd4f5fhf4xw |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-78bd4f5fhf4xw |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-78bd4f5fhf4xw |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-78bd4f5fhf4xw |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-77b55c8fc-5vjbr |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-77b55c8fc-5vjbr |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-77b55c8fc-5vjbr |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-77b55c8fc-lb4z9 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-77b55c8fc-lb4z9 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-77b55c8fc-lb4z9 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/precise-prefix-cache-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-57b5445dc8vzgpp |
Pulled |
Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" in 27.428s (27.428s including waiting). Image size: 3458932386 bytes. | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-57b5445dc8vzgpp |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-57b5445dc8vzgpp |
Created |
Created container: main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-78bd4f5fhf4xw |
Unhealthy |
Liveness probe failed: timeout: failed to connect service "10.132.0.33:9003" within 1s: context deadline exceeded |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-78bd4f5fhf4xw |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-77b55c8fc-lb4z9 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-78bd4f5fhf4xw |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-77b55c8fc-5vjbr |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-lora-crit |
Created |
Created v1.Deployment kserve-ci-e2e-test/conv-test-lora-crit-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-lora-crit |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/conv-test-lora-crit-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-lora-crit |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/conv-test-lora-crit-kserve-route | |
kserve-ci-e2e-test |
multus |
conv-test-lora-crit-kserve-84cd5c895-6wj54 |
AddedInterface |
Add eth0 [10.132.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-lora-crit |
Created |
Created v1.Service kserve-ci-e2e-test/conv-test-lora-crit-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-lora-crit |
Created |
Created v1.Secret kserve-ci-e2e-test/conv-test-lora-crit-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
conv-test-lora-crit-kserve |
ScalingReplicaSet |
Scaled up replica set conv-test-lora-crit-kserve-84cd5c895 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
conv-test-lora-crit-kserve-84cd5c895 |
SuccessfulCreate |
Created pod: conv-test-lora-crit-kserve-84cd5c895-6wj54 | |
| (x2) | kserve-ci-e2e-test |
kubelet |
conv-test-lora-crit-kserve-84cd5c895-6wj54 |
Started |
Started container storage-initializer |
| (x2) | kserve-ci-e2e-test |
kubelet |
conv-test-lora-crit-kserve-84cd5c895-6wj54 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine |
| (x2) | kserve-ci-e2e-test |
kubelet |
conv-test-lora-crit-kserve-84cd5c895-6wj54 |
Created |
Created container: storage-initializer |
| (x2) | kserve-ci-e2e-test |
kubelet |
conv-test-lora-crit-kserve-84cd5c895-6wj54 |
BackOff |
Back-off restarting failed container storage-initializer in pod conv-test-lora-crit-kserve-84cd5c895-6wj54_kserve-ci-e2e-test(b5d6568e-e008-4edb-b3c5-d1ef33086741) |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5bdb8cb8b8-kglzl |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5bdb8cb8b8-kglzl |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-5bdb8cb8b8 |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-5bdb8cb8b8-kglzl | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/stop-feature-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Role kserve-ci-e2e-test/stop-feature-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-stop-feature-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-5bdb8cb8b8-kglzl |
AddedInterface |
Add eth0 [10.134.0.54/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5bdb8cb8b8-kglzl |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-5bdb8cb8b8 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-router-scheduler-8755cc8d4 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-router-scheduler-8755cc8d4 |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-router-scheduler-8755cc8d4-4nqql | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-4nqql |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-4nqql |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-4nqql |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-router-scheduler-8755cc8d4-4nqql |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/stop-feature-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-4nqql |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-4nqql |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-4nqql |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-4nqql |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-4nqql |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-4nqql |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5bdb8cb8b8-kglzl |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5bdb8cb8b8-kglzl |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5bdb8cb8b8-kglzl |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
| (x10) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-57b5445dc8vzgpp |
Unhealthy |
Startup probe failed: Get "https://10.134.0.52:8000/health": dial tcp 10.134.0.52:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-teste2c0c7deeb42f8b9846a7a45d2caecd2-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-sche2n4ng |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-sche2n4ng |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-57b5445dc8vzgpp |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-sche2n4ng |
Unhealthy |
Readiness probe failed: Get "http://10.134.0.53:8082/healthz": dial tcp 10.134.0.53:8082: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-sche2n4ng |
Unhealthy |
Readiness probe failed: timeout: failed to connect service "10.134.0.53:9003" within 1s: context deadline exceeded | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
custom-route-timeout-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-test-kserve-shadow-svc |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-test-kserve-5c998f8fc6 |
SuccessfulCreate |
Created pod: custom-route-timeout-test-kserve-5c998f8fc6-rjndf | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-test-kserve-router-scheduler-dbdb7c5b6 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-test-kserve |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-test-kserve-5c998f8fc6 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-dbdb7c5b6ddnr |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-test-epp-sa | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-test-kserve-router-scheduler-dbdb7c5b6 |
SuccessfulCreate |
Created pod: custom-route-timeout-test-kserve-router-scheduler-dbdb7c5b6ddnr | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Role kserve-ci-e2e-test/custom-route-timeout-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-5c998f8fc6-rjndf |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-5c998f8fc6-rjndf |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-test-kserve-router-scheduler-dbdb7c5b6ddnr |
AddedInterface |
Add eth0 [10.132.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-5c998f8fc6-rjndf |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-test-kserve-5c998f8fc6-rjndf |
AddedInterface |
Add eth0 [10.134.0.55/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-dbdb7c5b6ddnr |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-dbdb7c5b6ddnr |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-dbdb7c5b6ddnr |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-dbdb7c5b6ddnr |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-dbdb7c5b6ddnr |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-dbdb7c5b6ddnr |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-dbdb7c5b6ddnr |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-dbdb7c5b6ddnr |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-5c998f8fc6-rjndf |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-5c998f8fc6-rjndf |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-5c998f8fc6-rjndf |
Started |
Started container main | |
| (x10) | kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5bdb8cb8b8-kglzl |
Unhealthy |
Startup probe failed: Get "https://10.134.0.54:8000/health": dial tcp 10.134.0.54:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.InferencePool kserve-ci-e2e-test/stop-feature-test-inference-pool | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-4nqql |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-4nqql |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1alpha2.InferencePool kserve-ci-e2e-test/stop-feature-test-inference-pool | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5bdb8cb8b8-kglzl |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-4nqql |
Unhealthy |
Readiness probe failed: timeout: failed to connect service "10.133.0.28:9003" within 1s: context deadline exceeded | |
| (x25) | kserve-ci-e2e-test |
OpenDataHubModelController |
stop-feature-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy stop-feature-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "stop-feature-test-kserve-route" not found |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-5bdb8cb8b8 |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-5bdb8cb8b8-fbpm6 | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5bdb8cb8b8-fbpm6 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5bdb8cb8b8-fbpm6 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5bdb8cb8b8-fbpm6 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-5bdb8cb8b8-fbpm6 |
AddedInterface |
Add eth0 [10.134.0.56/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-router-scheduler-8755cc8d4 |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-router-scheduler-8755cc8d4-jfz47 | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-router-scheduler-8755cc8d4 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-5bdb8cb8b8 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-jfz47 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-jfz47 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-router-scheduler-8755cc8d4-jfz47 |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-jfz47 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-jfz47 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-jfz47 |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-jfz47 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-jfz47 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-jfz47 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-jfz47 |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5bdb8cb8b8-fbpm6 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5bdb8cb8b8-fbpm6 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5bdb8cb8b8-fbpm6 |
Created |
Created container: main | |
| (x10) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-5c998f8fc6-rjndf |
Unhealthy |
Startup probe failed: Get "https://10.134.0.55:8000/health": dial tcp 10.134.0.55:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb | |
| (x2) | kserve-ci-e2e-test |
gateway_labeler_controller |
router-gateway-1 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway router-gateway-1 |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-dbdb7c5b6ddnr |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-dbdb7c5b6ddnr |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-5c998f8fc6-rjndf |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-58bf87d84-c8qcm |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-test-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-test-kserve-58bf87d84 |
SuccessfulCreate |
Created pod: router-with-refs-test-kserve-58bf87d84-c8qcm | |
kserve-ci-e2e-test |
multus |
router-with-refs-test-kserve-58bf87d84-c8qcm |
AddedInterface |
Add eth0 [10.134.0.57/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-58bf87d84-c8qcm |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-58bf87d84-c8qcm |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-test-kserve-router-scheduler-75c866f69d |
SuccessfulCreate |
Created pod: router-with-refs-test-kserve-router-scheduler-75c866f69d-2xq9x | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-test-epp-service | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set router-with-refs-test-kserve-router-scheduler-75c866f69d from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-test-kserve |
ScalingReplicaSet |
Scaled up replica set router-with-refs-test-kserve-58bf87d84 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Role kserve-ci-e2e-test/router-with-refs-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-test-epp-sa | |
kserve-ci-e2e-test |
multus |
router-with-refs-test-kserve-router-scheduler-75c866f69d-2xq9x |
AddedInterface |
Add eth0 [10.132.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-75c866f69d-2xq9x |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-75c866f69d-2xq9x |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-75c866f69d-2xq9x |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
| (x5) | kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-75c866f69d-2xq9x |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-75c866f69d-2xq9x |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-75c866f69d-2xq9x |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-75c866f69d-2xq9x |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-75c866f69d-2xq9x |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-75c866f69d-2xq9x |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-58bf87d84-c8qcm |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-58bf87d84-c8qcm |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-58bf87d84-c8qcm |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs | |
| (x9) | kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5bdb8cb8b8-fbpm6 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.56:8000/health": dial tcp 10.134.0.56:8000: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-jfz47 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-jfz47 |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5bdb8cb8b8-fbpm6 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-8755cc8d4-jfz47 |
Unhealthy |
Readiness probe failed: timeout: failed to connect service "10.133.0.29:9003" within 1s: context deadline exceeded | |
| (x9) | kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-58bf87d84-c8qcm |
Unhealthy |
Startup probe failed: Get "https://10.134.0.57:8000/health": dial tcp 10.134.0.57:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv8de1d74aab16d9cabd8b5aafeb5248e8-kserve-self-signed-certs | |
| (x9) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-788494645d from 0 to 1 | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-788494645dwrzt8 |
AddedInterface |
Add eth0 [10.134.0.58/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-788494645dwrzt8 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-788494645d |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-788494645dwrzt8 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-route | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-788494645dwrzt8 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-788494645dwrzt8 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-788494645dwrzt8 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-788494645dwrzt8 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-788494645dwrzt8 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-75c866f69d-2xq9x |
Killing |
Stopping container main | |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv8de1d74aab16d9cabd8b5aafeb5248e8-kserve-self-signed-certs |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-58bf87d84-c8qcm |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-75c866f69d-2xq9x |
Killing |
Stopping container tokenizer | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-route" not found |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-94f88d545 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-94f88d545-wwswl | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-workload-svc | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-7d447579b8 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-94f88d545 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv8f1a6f044e8c7a4d31a250e0c4861caf-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-rb | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-7d447579b8 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-7d7dgs6 | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherqwz7 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-7d7dgs6 |
Started |
Started container storage-initializer | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-shadow-svc |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-94f88d545-wwswl |
AddedInterface |
Add eth0 [10.134.0.59/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-7d7dgs6 |
AddedInterface |
Add eth0 [10.134.0.60/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherqwz7 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherqwz7 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-94f88d545-wwswl |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.7.1" | |
kserve-ci-e2e-test |
multus |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherqwz7 |
AddedInterface |
Add eth0 [10.132.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test4ce8108fb3d8aff064c322bee6e173f5-llmisvc-mode | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scheduler-b97987dc6 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scheduler-b97987dc6 |
SuccessfulCreate |
Created pod: llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherqwz7 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-7d7dgs6 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-7d7dgs6 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherqwz7 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-94f88d545-wwswl |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherqwz7 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherqwz7 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherqwz7 |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherqwz7 |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherqwz7 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-94f88d545-wwswl |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.7.1" in 923ms (923ms including waiting). Image size: 67767940 bytes. | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-94f88d545-wwswl |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-94f88d545-wwswl |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-94f88d545-wwswl |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-94f88d545-wwswl |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-7d7dgs6 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-7d7dgs6 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-7d7dgs6 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-94f88d545-wwswl |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-94f88d545-wwswl |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-94f88d545-wwswl |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv8f1a6f044e8c7a4d31a250e0c4861caf-kserve-self-signed-certs | |
| (x10) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-788494645dwrzt8 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.58:8000/health": dial tcp 10.134.0.58:8000: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-788494645dwrzt8 |
Killing |
Stopping container main | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-scc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testc9aefdf01a18c3acb55ce247710ebb71-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv4e643bc258191ffc517a31cd1d0ddd27-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-epp-rb | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheduler-6c9fbbbd48 |
SuccessfulCreate |
Created pod: llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schez9lx7 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheduler-6c9fbbbd48 from 0 to 1 | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn |
GroupsProgressing |
Created worker statefulset for leader pod llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn |
SuccessfulCreate |
create Pod llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 in StatefulSet llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn successful | |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn |
GroupsProgressing |
Replicas are progressing, with 0 groups ready of total 1 groups |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn |
GroupsProgressing |
Created leader statefulset llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn |
CreatingRevision |
Creating revision with key dc48886f4 for a newly created LeaderWorkerSet | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
SuccessfulCreate |
create Pod llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 in StatefulSet llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 successful | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schez9lx7 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
AddedInterface |
Add eth0 [10.134.0.61/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
AddedInterface |
Add eth0 [10.132.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schez9lx7 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schez9lx7 |
Started |
Started container storage-initializer | |
| (x8) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schez9lx7 |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schez9lx7 |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schez9lx7 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schez9lx7 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schez9lx7 |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schez9lx7 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schez9lx7 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Pulling |
Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv4e643bc258191ffc517a31cd1d0ddd27-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Pulled |
Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" in 47.366s (47.366s including waiting). Image size: 3458932386 bytes. | |
| (x15) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-7d7dgs6 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.60:8000/health": dial tcp 10.134.0.60:8000: connect: connection refused |
| (x15) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-94f88d545-wwswl |
Unhealthy |
Startup probe failed: Get "https://10.134.0.59:8001/health": dial tcp 10.134.0.59:8001: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-94f88d545-wwswl |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-94f88d545-wwswl |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-7d7dgs6 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherqwz7 |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherqwz7 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test4ce8108fb3d8aff064c322bee6e173f5-llmisvc-mode | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
custom-route-timeout-pd-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-pd-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-pd-test-kserve-route" not found |
| (x10) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.61:8000/health": dial tcp 10.134.0.61:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-6b6978488d |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-6b6978488d-7z2x6 | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-prefill-7584c7665 |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-prefill-7584c7665-gs4hw | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-prefill-7584c7665 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-router-scheduler-6d4859ddd7 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-6b6978488d from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Role kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-router-scheduler-6d4859ddd7 |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-router-scheduler-6d485k9sd4 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-epp-sa | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6d485k9sd4 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-7584c7665-gs4hw |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-6b6978488d-7z2x6 |
AddedInterface |
Add eth0 [10.132.0.39/23] from ovn-kubernetes | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-shadow-svc |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-prefill-7584c7665-gs4hw |
AddedInterface |
Add eth0 [10.132.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-7584c7665-gs4hw |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-7584c7665-gs4hw |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6d485k9sd4 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6d485k9sd4 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6b6978488d-7z2x6 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.7.1" | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-router-scheduler-6d485k9sd4 |
AddedInterface |
Add eth0 [10.133.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6b6978488d-7z2x6 |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6b6978488d-7z2x6 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.7.1" in 1.004s (1.004s including waiting). Image size: 67767940 bytes. | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6b6978488d-7z2x6 |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6d485k9sd4 |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6d485k9sd4 |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6d485k9sd4 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6d485k9sd4 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6d485k9sd4 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6d485k9sd4 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6b6978488d-7z2x6 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6b6978488d-7z2x6 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6b6978488d-7z2x6 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-7584c7665-gs4hw |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-7584c7665-gs4hw |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-7584c7665-gs4hw |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6b6978488d-7z2x6 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6b6978488d-7z2x6 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6b6978488d-7z2x6 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine | |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn |
AllGroupsReady |
All replicas are ready, with 1 groups ready of total 1 groups |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schez9lx7 |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testc9aefdf01a18c3acb55ce247710ebb71-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schez9lx7 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Killing |
Stopping container main | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-inline-config-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-inline-config-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-inline-config-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve | |
kserve-ci-e2e-test |
multus |
scheduler-inline-config-test-kserve-router-scheduler-5c87d8j5db |
AddedInterface |
Add eth0 [10.134.0.63/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-inline-config-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-inline-config-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-inline-config-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
multus |
scheduler-inline-config-test-kserve-67fd5c8857-rgq99 |
AddedInterface |
Add eth0 [10.134.0.62/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-67fd5c8857-rgq99 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-67fd5c8857-rgq99 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-67fd5c8857-rgq99 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-epp-service | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-inline-config-test-kserve-shadow-svc |
kserve-ci-e2e-test |
deployment-controller |
scheduler-inline-config-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-inline-config-test-kserve-router-scheduler-5c87d69765 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-inline-config-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-inline-config-test-kserve-67fd5c8857 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-5c87d8j5db |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-inline-config-test-kserve-67fd5c8857 |
SuccessfulCreate |
Created pod: scheduler-inline-config-test-kserve-67fd5c8857-rgq99 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-inline-config-test-kserve-router-scheduler-5c87d69765 |
SuccessfulCreate |
Created pod: scheduler-inline-config-test-kserve-router-scheduler-5c87d8j5db | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-5c87d8j5db |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-5c87d8j5db |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-5c87d8j5db |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-5c87d8j5db |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-5c87d8j5db |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-5c87d8j5db |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-5c87d8j5db |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-5c87d8j5db |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-67fd5c8857-rgq99 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-67fd5c8857-rgq99 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-67fd5c8857-rgq99 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.135s (1.135s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-67fd5c8857-rgq99 |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-5c87d8j5db |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-5c87d8j5db |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-67fd5c8857-rgq99 |
Killing |
Stopping container main | |
| (x13) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-7584c7665-gs4hw |
Unhealthy |
Startup probe failed: Get "https://10.132.0.40:8000/health": dial tcp 10.132.0.40:8000: connect: connection refused |
| (x14) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6b6978488d-7z2x6 |
Unhealthy |
Startup probe failed: Get "https://10.132.0.39:8001/health": dial tcp 10.132.0.39:8001: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-2-openshift-default-6866b85949 |
SuccessfulCreate |
Created pod: router-gateway-2-openshift-default-6866b85949-lmpz4 | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-2-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-2-openshift-default-6866b85949 from 0 to 1 | |
kserve-ci-e2e-test |
service-controller |
router-gateway-2-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
kserve-ci-e2e-test |
gateway_labeler_controller |
router-gateway-2 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway router-gateway-2 | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-6866b85949-lmpz4 |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6b6978488d-7z2x6 |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-7584c7665-gs4hw |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-6866b85949-lmpz4 |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-6866b85949-lmpz4 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:d518f3d1539f45e1253c5c9fa22062802804601d4998cd50344e476a3cc388fe" already present on machine | |
kserve-ci-e2e-test |
multus |
router-gateway-2-openshift-default-6866b85949-lmpz4 |
AddedInterface |
Add eth0 [10.134.0.64/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6d485k9sd4 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6d485k9sd4 |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6b6978488d-7z2x6 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6d485k9sd4 |
Unhealthy |
Readiness probe failed: timeout: failed to connect service "10.133.0.32:9003" within 1s: context deadline exceeded | |
kserve-ci-e2e-test |
service-controller |
router-gateway-2-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-54b886bf4d from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Role kserve-ci-e2e-test/router-with-refs-pd-test-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-epp-sa | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-54b886bf4d |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-54b886bf4d-vdz6d | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-pd-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-prefill-57c6dbf7f7 |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-prefill-57c6dbf7f7-6q7sf | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-prefill-57c6dbf7f7 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-pd-test-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-kserve | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-router-scheduler-76b559dddsfsrm |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-57c6dbf7f7-6q7sf |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-57c6dbf7f7-6q7sf |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-76b559dddsfsrm |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-router-scheduler-76b559ddd7 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-54b886bf4d-vdz6d |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-54b886bf4d-vdz6d |
Pulled |
Container image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-54b886bf4d-vdz6d |
AddedInterface |
Add eth0 [10.134.0.65/23] from ovn-kubernetes | |
| (x9) | kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-pd-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-76b559dddsfsrm |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-router-scheduler-76b559ddd7 |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-router-scheduler-76b559dddsfsrm | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-54b886bf4d-vdz6d |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-76b559dddsfsrm |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-prefill-57c6dbf7f7-6q7sf |
AddedInterface |
Add eth0 [10.134.0.66/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-57c6dbf7f7-6q7sf |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-54b886bf4d-vdz6d |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:a994fd91064f88b0a52b0b466ad083e0715e86891e056482a61038ab37cc2482" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-54b886bf4d-vdz6d |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-54b886bf4d-vdz6d |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-76b559dddsfsrm |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-76b559dddsfsrm |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-76b559dddsfsrm |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-76b559dddsfsrm |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-76b559dddsfsrm |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-76b559dddsfsrm |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-57c6dbf7f7-6q7sf |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-57c6dbf7f7-6q7sf |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-57c6dbf7f7-6q7sf |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-54b886bf4d-vdz6d |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-54b886bf4d-vdz6d |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-54b886bf4d-vdz6d |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.17.1" already present on machine | |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs |
| (x13) | kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-57c6dbf7f7-6q7sf |
Unhealthy |
Startup probe failed: Get "https://10.134.0.66:8000/health": dial tcp 10.134.0.66:8000: connect: connection refused |
| (x14) | kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-54b886bf4d-vdz6d |
Unhealthy |
Startup probe failed: Get "https://10.134.0.65:8001/health": dial tcp 10.134.0.65:8001: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-76b559dddsfsrm |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-54b886bf4d-vdz6d |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-54b886bf4d-vdz6d |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-76b559dddsfsrm |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-57c6dbf7f7-6q7sf |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-76b559dddsfsrm |
Unhealthy |
Readiness probe failed: timeout: failed to connect service "10.133.0.33:9003" within 1s: context deadline exceeded |