| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheqwhzc |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheqwhzc to ip-10-0-139-76.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6bpczs5 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6bpczs5 to ip-10-0-134-156.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-configmap-ref-test-kserve-router-scheduler-7f5455lfns |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-7f5455lfns to ip-10-0-134-156.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-66f45fb4cd-vl9fw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-66f45fb4cd-vl9fw to ip-10-0-134-156.ec2.internal | ||
kuadrant-system |
limitador-operator-controller-manager-774d94476f-pc9v2 |
Scheduled |
Successfully assigned kuadrant-system/limitador-operator-controller-manager-774d94476f-pc9v2 to ip-10-0-134-156.ec2.internal | ||
kuadrant-system |
limitador-limitador-85d9db4d5d-q7znc |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-85d9db4d5d-q7znc to ip-10-0-134-156.ec2.internal | ||
kserve-ci-e2e-test |
gw-section-name-router-with-gat-2f0a622e-kserve-8f74bff4c-24tm9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-8f74bff4c-24tm9 to ip-10-0-139-76.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-inline-config-test-kserve-router-scheduler-7cb79bw5sz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-7cb79bw5sz to ip-10-0-134-156.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-prefill-58df97877c-zm8tj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-58df97877c-zm8tj to ip-10-0-134-156.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-fb85fd64b-9bs98 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-fb85fd64b-9bs98 to ip-10-0-134-156.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-5697d48bb4-9dkjt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-5697d48bb4-9dkjt to ip-10-0-134-156.ec2.internal | ||
openshift-ingress |
istiod-openshift-gateway-5677ccb49b-r5ngl |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-5677ccb49b-r5ngl to ip-10-0-135-82.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-test-kserve-fcb85f744-42x5r |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-fcb85f744-42x5r to ip-10-0-134-156.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-2-openshift-default-7b76d7c4bf-4txdd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-7b76d7c4bf-4txdd to ip-10-0-134-156.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-5697d48bb4-zdsjd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-5697d48bb4-zdsjd to ip-10-0-134-156.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-579df5d64f-t9b75 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-579df5d64f-t9b75 to ip-10-0-139-76.ec2.internal | ||
kserve-ci-e2e-test |
gw-section-name-router-with-gat-f1d92d0f-kserve-6749bdbf6-tblrg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-6749bdbf6-tblrg to ip-10-0-139-76.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-router-scheduler-79b674bd2h5md |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-79b674bd2h5md to ip-10-0-134-156.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-prefill-965555885-9x9pp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-965555885-9x9pp to ip-10-0-134-156.ec2.internal | ||
openshift-ingress |
router-default-5df7c8cd4c-mgz6p |
Scheduled |
Successfully assigned openshift-ingress/router-default-5df7c8cd4c-mgz6p to ip-10-0-134-156.ec2.internal | ||
openshift-ingress |
router-default-5df7c8cd4c-mgz6p |
FailedScheduling |
0/3 nodes are available: 3 node(s) had untolerated taint(s). no new claims to deallocate, preemption: 0/3 nodes are available: 3 Preemption is not helpful for scheduling. | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-6fd74f44dd9zsjw |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-6fd74f44dd9zsjw to ip-10-0-139-76.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 to ip-10-0-139-76.ec2.internal | ||
kuadrant-system |
authorino-c548b5d7d-mqsxt |
Scheduled |
Successfully assigned kuadrant-system/authorino-c548b5d7d-mqsxt to ip-10-0-139-76.ec2.internal | ||
kuadrant-system |
authorino-b54df94b4-t6c5n |
Scheduled |
Successfully assigned kuadrant-system/authorino-b54df94b4-t6c5n to ip-10-0-139-76.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-7b66b5454d7vp4b |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-7b66b5454d7vp4b to ip-10-0-134-156.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-configmap-ref-test-kserve-96b574bdd-49nwj |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-96b574bdd-49nwj to ip-10-0-134-156.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5f62m8h |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5f62m8h to ip-10-0-134-156.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww to ip-10-0-139-76.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-test-kserve-router-scheduler-85d876656-57bx2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-85d876656-57bx2 to ip-10-0-139-76.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-test-kserve-68c8444c64-26gjz |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-68c8444c64-26gjz to ip-10-0-134-156.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-router-scheduler-6bd9fh69w4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-6bd9fh69w4 to ip-10-0-139-76.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-inline-config-test-kserve-5c479f4484-qzpz4 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-5c479f4484-qzpz4 to ip-10-0-134-156.ec2.internal | ||
kuadrant-system |
dns-operator-controller-manager-ccbdf686-fg6kl |
Scheduled |
Successfully assigned kuadrant-system/dns-operator-controller-manager-ccbdf686-fg6kl to ip-10-0-135-82.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-55bbc65c84-6qzjd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-55bbc65c84-6qzjd to ip-10-0-139-76.ec2.internal | ||
kuadrant-system |
authorino-operator-56fb6f6856-94qdj |
Scheduled |
Successfully assigned kuadrant-system/authorino-operator-56fb6f6856-94qdj to ip-10-0-134-156.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-router-scheduler-75576487bhnxvg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-75576487bhnxvg to ip-10-0-139-76.ec2.internal | ||
openshift-ingress |
openshift-ai-inference-openshift-default-5c7d4f8778-pfqgs |
Scheduled |
Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-5c7d4f8778-pfqgs to ip-10-0-139-76.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-9d6b6747-f45sn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-9d6b6747-f45sn to ip-10-0-134-156.ec2.internal | ||
kuadrant-system |
kuadrant-console-plugin-598f86468b-89xrd |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-console-plugin-598f86468b-89xrd to ip-10-0-139-76.ec2.internal | ||
kuadrant-system |
kuadrant-operator-controller-manager-66866f5fcc-v5xtf |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-66866f5fcc-v5xtf to ip-10-0-135-82.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-79b6995bcbrb97l |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-79b6995bcbrb97l to ip-10-0-134-156.ec2.internal | ||
kuadrant-system |
limitador-limitador-859c4d96d6-qwbgf |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-859c4d96d6-qwbgf to ip-10-0-135-82.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 to ip-10-0-134-156.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-66f68489b9-gd8b9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-66f68489b9-gd8b9 to ip-10-0-139-76.ec2.internal | ||
kuadrant-system |
authorino-867c7768fd-xj254 |
Scheduled |
Successfully assigned kuadrant-system/authorino-867c7768fd-xj254 to ip-10-0-139-76.ec2.internal | ||
openshift-ingress |
istiod-openshift-gateway-7b7995d5cd-hxqvm |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-7b7995d5cd-hxqvm to ip-10-0-134-156.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schecr696 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schecr696 to ip-10-0-139-76.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-schemm9kn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-schemm9kn to ip-10-0-139-76.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-router-scheduler-79bf4574b-r2629 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-79bf4574b-r2629 to ip-10-0-134-156.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-router-scheduler-79bf4574b-2ph88 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-79bf4574b-2ph88 to ip-10-0-139-76.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-test-kserve-router-scheduler-7477555ctkhml |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-7477555ctkhml to ip-10-0-139-76.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-66f68489b9-bq54t |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-66f68489b9-bq54t to ip-10-0-134-156.ec2.internal | ||
openshift-ingress |
deployment-controller |
router-default |
ScalingReplicaSet |
Scaled up replica set router-default-5df7c8cd4c from 0 to 1 | |
| (x13) | openshift-ingress |
replicaset-controller |
router-default-5df7c8cd4c |
FailedCreate |
Error creating: pods "router-default-5df7c8cd4c-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
openshift-ingress |
service-controller |
router-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
service-controller |
router-default |
UnAvailableLoadBalancer |
There are no available nodes for LoadBalancer | |
openshift-ingress |
service-controller |
router-default |
EnsuredLoadBalancer |
Ensured load balancer | |
| (x16) | openshift-ingress |
replicaset-controller |
router-default-5df7c8cd4c |
FailedCreate |
Error creating: pods "router-default-5df7c8cd4c-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
| (x3) | openshift-ingress |
service-controller |
router-default |
UpdatedLoadBalancer |
Updated load balancer with new hosts |
openshift-ingress |
replicaset-controller |
router-default-5df7c8cd4c |
SuccessfulCreate |
Created pod: router-default-5df7c8cd4c-mgz6p | |
| (x6) | openshift-ingress |
kubelet |
router-default-5df7c8cd4c-mgz6p |
FailedMount |
MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt |
| (x6) | openshift-ingress |
kubelet |
router-default-5df7c8cd4c-mgz6p |
FailedMount |
MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found |
openshift-ingress |
multus |
router-default-5df7c8cd4c-mgz6p |
AddedInterface |
Add eth0 [10.132.0.16/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
router-default-5df7c8cd4c-mgz6p |
Pulled |
Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:924ddd9185690e32284b189b3d0c7f005f10029b713c963227fee4da98829559" already present on machine | |
openshift-ingress |
kubelet |
router-default-5df7c8cd4c-mgz6p |
Created |
Created container: router | |
openshift-ingress |
kubelet |
router-default-5df7c8cd4c-mgz6p |
Started |
Started container router | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-7b7995d5cd from 0 to 1 | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-7b7995d5cd |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-7b7995d5cd-hxqvm | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7b7995d5cd-hxqvm |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" | |
openshift-ingress |
multus |
istiod-openshift-gateway-7b7995d5cd-hxqvm |
AddedInterface |
Add eth0 [10.132.0.32/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7b7995d5cd-hxqvm |
Started |
Started container discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7b7995d5cd-hxqvm |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 2.961s (2.961s including waiting). Image size: 181126104 bytes. | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7b7995d5cd-hxqvm |
Created |
Created container: discovery | |
openshift-ingress |
multus |
openshift-ai-inference-openshift-default-5c7d4f8778-pfqgs |
AddedInterface |
Add eth0 [10.133.0.16/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
openshift-ai-inference-openshift-default |
ScalingReplicaSet |
Scaled up replica set openshift-ai-inference-openshift-default-5c7d4f8778 from 0 to 1 | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-5c7d4f8778-pfqgs |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" | |
openshift-ingress |
replicaset-controller |
openshift-ai-inference-openshift-default-5c7d4f8778 |
SuccessfulCreate |
Created pod: openshift-ai-inference-openshift-default-5c7d4f8778-pfqgs | |
openshift-ingress |
gateway_labeler_controller |
openshift-ai-inference |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway openshift-ai-inference | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-5c7d4f8778-pfqgs |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 2.861s (2.861s including waiting). Image size: 181318953 bytes. | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.2 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.2 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
replicaset-controller |
authorino-operator-56fb6f6856 |
SuccessfulCreate |
Created pod: authorino-operator-56fb6f6856-94qdj | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.2 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
kubelet |
authorino-operator-56fb6f6856-94qdj |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:414262da59a55c48837807274db11cedb7da50b5984d03d3bd0445e4f7b1a0ea" | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.1 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.1 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.2 |
InstallWaiting |
installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability. | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.2 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
deployment-controller |
authorino-operator |
ScalingReplicaSet |
Scaled up replica set authorino-operator-56fb6f6856 from 0 to 1 | |
kuadrant-system |
multus |
authorino-operator-56fb6f6856-94qdj |
AddedInterface |
Add eth0 [10.132.0.37/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.1 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.1 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
deployment-controller |
dns-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set dns-operator-controller-manager-ccbdf686 from 0 to 1 | |
kuadrant-system |
replicaset-controller |
dns-operator-controller-manager-ccbdf686 |
SuccessfulCreate |
Created pod: dns-operator-controller-manager-ccbdf686-fg6kl | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.1 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
multus |
dns-operator-controller-manager-ccbdf686-fg6kl |
AddedInterface |
Add eth0 [10.134.0.27/23] from ovn-kubernetes | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.1 |
InstallWaiting |
installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.1 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-ccbdf686-fg6kl |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ca946bb88274562b8027c90d7b6945a426ec799b1b0017056f6189160c591c2d" | |
kuadrant-system |
kubelet |
authorino-operator-56fb6f6856-94qdj |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
authorino-operator-56fb6f6856-94qdj |
Started |
Started container manager | |
kuadrant-system |
kubelet |
authorino-operator-56fb6f6856-94qdj |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:414262da59a55c48837807274db11cedb7da50b5984d03d3bd0445e4f7b1a0ea" in 2.83s (2.83s including waiting). Image size: 168622690 bytes. | |
kuadrant-system |
authorino-operator-56fb6f6856-94qdj_5649b8c4-3fab-4b09-958f-99e839149357 |
aac3a15d.authorino.kuadrant.io |
LeaderElection |
authorino-operator-56fb6f6856-94qdj_5649b8c4-3fab-4b09-958f-99e839149357 became leader | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.1 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.1 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
replicaset-controller |
limitador-operator-controller-manager-774d94476f |
SuccessfulCreate |
Created pod: limitador-operator-controller-manager-774d94476f-pc9v2 | |
kuadrant-system |
deployment-controller |
limitador-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set limitador-operator-controller-manager-774d94476f from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.1 |
InstallWaiting |
installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-ccbdf686-fg6kl |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:ca946bb88274562b8027c90d7b6945a426ec799b1b0017056f6189160c591c2d" in 2.958s (2.958s including waiting). Image size: 190515353 bytes. | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.2 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.2 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
multus |
limitador-operator-controller-manager-774d94476f-pc9v2 |
AddedInterface |
Add eth0 [10.132.0.38/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-774d94476f-pc9v2 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:5261170dafd0c9b5a89d3509ada864624e4aaf62a7763bf595980de5b450cc04" | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-ccbdf686-fg6kl |
Started |
Started container manager | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-ccbdf686-fg6kl |
Created |
Created container: manager | |
kuadrant-system |
dns-operator-controller-manager-ccbdf686-fg6kl_aa6ea5ef-853d-4c6f-9d09-057e8e26b815 |
a3f98d6c.kuadrant.io |
LeaderElection |
dns-operator-controller-manager-ccbdf686-fg6kl_aa6ea5ef-853d-4c6f-9d09-057e8e26b815 became leader | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-774d94476f-pc9v2 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:5261170dafd0c9b5a89d3509ada864624e4aaf62a7763bf595980de5b450cc04" in 1.55s (1.55s including waiting). Image size: 178551314 bytes. | |
kuadrant-system |
limitador-operator-controller-manager-774d94476f-pc9v2_f4aed9cd-c4c6-41e3-afe2-fdfae68b053a |
3745a16e.kuadrant.io |
LeaderElection |
limitador-operator-controller-manager-774d94476f-pc9v2_f4aed9cd-c4c6-41e3-afe2-fdfae68b053a became leader | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-774d94476f-pc9v2 |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-774d94476f-pc9v2 |
Started |
Started container manager | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.2 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.2 |
InstallWaiting |
installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.2 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
deployment-controller |
kuadrant-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set kuadrant-operator-controller-manager-66866f5fcc from 0 to 1 | |
kuadrant-system |
multus |
kuadrant-operator-controller-manager-66866f5fcc-v5xtf |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-66866f5fcc-v5xtf |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:8c2d9a84169e86454e4fb3df6f4846c5c5495d19b01137b6e78e113161981e47" | |
kuadrant-system |
replicaset-controller |
kuadrant-operator-controller-manager-66866f5fcc |
SuccessfulCreate |
Created pod: kuadrant-operator-controller-manager-66866f5fcc-v5xtf | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-66866f5fcc-v5xtf |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-66866f5fcc-v5xtf |
Started |
Started container manager | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-66866f5fcc-v5xtf |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:8c2d9a84169e86454e4fb3df6f4846c5c5495d19b01137b6e78e113161981e47" in 4.205s (4.205s including waiting). Image size: 425442547 bytes. | |
kuadrant-system |
kuadrant-operator-controller-manager-66866f5fcc-v5xtf_8fd9bc4b-9aaf-4d19-961d-8f46fb9890da |
f139389e.kuadrant.io |
LeaderElection |
kuadrant-operator-controller-manager-66866f5fcc-v5xtf_8fd9bc4b-9aaf-4d19-961d-8f46fb9890da became leader | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.4.2 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
deployment-controller |
kuadrant-console-plugin |
ScalingReplicaSet |
Scaled up replica set kuadrant-console-plugin-598f86468b from 0 to 1 | |
kuadrant-system |
multus |
kuadrant-console-plugin-598f86468b-89xrd |
AddedInterface |
Add eth0 [10.133.0.18/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-598f86468b-89xrd |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:1162c282e762d89acccbfb5ce9fad561fd3f807bd1929db154af3135ccc87f34" | |
kuadrant-system |
replicaset-controller |
kuadrant-console-plugin-598f86468b |
SuccessfulCreate |
Created pod: kuadrant-console-plugin-598f86468b-89xrd | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.4.1 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.4.1 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-598f86468b-89xrd |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:1162c282e762d89acccbfb5ce9fad561fd3f807bd1929db154af3135ccc87f34" in 4.6s (4.6s including waiting). Image size: 342512747 bytes. | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-598f86468b-89xrd |
Started |
Started container kuadrant-console-plugin | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-598f86468b-89xrd |
Created |
Created container: kuadrant-console-plugin | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.4.2 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-859c4d96d6 from 0 to 1 | |
kuadrant-system |
replicaset-controller |
limitador-limitador-859c4d96d6 |
SuccessfulCreate |
Created pod: limitador-limitador-859c4d96d6-qwbgf | |
kuadrant-system |
replicaset-controller |
limitador-limitador-85d9db4d5d |
SuccessfulCreate |
Created pod: limitador-limitador-85d9db4d5d-q7znc | |
kuadrant-system |
kubelet |
limitador-limitador-859c4d96d6-qwbgf |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:a233ab32e26cf2ea46c31dfc4fcaf89ce541a9351bba99182036a91f357cc2b4" | |
kuadrant-system |
multus |
limitador-limitador-859c4d96d6-qwbgf |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
limitador-limitador-85d9db4d5d-q7znc |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:a233ab32e26cf2ea46c31dfc4fcaf89ce541a9351bba99182036a91f357cc2b4" | |
kuadrant-system |
replicaset-controller |
authorino-c548b5d7d |
SuccessfulCreate |
Created pod: authorino-c548b5d7d-mqsxt | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-b54df94b4 from 0 to 1 | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-85d9db4d5d from 0 to 1 | |
kuadrant-system |
replicaset-controller |
authorino-b54df94b4 |
SuccessfulCreate |
Created pod: authorino-b54df94b4-t6c5n | |
kuadrant-system |
multus |
limitador-limitador-85d9db4d5d-q7znc |
AddedInterface |
Add eth0 [10.132.0.39/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-c548b5d7d from 0 to 1 | |
kuadrant-system |
kubelet |
authorino-c548b5d7d-mqsxt |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fbe9e2e767530eae72a421f541325640feba03322441cd7a294f8a6bf1fb4d97" | |
kuadrant-system |
multus |
authorino-c548b5d7d-mqsxt |
AddedInterface |
Add eth0 [10.133.0.20/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-b54df94b4-t6c5n |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fbe9e2e767530eae72a421f541325640feba03322441cd7a294f8a6bf1fb4d97" | |
kuadrant-system |
kubelet |
limitador-limitador-859c4d96d6-qwbgf |
Started |
Started container limitador | |
kuadrant-system |
kubelet |
limitador-limitador-859c4d96d6-qwbgf |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:a233ab32e26cf2ea46c31dfc4fcaf89ce541a9351bba99182036a91f357cc2b4" in 1.21s (1.21s including waiting). Image size: 139554524 bytes. | |
kuadrant-system |
multus |
authorino-b54df94b4-t6c5n |
AddedInterface |
Add eth0 [10.133.0.19/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
limitador-limitador-859c4d96d6-qwbgf |
Created |
Created container: limitador | |
kuadrant-system |
kubelet |
limitador-limitador-85d9db4d5d-q7znc |
Started |
Started container limitador | |
kuadrant-system |
kubelet |
limitador-limitador-85d9db4d5d-q7znc |
Created |
Created container: limitador | |
kuadrant-system |
kubelet |
limitador-limitador-85d9db4d5d-q7znc |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:a233ab32e26cf2ea46c31dfc4fcaf89ce541a9351bba99182036a91f357cc2b4" in 1.436s (1.436s including waiting). Image size: 139554524 bytes. | |
kuadrant-system |
kubelet |
authorino-c548b5d7d-mqsxt |
Started |
Started container authorino | |
kuadrant-system |
replicaset-controller |
authorino-b54df94b4 |
SuccessfulDelete |
Deleted pod: authorino-b54df94b4-t6c5n | |
kuadrant-system |
kubelet |
authorino-c548b5d7d-mqsxt |
Created |
Created container: authorino | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-b54df94b4 from 1 to 0 | |
kuadrant-system |
kubelet |
authorino-c548b5d7d-mqsxt |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fbe9e2e767530eae72a421f541325640feba03322441cd7a294f8a6bf1fb4d97" in 2.847s (2.847s including waiting). Image size: 202723116 bytes. | |
kuadrant-system |
kubelet |
authorino-b54df94b4-t6c5n |
Started |
Started container authorino | |
kuadrant-system |
kubelet |
authorino-b54df94b4-t6c5n |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-b54df94b4-t6c5n |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fbe9e2e767530eae72a421f541325640feba03322441cd7a294f8a6bf1fb4d97" in 2.946s (2.946s including waiting). Image size: 202723116 bytes. | |
kuadrant-system |
kubelet |
authorino-b54df94b4-t6c5n |
Killing |
Stopping container authorino | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled down replica set limitador-limitador-859c4d96d6 from 1 to 0 | |
kuadrant-system |
replicaset-controller |
limitador-limitador-859c4d96d6 |
SuccessfulDelete |
Deleted pod: limitador-limitador-859c4d96d6-qwbgf | |
kuadrant-system |
kubelet |
limitador-limitador-859c4d96d6-qwbgf |
Killing |
Stopping container limitador | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-867c7768fd from 0 to 1 | |
kuadrant-system |
kubelet |
authorino-867c7768fd-xj254 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fbe9e2e767530eae72a421f541325640feba03322441cd7a294f8a6bf1fb4d97" | |
kuadrant-system |
replicaset-controller |
authorino-867c7768fd |
SuccessfulCreate |
Created pod: authorino-867c7768fd-xj254 | |
kuadrant-system |
multus |
authorino-867c7768fd-xj254 |
AddedInterface |
Add eth0 [10.133.0.21/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-867c7768fd-xj254 |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-867c7768fd-xj254 |
Started |
Started container authorino | |
kuadrant-system |
kubelet |
authorino-867c7768fd-xj254 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:fbe9e2e767530eae72a421f541325640feba03322441cd7a294f8a6bf1fb4d97" in 868ms (868ms including waiting). Image size: 202723116 bytes. | |
kuadrant-system |
kubelet |
authorino-c548b5d7d-mqsxt |
Killing |
Stopping container authorino | |
kuadrant-system |
replicaset-controller |
authorino-c548b5d7d |
SuccessfulDelete |
Deleted pod: authorino-c548b5d7d-mqsxt | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-c548b5d7d from 1 to 0 | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-5677ccb49b-r5ngl |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" | |
openshift-ingress |
multus |
istiod-openshift-gateway-5677ccb49b-r5ngl |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-5677ccb49b from 0 to 1 | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-5677ccb49b |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-5677ccb49b-r5ngl | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-5677ccb49b-r5ngl |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:2a25d47b4bb3bf346563a0ccea986c0ab0466709ca4cb9d2666ba6a02a8a5f31" in 3.368s (3.368s including waiting). Image size: 181126104 bytes. | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-5677ccb49b-r5ngl |
Started |
Started container discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-5677ccb49b-r5ngl |
Created |
Created container: discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7b7995d5cd-hxqvm |
Killing |
Stopping container discovery | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled down replica set istiod-openshift-gateway-7b7995d5cd from 1 to 0 | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-7b7995d5cd |
SuccessfulDelete |
Deleted pod: istiod-openshift-gateway-7b7995d5cd-hxqvm | |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x3) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-579df5d64f |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-579df5d64f-t9b75 | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-1-openshift-default-579df5d64f from 0 to 1 | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-579df5d64f-t9b75 |
AddedInterface |
Add eth0 [10.133.0.22/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-inline-config-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-inline-config-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-inline-config-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-inline-config-test-kserve-5c479f4484 |
SuccessfulCreate |
Created pod: scheduler-inline-config-test-kserve-5c479f4484-qzpz4 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-inline-config-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-inline-config-test-kserve-5c479f4484 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-epp-service | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-inline-config-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-inline-config-test-kserve-router-scheduler-7cb798894c from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-inline-config-test-epp-role | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-7cb79bw5sz |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
multus |
scheduler-inline-config-test-kserve-5c479f4484-qzpz4 |
AddedInterface |
Add eth0 [10.132.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-5c479f4484-qzpz4 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" | |
kserve-ci-e2e-test |
multus |
scheduler-inline-config-test-kserve-router-scheduler-7cb79bw5sz |
AddedInterface |
Add eth0 [10.132.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-inline-config-test-kserve-router-scheduler-7cb798894c |
SuccessfulCreate |
Created pod: scheduler-inline-config-test-kserve-router-scheduler-7cb79bw5sz | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-inline-config-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-inline-config-test-epp-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-5c479f4484-qzpz4 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-7cb79bw5sz |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-7cb79bw5sz |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" in 4.099s (4.099s including waiting). Image size: 301469644 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-5c479f4484-qzpz4 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-5c479f4484-qzpz4 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" in 4.588s (4.588s including waiting). Image size: 301469644 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-7cb79bw5sz |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-7cb79bw5sz |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-7cb79bw5sz |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-7cb79bw5sz |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-7cb79bw5sz |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-7cb79bw5sz |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" in 946ms (946ms including waiting). Image size: 87241021 bytes. | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-5c7d4f8778-pfqgs |
ProbeError |
Readiness probe error: Get "http://10.133.0.16:15021/healthz/ready": dial tcp 10.133.0.16:15021: connect: connection refused body: | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-5c7d4f8778-pfqgs |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.16:15021/healthz/ready": dial tcp 10.133.0.16:15021: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-5c479f4484-qzpz4 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
| (x2) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-5c7d4f8778-pfqgs |
Started |
Started container istio-proxy |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-5c7d4f8778-pfqgs |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine | |
| (x2) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-5c7d4f8778-pfqgs |
Created |
Created container: istio-proxy |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-5c479f4484-qzpz4 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-5c479f4484-qzpz4 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.263s (1.263s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-5c479f4484-qzpz4 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
gw-section-name-router-with-gat-2f0a622e-kserve-8f74bff4c |
SuccessfulCreate |
Created pod: gw-section-name-router-with-gat-2f0a622e-kserve-8f74bff4c-24tm9 | |
kserve-ci-e2e-test |
deployment-controller |
gw-section-name-router-with-gat-2f0a622e-kserve |
ScalingReplicaSet |
Scaled up replica set gw-section-name-router-with-gat-2f0a622e-kserve-8f74bff4c from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.Secret kserve-ci-e2e-test/gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve | |
kserve-ci-e2e-test |
multus |
gw-section-name-router-with-gat-2f0a622e-kserve-8f74bff4c-24tm9 |
AddedInterface |
Add eth0 [10.133.0.23/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-8f74bff4c-24tm9 |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" | |
| (x5) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-5c7d4f8778-pfqgs |
ProbeError |
Startup probe error: Get "http://10.133.0.16:15021/healthz/ready": dial tcp 10.133.0.16:15021: connect: connection refused body: |
| (x5) | openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-5c7d4f8778-pfqgs |
Unhealthy |
Startup probe failed: Get "http://10.133.0.16:15021/healthz/ready": dial tcp 10.133.0.16:15021: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-8f74bff4c-24tm9 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-8f74bff4c-24tm9 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-8f74bff4c-24tm9 |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" in 4.601s (4.601s including waiting). Image size: 301469644 bytes. | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-inline-config-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-8f74bff4c-24tm9 |
Killing |
Stopping container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-7cb79bw5sz |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-7cb79bw5sz |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" in 30.697s (30.697s including waiting). Image size: 2907020949 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-7cb79bw5sz |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-6749bdbf6-tblrg |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
gw-section-name-router-with-gat-f1d92d0f-kserve |
ScalingReplicaSet |
Scaled up replica set gw-section-name-router-with-gat-f1d92d0f-kserve-6749bdbf6 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
gw-section-name-router-with-gat-f1d92d0f-kserve-6749bdbf6-tblrg |
AddedInterface |
Add eth0 [10.133.0.24/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
gw-section-name-router-with-gat-f1d92d0f-kserve-6749bdbf6 |
SuccessfulCreate |
Created pod: gw-section-name-router-with-gat-f1d92d0f-kserve-6749bdbf6-tblrg | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.Secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-6749bdbf6-tblrg |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-6749bdbf6-tblrg |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-6749bdbf6-tblrg |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Updated |
Updated v1.Secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-6749bdbf6-tblrg |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.153s (1.153s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-6749bdbf6-tblrg |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-6749bdbf6-tblrg |
Created |
Created container: main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-579df5d64f-t9b75 |
BackOff |
Back-off restarting failed container istio-proxy in pod router-gateway-1-openshift-default-579df5d64f-t9b75_kserve-ci-e2e-test(581f680c-a2a0-4443-b3ca-4834dfaa9c17) |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvad71fa5348b85aebd404221bba611457-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-6fd74f44dd from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-6fd74f44dd9zsjw |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-route | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-6fd74f44dd9zsjw |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-6fd74f44dd9zsjw |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-6fd74f44dd9zsjw |
AddedInterface |
Add eth0 [10.133.0.25/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-6fd74f44dd |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-6fd74f44dd9zsjw | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-6749bdbf6-tblrg |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-6fd74f44dd9zsjw |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-6fd74f44dd9zsjw |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-6fd74f44dd9zsjw |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvad71fa5348b85aebd404221bba611457-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb | |
| (x3) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-579df5d64f-t9b75 |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" already present on machine |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-7cb79bw5sz |
Killing |
Stopping container tokenizer | |
| (x3) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-579df5d64f-t9b75 |
Created |
Created container: istio-proxy |
| (x3) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-579df5d64f-t9b75 |
Started |
Started container istio-proxy |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-7cb79bw5sz |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-5c479f4484-qzpz4 |
Killing |
Stopping container main | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-configmap-ref-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-configmap-ref-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-configmap-ref-test-kserve-route" not found |
| (x5) | kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-579df5d64f-t9b75 |
Unhealthy |
Startup probe failed: Get "http://10.133.0.22:15021/healthz/ready": dial tcp 10.133.0.22:15021: connect: connection refused |
kserve-ci-e2e-test |
deployment-controller |
scheduler-configmap-ref-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-configmap-ref-test-kserve-96b574bdd from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-configmap-ref-test-kserve-96b574bdd |
SuccessfulCreate |
Created pod: scheduler-configmap-ref-test-kserve-96b574bdd-49nwj | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-7f5455lfns |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
multus |
scheduler-configmap-ref-test-kserve-96b574bdd-49nwj |
AddedInterface |
Add eth0 [10.132.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-96b574bdd-49nwj |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-96b574bdd-49nwj |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-96b574bdd-49nwj |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
scheduler-configmap-ref-test-kserve-router-scheduler-7f5455lfns |
AddedInterface |
Add eth0 [10.132.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-7f5455lfns |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-7f5455lfns |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-configmap-ref-test-kserve-router-scheduler-7f54577db5 |
SuccessfulCreate |
Created pod: scheduler-configmap-ref-test-kserve-router-scheduler-7f5455lfns | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-configmap-ref-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-configmap-ref-test-kserve-router-scheduler-7f54577db5 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-7f5455lfns |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-7f5455lfns |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-7f5455lfns |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-7f5455lfns |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-7f5455lfns |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-7f5455lfns |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-96b574bdd-49nwj |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-96b574bdd-49nwj |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-96b574bdd-49nwj |
Started |
Started container main | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-ha-replicas-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-ha-replicas-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-ha-replicas-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-service | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fc75 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5f62m8h | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fc75 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-ha-replicas-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fc75 from 0 to 2 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-55bbc65c84 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-55bbc65c84-6qzjd | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-ha-replicas-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-ha-replicas-test-kserve-55bbc65c84 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-55bbc65c84-6qzjd |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-55bbc65c84-6qzjd |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-55bbc65c84-6qzjd |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-role | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-55bbc65c84-6qzjd |
AddedInterface |
Add eth0 [10.133.0.26/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5f62m8h |
AddedInterface |
Add eth0 [10.132.0.51/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww |
AddedInterface |
Add eth0 [10.133.0.27/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5f62m8h |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5f62m8h |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5f62m8h |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-7f5455lfns |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-96b574bdd-49nwj |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5f62m8h |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5f62m8h |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-7f5455lfns |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5f62m8h |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5f62m8h |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5f62m8h |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5f62m8h |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" in 1.036s (1.036s including waiting). Image size: 87241021 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-55bbc65c84-6qzjd |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-55bbc65c84-6qzjd |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-55bbc65c84-6qzjd |
Started |
Started container main | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" in 28.789s (28.789s including waiting). Image size: 2907020949 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5f62m8h |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5f62m8h |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww |
FailedToRetrieveImagePullSecret |
Unable to retrieve some image pull secrets (scheduler-ha-replicas-test-epp-sa-dockercfg-wxllg); attempting to pull the image may not succeed. | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-55bbc65c84-6qzjd |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww |
Killing |
Stopping container main | |
| (x2) | kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/precise-prefix-cache-test-epp-rb | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-66f68489b9-gd8b9 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
precise-prefix-cache-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy precise-prefix-cache-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "precise-prefix-cache-test-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
precise-prefix-cache-test-kserve |
ScalingReplicaSet |
Scaled up replica set precise-prefix-cache-test-kserve-66f68489b9 from 0 to 2 | |
kserve-ci-e2e-test |
deployment-controller |
precise-prefix-cache-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set precise-prefix-cache-test-kserve-router-scheduler-79b674bd6f from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-router-scheduler-79b674bd6f |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-router-scheduler-79b674bd2h5md | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/precise-prefix-cache-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Role kserve-ci-e2e-test/precise-prefix-cache-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-66f68489b9-bq54t |
AddedInterface |
Add eth0 [10.132.0.52/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-66f68489b9-bq54t |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-66f68489b9-bq54t |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-66f68489b9 |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-66f68489b9-gd8b9 | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-66f68489b9 |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-66f68489b9-bq54t | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-66f68489b9-bq54t |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-66f68489b9-gd8b9 |
AddedInterface |
Add eth0 [10.133.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-79b674bd2h5md |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-router-scheduler-79b674bd2h5md |
AddedInterface |
Add eth0 [10.132.0.53/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-66f68489b9-gd8b9 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-66f68489b9-gd8b9 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-79b674bd2h5md |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-79b674bd2h5md |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-79b674bd2h5md |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-79b674bd2h5md |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-79b674bd2h5md |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-79b674bd2h5md |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-79b674bd2h5md |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-79b674bd2h5md |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-66f68489b9-bq54t |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-66f68489b9-gd8b9 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-66f68489b9-bq54t |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-66f68489b9-bq54t |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-66f68489b9-gd8b9 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-66f68489b9-gd8b9 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/precise-prefix-cache-test-kserve-shadow-svc |
| (x6) | kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww |
FailedMount |
MountVolume.SetUp failed for volume "tls-certs" : secret "scheduler-ha-replicas-test-kserve-self-signed-certs" not found |
| (x2) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-79b674bd2h5md |
Unhealthy |
Liveness probe failed: timeout: failed to connect service "10.132.0.53:9003" within 1s: context deadline exceeded |
| (x3) | kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-74c9c5fvnkww |
Unhealthy |
Readiness probe failed: timeout: failed to connect service "10.133.0.27:9003" within 1s: context deadline exceeded |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-79b674bd2h5md |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-79b674bd2h5md |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-66f68489b9-gd8b9 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-66f68489b9-bq54t |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-criticality |
Error |
Reconciliation failed: failed to combine base-configurations: failed to get LLMInferenceServiceConfig "conv-test-criticality-config" from namespaces ["kserve-ci-e2e-test", "kserve"]: LLMInferenceServiceConfig.serving.kserve.io "conv-test-criticality-config" not found | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-round-trip |
Error |
Reconciliation failed: failed to combine base-configurations: failed to get LLMInferenceServiceConfig "conv-test-round-trip-config" from namespaces ["kserve-ci-e2e-test", "kserve"]: LLMInferenceServiceConfig.serving.kserve.io "conv-test-round-trip-config" not found | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-lora-crit |
Error |
Reconciliation failed: failed to combine base-configurations: failed to get LLMInferenceServiceConfig "conv-test-lora-crit-config" from namespaces ["kserve-ci-e2e-test", "kserve"]: LLMInferenceServiceConfig.serving.kserve.io "conv-test-lora-crit-config" not found | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-router-scheduler-79bf4574b-r2629 |
AddedInterface |
Add eth0 [10.132.0.55/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-router-scheduler-79bf4574b |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-router-scheduler-79bf4574b-r2629 | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-5697d48bb4 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-r2629 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5697d48bb4-zdsjd |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/stop-feature-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Role kserve-ci-e2e-test/stop-feature-test-epp-role | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-5697d48bb4-zdsjd |
AddedInterface |
Add eth0 [10.132.0.54/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-stop-feature-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5697d48bb4-zdsjd |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-r2629 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-r2629 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-router-scheduler-79bf4574b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5697d48bb4-zdsjd |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-5697d48bb4 |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-5697d48bb4-zdsjd | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-r2629 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-r2629 |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-r2629 |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-r2629 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-r2629 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-r2629 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5697d48bb4-zdsjd |
Pulling |
Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-r2629 |
Unhealthy |
Startup probe failed: Get "http://10.132.0.55:8082/healthz": dial tcp 10.132.0.55:8082: connect: connection refused | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/stop-feature-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5697d48bb4-zdsjd |
Pulled |
Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" in 51.559s (51.559s including waiting). Image size: 3531177328 bytes. | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5697d48bb4-zdsjd |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5697d48bb4-zdsjd |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-6fd74f44dd9zsjw |
Killing |
Stopping container main | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheduler-5bb9496bd8 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-7b66b5454d from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-teste2c0c7deeb42f8b9846a7a45d2caecd2-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheduler-5bb9496bd8 |
SuccessfulCreate |
Created pod: llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheqwhzc | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-7b66b5454d7vp4b |
AddedInterface |
Add eth0 [10.132.0.56/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-7b66b5454d7vp4b |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-7b66b5454d7vp4b |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-7b66b5454d7vp4b |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvdde380eaa9fe1facad32d45131f9e34d-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-7b66b5454d |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-7b66b5454d7vp4b | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheqwhzc |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheqwhzc |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheqwhzc |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheqwhzc |
AddedInterface |
Add eth0 [10.133.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheqwhzc |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheqwhzc |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheqwhzc |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheqwhzc |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheqwhzc |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheqwhzc |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-7b66b5454d7vp4b |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-7b66b5454d7vp4b |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-7b66b5454d7vp4b |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvdde380eaa9fe1facad32d45131f9e34d-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-route | |
| (x10) | kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5697d48bb4-zdsjd |
Unhealthy |
Startup probe failed: Get "https://10.132.0.54:8000/health": dial tcp 10.132.0.54:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5697d48bb4-zdsjd |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Error |
Reconciliation failed: failed to reconcile networking: failed to reconcile scheduler: failed to build expected scheduler deployment: failed to attach model artifacts to scheduler deployment: secrets "stop-feature-test-epp-sa-dockercfg-fq8k8" not found | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.InferencePool kserve-ci-e2e-test/stop-feature-test-inference-pool | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1alpha2.InferencePool kserve-ci-e2e-test/stop-feature-test-inference-pool | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-r2629 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-r2629 |
Killing |
Stopping container tokenizer | |
| (x23) | kserve-ci-e2e-test |
OpenDataHubModelController |
stop-feature-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy stop-feature-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "stop-feature-test-kserve-route" not found |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-router-scheduler-79bf4574b |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-router-scheduler-79bf4574b-2ph88 | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-5697d48bb4 |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-5697d48bb4-9dkjt | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-5697d48bb4 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-router-scheduler-79bf4574b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-2ph88 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5697d48bb4-9dkjt |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-2ph88 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-router-scheduler-79bf4574b-2ph88 |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-2ph88 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-5697d48bb4-9dkjt |
AddedInterface |
Add eth0 [10.132.0.57/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5697d48bb4-9dkjt |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5697d48bb4-9dkjt |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-2ph88 |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-2ph88 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-2ph88 |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-2ph88 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-2ph88 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-2ph88 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5697d48bb4-9dkjt |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5697d48bb4-9dkjt |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5697d48bb4-9dkjt |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
| (x10) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-7b66b5454d7vp4b |
Unhealthy |
Startup probe failed: Get "https://10.132.0.56:8000/health": dial tcp 10.132.0.56:8000: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-7b66b5454d7vp4b |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-teste2c0c7deeb42f8b9846a7a45d2caecd2-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheqwhzc |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheqwhzc |
Killing |
Stopping container main | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
custom-route-timeout-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Role kserve-ci-e2e-test/custom-route-timeout-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-test-epp-rb | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-test-kserve-router-scheduler-7477555cf6 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-test-kserve |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-test-kserve-fcb85f744 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-test-kserve-router-scheduler-7477555cf6 |
SuccessfulCreate |
Created pod: custom-route-timeout-test-kserve-router-scheduler-7477555ctkhml | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-test-kserve-fcb85f744 |
SuccessfulCreate |
Created pod: custom-route-timeout-test-kserve-fcb85f744-42x5r | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7477555ctkhml |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-fcb85f744-42x5r |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-fcb85f744-42x5r |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-fcb85f744-42x5r |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-test-kserve-fcb85f744-42x5r |
AddedInterface |
Add eth0 [10.132.0.58/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-test-kserve-router-scheduler-7477555ctkhml |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7477555ctkhml |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7477555ctkhml |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7477555ctkhml |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7477555ctkhml |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7477555ctkhml |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7477555ctkhml |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7477555ctkhml |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7477555ctkhml |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-fcb85f744-42x5r |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-fcb85f744-42x5r |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-fcb85f744-42x5r |
Created |
Created container: main | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route | |
| (x10) | kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5697d48bb4-9dkjt |
Unhealthy |
Startup probe failed: Get "https://10.132.0.57:8000/health": dial tcp 10.132.0.57:8000: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-5697d48bb4-9dkjt |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-2ph88 |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-2ph88 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-79bf4574b-2ph88 |
Unhealthy |
Readiness probe failed: timeout: failed to connect service "10.133.0.30:9003" within 1s: context deadline exceeded | |
| (x10) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-fcb85f744-42x5r |
Unhealthy |
Startup probe failed: Get "https://10.132.0.58:8000/health": dial tcp 10.132.0.58:8000: connect: connection refused |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-2-openshift-default-7b76d7c4bf |
SuccessfulCreate |
Created pod: router-gateway-2-openshift-default-7b76d7c4bf-4txdd | |
kserve-ci-e2e-test |
gateway_labeler_controller |
router-gateway-2 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway router-gateway-2 | |
kserve-ci-e2e-test |
service-controller |
router-gateway-2-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-2-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-2-openshift-default-7b76d7c4bf from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-7b76d7c4bf-4txdd |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" | |
kserve-ci-e2e-test |
multus |
router-gateway-2-openshift-default-7b76d7c4bf-4txdd |
AddedInterface |
Add eth0 [10.132.0.60/23] from ovn-kubernetes | |
| (x4) | kserve-ci-e2e-test |
gateway_labeler_controller |
router-gateway-1 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway router-gateway-1 |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-fcb85f744-42x5r |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7477555ctkhml |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7477555ctkhml |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
service-controller |
router-gateway-2-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-7b76d7c4bf-4txdd |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:2b5f5aa5ee9974269d8e3666b1bfc58da10c172bf3f1d6defd555fbd1ac9a6ec" in 3.208s (3.208s including waiting). Image size: 181318953 bytes. | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-7b76d7c4bf-4txdd |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-7b76d7c4bf-4txdd |
Created |
Created container: istio-proxy | |
| (x6) | kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-7b76d7c4bf-4txdd |
Unhealthy |
Startup probe failed: Get "http://10.132.0.60:15021/healthz/ready": dial tcp 10.132.0.60:15021: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Role kserve-ci-e2e-test/router-with-refs-pd-test-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-pd-test-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-prefill-58df97877c |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-prefill-58df97877c-zm8tj | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-pd-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-fb85fd64b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-fb85fd64b-9bs98 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.7.1" | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-fb85fd64b-9bs98 |
AddedInterface |
Add eth0 [10.132.0.61/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-fb85fd64b |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-fb85fd64b-9bs98 | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-prefill-58df97877c-zm8tj |
AddedInterface |
Add eth0 [10.132.0.62/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-58df97877c-zm8tj |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-router-scheduler-75576487bf from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-router-scheduler-75576487bf |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-router-scheduler-75576487bhnxvg | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-prefill-58df97877c from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-fb85fd64b-9bs98 |
Created |
Created container: llm-d-routing-sidecar | |
| (x8) | kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-pd-test-kserve-workload-svc |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-fb85fd64b-9bs98 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.7.1" in 811ms (811ms including waiting). Image size: 67767940 bytes. | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-fb85fd64b-9bs98 |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-75576487bhnxvg |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-75576487bhnxvg |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-75576487bhnxvg |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-router-scheduler-75576487bhnxvg |
AddedInterface |
Add eth0 [10.133.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-58df97877c-zm8tj |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-58df97877c-zm8tj |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-75576487bhnxvg |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-75576487bhnxvg |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-75576487bhnxvg |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-75576487bhnxvg |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-75576487bhnxvg |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-75576487bhnxvg |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-fb85fd64b-9bs98 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-fb85fd64b-9bs98 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-fb85fd64b-9bs98 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-58df97877c-zm8tj |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-58df97877c-zm8tj |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-58df97877c-zm8tj |
Created |
Created container: main | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-test-kserve |
ScalingReplicaSet |
Scaled up replica set router-with-refs-test-kserve-68c8444c64 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-fb85fd64b-9bs98 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-fb85fd64b-9bs98 |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-fb85fd64b-9bs98 |
Created |
Created container: main | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-test-kserve-68c8444c64 |
SuccessfulCreate |
Created pod: router-with-refs-test-kserve-68c8444c64-26gjz | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-68c8444c64-26gjz |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-test-kserve-router-scheduler-85d876656 |
SuccessfulCreate |
Created pod: router-with-refs-test-kserve-router-scheduler-85d876656-57bx2 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-test-epp-service | |
| (x4) | kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-test-kserve-workload-svc |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-68c8444c64-26gjz |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Role kserve-ci-e2e-test/router-with-refs-test-epp-role | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-68c8444c64-26gjz |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-test-epp-rb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-85d876656-57bx2 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
router-with-refs-test-kserve-68c8444c64-26gjz |
AddedInterface |
Add eth0 [10.132.0.63/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set router-with-refs-test-kserve-router-scheduler-85d876656 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
multus |
router-with-refs-test-kserve-router-scheduler-85d876656-57bx2 |
AddedInterface |
Add eth0 [10.133.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-85d876656-57bx2 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-85d876656-57bx2 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-85d876656-57bx2 |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-85d876656-57bx2 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-85d876656-57bx2 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-85d876656-57bx2 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-85d876656-57bx2 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-85d876656-57bx2 |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-68c8444c64-26gjz |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-68c8444c64-26gjz |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-68c8444c64-26gjz |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs | |
| (x19) | kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-58df97877c-zm8tj |
Unhealthy |
Startup probe failed: Get "https://10.132.0.62:8000/health": dial tcp 10.132.0.62:8000: connect: connection refused |
| (x19) | kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-fb85fd64b-9bs98 |
Unhealthy |
Startup probe failed: Get "https://10.132.0.61:8001/health": dial tcp 10.132.0.61:8001: connect: connection refused |
| (x19) | kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-68c8444c64-26gjz |
Unhealthy |
Startup probe failed: Get "https://10.132.0.63:8000/health": dial tcp 10.132.0.63:8000: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-75576487bhnxvg |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-58df97877c-zm8tj |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-75576487bhnxvg |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-fb85fd64b-9bs98 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-fb85fd64b-9bs98 |
Killing |
Stopping container llm-d-routing-sidecar | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv8de1d74aab16d9cabd8b5aafeb5248e8-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-79b6995bcb |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-79b6995bcbrb97l | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-route | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-79b6995bcb from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-79b6995bcbrb97l |
AddedInterface |
Add eth0 [10.132.0.64/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-79b6995bcbrb97l |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-79b6995bcbrb97l |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-79b6995bcbrb97l |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb | |
kserve-ci-e2e-test |
GatewayAuthBootstrap |
router-gateway-1 |
ReconcileError |
Failed to delete gateway PodMonitor: failed to delete PodMonitor: podmonitors.monitoring.coreos.com "router-gateway-1-metrics" not found | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-85d876656-57bx2 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-68c8444c64-26gjz |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-85d876656-57bx2 |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-79b6995bcbrb97l |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-79b6995bcbrb97l |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-79b6995bcbrb97l |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv8f1a6f044e8c7a4d31a250e0c4861caf-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-role | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6bpczs5 |
AddedInterface |
Add eth0 [10.132.0.66/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6bpczs5 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-9d6b6747-f45sn |
AddedInterface |
Add eth0 [10.132.0.65/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-9d6b6747-f45sn |
Pulled |
Container image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-9d6b6747-f45sn |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-9d6b6747-f45sn |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-9d6b6747 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-9d6b6747-f45sn | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6b6c85548d |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6bpczs5 | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-schemm9kn |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-schemm9kn |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6bpczs5 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-schemm9kn |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-schemm9kn |
AddedInterface |
Add eth0 [10.133.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6bpczs5 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6b6c85548d from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-9d6b6747 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test4ce8108fb3d8aff064c322bee6e173f5-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-rb | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scheduler-757746cdc4 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scheduler-757746cdc4 |
SuccessfulCreate |
Created pod: llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-schemm9kn | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-schemm9kn |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-9d6b6747-f45sn |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-9d6b6747-f45sn |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-schemm9kn |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-schemm9kn |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-schemm9kn |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-schemm9kn |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-schemm9kn |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-9d6b6747-f45sn |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6bpczs5 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6bpczs5 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6bpczs5 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-9d6b6747-f45sn |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-9d6b6747-f45sn |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-9d6b6747-f45sn |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv8de1d74aab16d9cabd8b5aafeb5248e8-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv8f1a6f044e8c7a4d31a250e0c4861caf-kserve-self-signed-certs | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-shadow-svc |
| (x18) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-79b6995bcbrb97l |
Unhealthy |
Startup probe failed: Get "https://10.132.0.64:8000/health": dial tcp 10.132.0.64:8000: connect: connection refused |
| (x19) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-9d6b6747-f45sn |
Unhealthy |
Startup probe failed: Get "https://10.132.0.65:8001/health": dial tcp 10.132.0.65:8001: connect: connection refused |
| (x19) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6bpczs5 |
Unhealthy |
Startup probe failed: Get "https://10.132.0.66:8000/health": dial tcp 10.132.0.66:8000: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-79b6995bcbrb97l |
Killing |
Stopping container main | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testc9aefdf01a18c3acb55ce247710ebb71-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-epp-role | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
SuccessfulCreate |
create Pod llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 in StatefulSet llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 successful | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-workload-svc | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheduler-67b7d6c74 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-scc | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn |
CreatingRevision |
Creating revision with key 84454fd69d for a newly created LeaderWorkerSet | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn |
GroupsProgressing |
Created leader statefulset llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn | |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn |
GroupsProgressing |
Replicas are progressing, with 0 groups ready of total 1 groups |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn |
SuccessfulCreate |
create Pod llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 in StatefulSet llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn successful | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-epp-rb | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheduler-67b7d6c74 |
SuccessfulCreate |
Created pod: llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schecr696 | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn |
GroupsProgressing |
Created worker statefulset for leader pod llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv4e643bc258191ffc517a31cd1d0ddd27-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schecr696 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
AddedInterface |
Add eth0 [10.132.0.67/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schecr696 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
AddedInterface |
Add eth0 [10.133.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schecr696 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schecr696 |
AddedInterface |
Add eth0 [10.133.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schecr696 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schecr696 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schecr696 |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schecr696 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schecr696 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schecr696 |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Pulling |
Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schecr696 |
Unhealthy |
Startup probe failed: Get "http://10.133.0.36:8082/healthz": dial tcp 10.133.0.36:8082: connect: connection refused | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-route | |
| (x8) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv4e643bc258191ffc517a31cd1d0ddd27-kserve-self-signed-certs | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
custom-route-timeout-pd-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-pd-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-pd-test-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-prefill-965555885 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-rb | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-66f45fb4cd-vl9fw |
AddedInterface |
Add eth0 [10.132.0.68/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-prefill-965555885 |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-prefill-965555885-9x9pp | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-router-scheduler-6bd9ff8d9 |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-router-scheduler-6bd9fh69w4 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Role kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-role | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-66f45fb4cd |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-66f45fb4cd-vl9fw | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-router-scheduler-6bd9ff8d9 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-66f45fb4cd from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-965555885-9x9pp |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-965555885-9x9pp |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-66f45fb4cd-vl9fw |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-66f45fb4cd-vl9fw |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-66f45fb4cd-vl9fw |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-66f45fb4cd-vl9fw |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-prefill-965555885-9x9pp |
AddedInterface |
Add eth0 [10.132.0.69/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-66f45fb4cd-vl9fw |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-66f45fb4cd-vl9fw |
Pulled |
Container image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-965555885-9x9pp |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test4ce8108fb3d8aff064c322bee6e173f5-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-schemm9kn |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
endpoint-controller |
llmisvc-model-fb-opt-125m-route-05aa9bba-inference--ip-fe69e9df |
FailedToUpdateEndpoint |
Failed to update endpoint kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-inference--ip-fe69e9df: Operation cannot be fulfilled on endpoints "llmisvc-model-fb-opt-125m-route-05aa9bba-inference--ip-fe69e9df": StorageError: invalid object, Code: 4, Key: /kubernetes.io/services/endpoints/kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-inference--ip-fe69e9df, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: ccb6845d-df82-4ea9-8679-90b5107c72b2, UID in object meta: | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-6bpczs5 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-9d6b6747-f45sn |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-9d6b6747-f45sn |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-schemm9kn |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-66f45fb4cd-vl9fw |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-66f45fb4cd-vl9fw |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-965555885-9x9pp |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-965555885-9x9pp |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-965555885-9x9pp |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-schemm9kn |
Unhealthy |
Readiness probe failed: Get "http://10.133.0.34:8082/healthz": dial tcp 10.133.0.34:8082: connect: connection refused | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-66f45fb4cd-vl9fw |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-schemm9kn |
Unhealthy |
Readiness probe failed: timeout: failed to connect service "10.133.0.34:9003" within 1s: context deadline exceeded | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6bd9fh69w4 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:db87b31bd66df923588fdbd06edc33da9e31bbce1587b8a240e1f949f63efd2f" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6bd9fh69w4 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6bd9fh69w4 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-router-scheduler-6bd9fh69w4 |
AddedInterface |
Add eth0 [10.133.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Pulled |
Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" in 38.96s (38.96s including waiting). Image size: 3531177328 bytes. | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6bd9fh69w4 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6bd9fh69w4 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6bd9fh69w4 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6bd9fh69w4 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6bd9fh69w4 |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6bd9fh69w4 |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Updated |
Updated v1.HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-shadow-svc |
| (x13) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Unhealthy |
Startup probe failed: Get "https://10.132.0.67:8000/health": dial tcp 10.132.0.67:8000: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn |
AllGroupsReady |
All replicas are ready, with 1 groups ready of total 1 groups |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schecr696 |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schecr696 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testc9aefdf01a18c3acb55ce247710ebb71-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Killing |
Stopping container main | |
| (x17) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-965555885-9x9pp |
Unhealthy |
Startup probe failed: Get "https://10.132.0.69:8000/health": dial tcp 10.132.0.69:8000: connect: connection refused |
| (x17) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-66f45fb4cd-vl9fw |
Unhealthy |
Startup probe failed: Get "https://10.132.0.68:8001/health": dial tcp 10.132.0.68:8001: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-66f45fb4cd-vl9fw |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6bd9fh69w4 |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-66f45fb4cd-vl9fw |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-6bd9fh69w4 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-965555885-9x9pp |
Killing |
Stopping container main |