| Time | Namespace | Component | RelatedObject | Reason | Message |
|---|---|---|---|---|---|
kserve-ci-e2e-test |
scheduler-inline-config-test-kserve-router-scheduler-d6db7h4vsv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler-d6db7h4vsv to ip-10-0-138-68.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-router-scheduler-668db9fc8bmjbq |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-router-scheduler-668db9fc8bmjbq to ip-10-0-143-218.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-84pljnr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-84pljnr to ip-10-0-137-68.ec2.internal | ||
kuadrant-system |
authorino-operator-7587b89b76-hnn8l |
Scheduled |
Successfully assigned kuadrant-system/authorino-operator-7587b89b76-hnn8l to ip-10-0-138-68.ec2.internal | ||
kuadrant-system |
dns-operator-controller-manager-844548ff4c-hhjsv |
Scheduled |
Successfully assigned kuadrant-system/dns-operator-controller-manager-844548ff4c-hhjsv to ip-10-0-137-68.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedlwqk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedlwqk to ip-10-0-138-68.ec2.internal | ||
kuadrant-system |
authorino-79cbc94b89-qkxtz |
Scheduled |
Successfully assigned kuadrant-system/authorino-79cbc94b89-qkxtz to ip-10-0-138-68.ec2.internal | ||
kuadrant-system |
authorino-68bd676465-vlxjh |
Scheduled |
Successfully assigned kuadrant-system/authorino-68bd676465-vlxjh to ip-10-0-137-68.ec2.internal | ||
kserve-ci-e2e-test |
gw-section-name-router-with-gat-2f0a622e-kserve-5db5b6c7cccrw6r |
Scheduled |
Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-5db5b6c7cccrw6r to ip-10-0-137-68.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherzz78 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherzz78 to ip-10-0-138-68.ec2.internal | ||
kuadrant-system |
limitador-operator-controller-manager-c7fb4c8d5-l5476 |
Scheduled |
Successfully assigned kuadrant-system/limitador-operator-controller-manager-c7fb4c8d5-l5476 to ip-10-0-138-68.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-test-kserve-router-scheduler-7fccfb7cpgx66 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler-7fccfb7cpgx66 to ip-10-0-138-68.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 to ip-10-0-137-68.ec2.internal | ||
kuadrant-system |
authorino-674b59b84c-55pqx |
Scheduled |
Successfully assigned kuadrant-system/authorino-674b59b84c-55pqx to ip-10-0-137-68.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 to ip-10-0-138-68.ec2.internal | ||
kuadrant-system |
limitador-limitador-64c8f475fb-lhq28 |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-64c8f475fb-lhq28 to ip-10-0-143-218.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-69b8c75f54sbwdk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-69b8c75f54sbwdk to ip-10-0-137-68.ec2.internal | ||
openshift-ingress |
router-default-747f569c94-mjbpd |
Scheduled |
Successfully assigned openshift-ingress/router-default-747f569c94-mjbpd to ip-10-0-137-68.ec2.internal | ||
kserve-ci-e2e-test |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevm82l |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevm82l to ip-10-0-138-68.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59lqc2s |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59lqc2s to ip-10-0-143-218.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-554847cfc4-8zh9q |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-554847cfc4-8zh9q to ip-10-0-143-218.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-configmap-ref-test-kserve-router-scheduler-86f46sqqjs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler-86f46sqqjs to ip-10-0-138-68.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-configmap-ref-test-kserve-88df5d794-kmp54 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-88df5d794-kmp54 to ip-10-0-143-218.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59sszp2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59sszp2 to ip-10-0-138-68.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-f84cb79f7-tppf9 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-f84cb79f7-tppf9 to ip-10-0-137-68.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-test-kserve-c74cb6db6-m7zsv |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-c74cb6db6-m7zsv to ip-10-0-137-68.ec2.internal | ||
kuadrant-system |
limitador-limitador-67566c68b4-52nnx |
Scheduled |
Successfully assigned kuadrant-system/limitador-limitador-67566c68b4-52nnx to ip-10-0-137-68.ec2.internal | ||
kserve-ci-e2e-test |
gw-section-name-router-with-gat-f1d92d0f-kserve-59f6ff894bf5hzn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-59f6ff894bf5hzn to ip-10-0-137-68.ec2.internal | ||
openshift-ingress |
istiod-openshift-gateway-55ff986f96-fjvbp |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-55ff986f96-fjvbp to ip-10-0-138-68.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-router-scheduler-85998xvffb |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-router-scheduler-85998xvffb to ip-10-0-143-218.ec2.internal | ||
kuadrant-system |
kuadrant-operator-controller-manager-6ddf9554fc-s54pc |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-operator-controller-manager-6ddf9554fc-s54pc to ip-10-0-143-218.ec2.internal | ||
kserve-ci-e2e-test |
scheduler-inline-config-test-kserve-78b8847666-26b5f |
Scheduled |
Successfully assigned kserve-ci-e2e-test/scheduler-inline-config-test-kserve-78b8847666-26b5f to ip-10-0-143-218.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-65747bccd4-b5kpp |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-65747bccd4-b5kpp to ip-10-0-143-218.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-65747bccd4-kk5ht |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-65747bccd4-kk5ht to ip-10-0-137-68.ec2.internal | ||
kuadrant-system |
kuadrant-console-plugin-6c886788f8-mj4k9 |
Scheduled |
Successfully assigned kuadrant-system/kuadrant-console-plugin-6c886788f8-mj4k9 to ip-10-0-137-68.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-6d59c9877dfckvg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-6d59c9877dfckvg to ip-10-0-137-68.ec2.internal | ||
kserve-ci-e2e-test |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-d75c5d878-d99kh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-d75c5d878-d99kh to ip-10-0-137-68.ec2.internal | ||
kserve-ci-e2e-test |
precise-prefix-cache-test-kserve-router-scheduler-55c45dd7scpbh |
Scheduled |
Successfully assigned kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler-55c45dd7scpbh to ip-10-0-138-68.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-prefill-5cd8c8d959-p7545 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill-5cd8c8d959-p7545 to ip-10-0-137-68.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-pd-test-kserve-6f974f4c44-cwjhg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-6f974f4c44-cwjhg to ip-10-0-137-68.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-test-kserve-router-scheduler-69f799fd49-2gjfr |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler-69f799fd49-2gjfr to ip-10-0-138-68.ec2.internal | ||
openshift-ingress |
openshift-ai-inference-openshift-default-6b94bb86d8-j64f2 |
Scheduled |
Successfully assigned openshift-ingress/openshift-ai-inference-openshift-default-6b94bb86d8-j64f2 to ip-10-0-138-68.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-prefill-7d9f7645f-glgwk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill-7d9f7645f-glgwk to ip-10-0-138-68.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-b8c47cf74-d8fqg |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-b8c47cf74-d8fqg to ip-10-0-137-68.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-b8c47cf74-mvwrt |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-b8c47cf74-mvwrt to ip-10-0-137-68.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-router-scheduler-d547597f-fs6kk |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-d547597f-fs6kk to ip-10-0-143-218.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-1-openshift-default-6c59fbf55c-mqqmd |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-1-openshift-default-6c59fbf55c-mqqmd to ip-10-0-138-68.ec2.internal | ||
kserve-ci-e2e-test |
router-with-refs-pd-test-kserve-d9f6bb5b8-pckhm |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-with-refs-pd-test-kserve-d9f6bb5b8-pckhm to ip-10-0-138-68.ec2.internal | ||
kserve-ci-e2e-test |
router-gateway-2-openshift-default-6866b85949-kqbbn |
Scheduled |
Successfully assigned kserve-ci-e2e-test/router-gateway-2-openshift-default-6866b85949-kqbbn to ip-10-0-138-68.ec2.internal | ||
kserve-ci-e2e-test |
stop-feature-test-kserve-router-scheduler-d547597f-zmfgs |
Scheduled |
Successfully assigned kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler-d547597f-zmfgs to ip-10-0-143-218.ec2.internal | ||
kserve-ci-e2e-test |
custom-route-timeout-test-kserve-7cc767b4f4-wpnr2 |
Scheduled |
Successfully assigned kserve-ci-e2e-test/custom-route-timeout-test-kserve-7cc767b4f4-wpnr2 to ip-10-0-137-68.ec2.internal | ||
openshift-ingress |
istiod-openshift-gateway-7cd77c7ffd-h4tbj |
Scheduled |
Successfully assigned openshift-ingress/istiod-openshift-gateway-7cd77c7ffd-h4tbj to ip-10-0-138-68.ec2.internal | ||
openshift-ingress |
deployment-controller |
router-default |
ScalingReplicaSet |
Scaled up replica set router-default-747f569c94 from 0 to 1 | |
| (x11) | openshift-ingress |
replicaset-controller |
router-default-747f569c94 |
FailedCreate |
Error creating: pods "router-default-747f569c94-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
openshift-ingress |
service-controller |
router-default |
UnAvailableLoadBalancer |
There are no available nodes for LoadBalancer | |
openshift-ingress |
service-controller |
router-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
openshift-ingress |
service-controller |
router-default |
EnsuredLoadBalancer |
Ensured load balancer | |
| (x16) | openshift-ingress |
replicaset-controller |
router-default-747f569c94 |
FailedCreate |
Error creating: pods "router-default-747f569c94-" is forbidden: autoscaling.openshift.io/ManagementCPUsOverride the cluster does not have any nodes |
| (x3) | openshift-ingress |
service-controller |
router-default |
UpdatedLoadBalancer |
Updated load balancer with new hosts |
openshift-ingress |
replicaset-controller |
router-default-747f569c94 |
SuccessfulCreate |
Created pod: router-default-747f569c94-mjbpd | |
| (x6) | openshift-ingress |
kubelet |
router-default-747f569c94-mjbpd |
FailedMount |
MountVolume.SetUp failed for volume "metrics-certs" : secret "router-metrics-certs-default" not found |
| (x6) | openshift-ingress |
kubelet |
router-default-747f569c94-mjbpd |
FailedMount |
MountVolume.SetUp failed for volume "service-ca-bundle" : configmap references non-existent config key: service-ca.crt |
openshift-ingress |
kubelet |
router-default-747f569c94-mjbpd |
Created |
Created container: router | |
openshift-ingress |
multus |
router-default-747f569c94-mjbpd |
AddedInterface |
Add eth0 [10.134.0.10/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
router-default-747f569c94-mjbpd |
Pulled |
Container image "quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:294af5c64228434d1ed6ee8ea3ac802e3c999aa847223e3b2efa18425a9fe421" already present on machine | |
openshift-ingress |
kubelet |
router-default-747f569c94-mjbpd |
Started |
Started container router | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-7cd77c7ffd |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-7cd77c7ffd-h4tbj | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7cd77c7ffd-h4tbj |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:028e10651db0d1ddb769a27c9483c6d41be6ac597f253afd9d599f395d9c82d8" | |
openshift-ingress |
multus |
istiod-openshift-gateway-7cd77c7ffd-h4tbj |
AddedInterface |
Add eth0 [10.133.0.30/23] from ovn-kubernetes | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-7cd77c7ffd from 0 to 1 | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7cd77c7ffd-h4tbj |
Created |
Created container: discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7cd77c7ffd-h4tbj |
Started |
Started container discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7cd77c7ffd-h4tbj |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:028e10651db0d1ddb769a27c9483c6d41be6ac597f253afd9d599f395d9c82d8" in 2.326s (2.326s including waiting). Image size: 179322965 bytes. | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7cd77c7ffd-h4tbj |
ProbeError |
Readiness probe error: HTTP probe failed with statuscode: 503 body: | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7cd77c7ffd-h4tbj |
Unhealthy |
Readiness probe failed: HTTP probe failed with statuscode: 503 | |
openshift-ingress |
deployment-controller |
openshift-ai-inference-openshift-default |
ScalingReplicaSet |
Scaled up replica set openshift-ai-inference-openshift-default-6b94bb86d8 from 0 to 1 | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-6b94bb86d8-j64f2 |
Pulling |
Pulling image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:d518f3d1539f45e1253c5c9fa22062802804601d4998cd50344e476a3cc388fe" | |
openshift-ingress |
multus |
openshift-ai-inference-openshift-default-6b94bb86d8-j64f2 |
AddedInterface |
Add eth0 [10.133.0.31/23] from ovn-kubernetes | |
openshift-ingress |
replicaset-controller |
openshift-ai-inference-openshift-default-6b94bb86d8 |
SuccessfulCreate |
Created pod: openshift-ai-inference-openshift-default-6b94bb86d8-j64f2 | |
openshift-ingress |
gateway_labeler_controller |
openshift-ai-inference |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway openshift-ai-inference | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
SyncLoadBalancerFailed |
Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: 2fa01897-af32-4347-8f5c-b6763bb4c39a, TooManyLoadBalancers: Exceeded quota of account 590184136207 | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-6b94bb86d8-j64f2 |
Pulled |
Successfully pulled image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:d518f3d1539f45e1253c5c9fa22062802804601d4998cd50344e476a3cc388fe" in 2.479s (2.479s including waiting). Image size: 163191192 bytes. | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-6b94bb86d8-j64f2 |
Started |
Started container istio-proxy | |
openshift-ingress |
kubelet |
openshift-ai-inference-openshift-default-6b94bb86d8-j64f2 |
Created |
Created container: istio-proxy | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
SyncLoadBalancerFailed |
Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: f3b1a6ee-9f5a-43c8-bc59-4d784c4fa779, TooManyLoadBalancers: Exceeded quota of account 590184136207 | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.3.0 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.3.0 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.3.2 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.3.2 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.3.0 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.3.0 |
InstallWaiting |
installing: waiting for deployment limitador-operator-controller-manager to become ready: deployment "limitador-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
replicaset-controller |
limitador-operator-controller-manager-c7fb4c8d5 |
SuccessfulCreate |
Created pod: limitador-operator-controller-manager-c7fb4c8d5-l5476 | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-c7fb4c8d5-l5476 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:9a3ccb54bc904521277b87e1d178d8134cc6ef744eb4ec5b64177355fd5a9e66" | |
kuadrant-system |
deployment-controller |
limitador-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set limitador-operator-controller-manager-c7fb4c8d5 from 0 to 1 | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
SyncLoadBalancerFailed |
Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: e3eab7b6-c9da-4732-8f1f-62f3c4138502, TooManyLoadBalancers: Exceeded quota of account 590184136207 | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.3.0 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
multus |
limitador-operator-controller-manager-c7fb4c8d5-l5476 |
AddedInterface |
Add eth0 [10.133.0.36/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-c7fb4c8d5-l5476 |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-c7fb4c8d5-l5476 |
Started |
Started container manager | |
kuadrant-system |
kubelet |
limitador-operator-controller-manager-c7fb4c8d5-l5476 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9-operator@sha256:9a3ccb54bc904521277b87e1d178d8134cc6ef744eb4ec5b64177355fd5a9e66" in 2.121s (2.121s including waiting). Image size: 175506011 bytes. | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.3.2 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.3.0 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
replicaset-controller |
kuadrant-operator-controller-manager-6ddf9554fc |
SuccessfulCreate |
Created pod: kuadrant-operator-controller-manager-6ddf9554fc-s54pc | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.3.0 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
limitador-operator-controller-manager-c7fb4c8d5-l5476_99666f8e-6c16-46b4-849e-f08c3b233d42 |
3745a16e.kuadrant.io |
LeaderElection |
limitador-operator-controller-manager-c7fb4c8d5-l5476_99666f8e-6c16-46b4-849e-f08c3b233d42 became leader | |
kuadrant-system |
deployment-controller |
kuadrant-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set kuadrant-operator-controller-manager-6ddf9554fc from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.3.2 |
InstallWaiting |
installing: waiting for deployment kuadrant-operator-controller-manager to become ready: deployment "kuadrant-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.3.2 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-6ddf9554fc-s54pc |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:7aa6d6dbbde488260789adb94fa232a06d1e635cc2aaf86af24f8cf14a17eef8" | |
kuadrant-system |
multus |
kuadrant-operator-controller-manager-6ddf9554fc-s54pc |
AddedInterface |
Add eth0 [10.132.0.22/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-operator-7587b89b76-hnn8l |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:4e581c0172549df72c6ef8978e96d771645bc36298d2ccf9240af4e71c088733" | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.3.0 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.3.0 |
RequirementsNotMet |
one or more requirements couldn't be found | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.3.0 |
RequirementsUnknown |
requirements not yet checked | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.3.0 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.3.0 |
InstallWaiting |
installing: waiting for deployment authorino-operator to become ready: deployment "authorino-operator" not available: Deployment does not have minimum availability. | |
kuadrant-system |
deployment-controller |
authorino-operator |
ScalingReplicaSet |
Scaled up replica set authorino-operator-7587b89b76 from 0 to 1 | |
kuadrant-system |
replicaset-controller |
authorino-operator-7587b89b76 |
SuccessfulCreate |
Created pod: authorino-operator-7587b89b76-hnn8l | |
kuadrant-system |
multus |
authorino-operator-7587b89b76-hnn8l |
AddedInterface |
Add eth0 [10.133.0.37/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
authorino-operator-7587b89b76-hnn8l |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-6ddf9554fc-s54pc |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
authorino-operator-7587b89b76-hnn8l |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9-operator@sha256:4e581c0172549df72c6ef8978e96d771645bc36298d2ccf9240af4e71c088733" in 1.328s (1.328s including waiting). Image size: 161991975 bytes. | |
kuadrant-system |
deployment-controller |
dns-operator-controller-manager |
ScalingReplicaSet |
Scaled up replica set dns-operator-controller-manager-844548ff4c from 0 to 1 | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.3.0 |
AllRequirementsMet |
all requirements found, attempting install | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-6ddf9554fc-s54pc |
Started |
Started container manager | |
kuadrant-system |
authorino-operator-7587b89b76-hnn8l_833583fe-396b-499c-9df5-23644d919db0 |
aac3a15d.authorino.kuadrant.io |
LeaderElection |
authorino-operator-7587b89b76-hnn8l_833583fe-396b-499c-9df5-23644d919db0 became leader | |
kuadrant-system |
kubelet |
authorino-operator-7587b89b76-hnn8l |
Started |
Started container manager | |
kuadrant-system |
kubelet |
kuadrant-operator-controller-manager-6ddf9554fc-s54pc |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-rhel9-operator@sha256:7aa6d6dbbde488260789adb94fa232a06d1e635cc2aaf86af24f8cf14a17eef8" in 4.077s (4.077s including waiting). Image size: 411782238 bytes. | |
kuadrant-system |
replicaset-controller |
dns-operator-controller-manager-844548ff4c |
SuccessfulCreate |
Created pod: dns-operator-controller-manager-844548ff4c-hhjsv | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.3.0 |
InstallSucceeded |
waiting for install components to report healthy | |
kuadrant-system |
kuadrant-operator-controller-manager-6ddf9554fc-s54pc_24089f70-f21a-4c38-a947-6c7e14f132db |
f139389e.kuadrant.io |
LeaderElection |
kuadrant-operator-controller-manager-6ddf9554fc-s54pc_24089f70-f21a-4c38-a947-6c7e14f132db became leader | |
kuadrant-system |
multus |
dns-operator-controller-manager-844548ff4c-hhjsv |
AddedInterface |
Add eth0 [10.134.0.28/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-844548ff4c-hhjsv |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:b4e7ba67509320ca9ac5d63cc4add987fad05b098c4a7cd8dd91f264731177cf" | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.3.0 |
InstallWaiting |
installing: waiting for deployment dns-operator-controller-manager to become ready: deployment "dns-operator-controller-manager" not available: Deployment does not have minimum availability. | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-6c886788f8-mj4k9 |
FailedMount |
MountVolume.SetUp failed for volume "plugin-serving-cert" : secret "plugin-serving-cert" not found | |
kuadrant-system |
deployment-controller |
kuadrant-console-plugin |
ScalingReplicaSet |
Scaled up replica set kuadrant-console-plugin-6c886788f8 from 0 to 1 | |
kuadrant-system |
replicaset-controller |
kuadrant-console-plugin-6c886788f8 |
SuccessfulCreate |
Created pod: kuadrant-console-plugin-6c886788f8-mj4k9 | |
kuadrant-system |
multus |
kuadrant-console-plugin-6c886788f8-mj4k9 |
AddedInterface |
Add eth0 [10.134.0.29/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-844548ff4c-hhjsv |
Started |
Started container manager | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-844548ff4c-hhjsv |
Created |
Created container: manager | |
kuadrant-system |
kubelet |
dns-operator-controller-manager-844548ff4c-hhjsv |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/dns-rhel9-operator@sha256:b4e7ba67509320ca9ac5d63cc4add987fad05b098c4a7cd8dd91f264731177cf" in 2.227s (2.227s including waiting). Image size: 186790172 bytes. | |
kuadrant-system |
dns-operator-controller-manager-844548ff4c-hhjsv_75fb060e-5847-4f97-b443-8adf90aa1ea0 |
a3f98d6c.kuadrant.io |
LeaderElection |
dns-operator-controller-manager-844548ff4c-hhjsv_75fb060e-5847-4f97-b443-8adf90aa1ea0 became leader | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-6c886788f8-mj4k9 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:41755d5e16ee5409cfe8888cf5883b262820baea4eae449fcf61f06ab1756f57" | |
kuadrant-system |
operator-lifecycle-manager |
limitador-operator.v1.3.0 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-6c886788f8-mj4k9 |
Created |
Created container: kuadrant-console-plugin | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-6c886788f8-mj4k9 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/rhcl-console-plugin-rhel9@sha256:41755d5e16ee5409cfe8888cf5883b262820baea4eae449fcf61f06ab1756f57" in 5.794s (5.794s including waiting). Image size: 339541674 bytes. | |
kuadrant-system |
kubelet |
kuadrant-console-plugin-6c886788f8-mj4k9 |
Started |
Started container kuadrant-console-plugin | |
kuadrant-system |
operator-lifecycle-manager |
rhcl-operator.v1.3.2 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
operator-lifecycle-manager |
authorino-operator.v1.3.0 |
InstallSucceeded |
install strategy completed with no errors | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
SyncLoadBalancerFailed |
Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: 563cefc1-0c1b-4a43-acd5-05aa1eca28be, TooManyLoadBalancers: Exceeded quota of account 590184136207 | |
kuadrant-system |
operator-lifecycle-manager |
dns-operator.v1.3.0 |
InstallSucceeded |
install strategy completed with no errors | |
kuadrant-system |
kubelet |
limitador-limitador-64c8f475fb-lhq28 |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:43bc4021bb30c7ef305e01c11e22ca5584c7e2c192b4db0a5646f04f715ee3b0" | |
kuadrant-system |
replicaset-controller |
limitador-limitador-64c8f475fb |
SuccessfulCreate |
Created pod: limitador-limitador-64c8f475fb-lhq28 | |
kuadrant-system |
multus |
limitador-limitador-64c8f475fb-lhq28 |
AddedInterface |
Add eth0 [10.132.0.23/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-67566c68b4 from 0 to 1 | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled up replica set limitador-limitador-64c8f475fb from 0 to 1 | |
kuadrant-system |
replicaset-controller |
limitador-limitador-67566c68b4 |
SuccessfulCreate |
Created pod: limitador-limitador-67566c68b4-52nnx | |
kuadrant-system |
multus |
authorino-674b59b84c-55pqx |
AddedInterface |
Add eth0 [10.134.0.31/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-79cbc94b89 from 0 to 1 | |
kuadrant-system |
kubelet |
limitador-limitador-67566c68b4-52nnx |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:43bc4021bb30c7ef305e01c11e22ca5584c7e2c192b4db0a5646f04f715ee3b0" | |
kuadrant-system |
multus |
limitador-limitador-67566c68b4-52nnx |
AddedInterface |
Add eth0 [10.134.0.30/23] from ovn-kubernetes | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-674b59b84c from 0 to 1 | |
kuadrant-system |
kubelet |
authorino-674b59b84c-55pqx |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c2208382e16c501e4ed58aea83f54d108567f36853cf79f7ffdf8ee54ff4ace8" | |
kuadrant-system |
replicaset-controller |
authorino-674b59b84c |
SuccessfulCreate |
Created pod: authorino-674b59b84c-55pqx | |
kuadrant-system |
replicaset-controller |
authorino-79cbc94b89 |
SuccessfulCreate |
Created pod: authorino-79cbc94b89-qkxtz | |
kuadrant-system |
multus |
authorino-79cbc94b89-qkxtz |
AddedInterface |
Add eth0 [10.133.0.38/23] from ovn-kubernetes | |
kuadrant-system |
kubelet |
limitador-limitador-67566c68b4-52nnx |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:43bc4021bb30c7ef305e01c11e22ca5584c7e2c192b4db0a5646f04f715ee3b0" in 1.115s (1.115s including waiting). Image size: 249943843 bytes. | |
kuadrant-system |
kubelet |
authorino-79cbc94b89-qkxtz |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c2208382e16c501e4ed58aea83f54d108567f36853cf79f7ffdf8ee54ff4ace8" | |
kuadrant-system |
kubelet |
limitador-limitador-67566c68b4-52nnx |
Started |
Started container limitador | |
kuadrant-system |
kubelet |
limitador-limitador-67566c68b4-52nnx |
Created |
Created container: limitador | |
kuadrant-system |
kubelet |
authorino-674b59b84c-55pqx |
Started |
Started container authorino | |
kuadrant-system |
kubelet |
limitador-limitador-64c8f475fb-lhq28 |
Created |
Created container: limitador | |
kuadrant-system |
kubelet |
authorino-79cbc94b89-qkxtz |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c2208382e16c501e4ed58aea83f54d108567f36853cf79f7ffdf8ee54ff4ace8" in 2.696s (2.696s including waiting). Image size: 199256829 bytes. | |
kuadrant-system |
kubelet |
limitador-limitador-64c8f475fb-lhq28 |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/limitador-rhel9@sha256:43bc4021bb30c7ef305e01c11e22ca5584c7e2c192b4db0a5646f04f715ee3b0" in 3.363s (3.363s including waiting). Image size: 249943843 bytes. | |
kuadrant-system |
kubelet |
limitador-limitador-64c8f475fb-lhq28 |
Started |
Started container limitador | |
kuadrant-system |
kubelet |
authorino-79cbc94b89-qkxtz |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-674b59b84c-55pqx |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c2208382e16c501e4ed58aea83f54d108567f36853cf79f7ffdf8ee54ff4ace8" in 2.874s (2.874s including waiting). Image size: 199256829 bytes. | |
kuadrant-system |
kubelet |
authorino-674b59b84c-55pqx |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-79cbc94b89-qkxtz |
Started |
Started container authorino | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-674b59b84c from 1 to 0 | |
kuadrant-system |
replicaset-controller |
authorino-674b59b84c |
SuccessfulDelete |
Deleted pod: authorino-674b59b84c-55pqx | |
kuadrant-system |
kubelet |
authorino-674b59b84c-55pqx |
Killing |
Stopping container authorino | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
SyncLoadBalancerFailed |
Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: 27eed5e7-9158-4806-8ac8-bd4797bc160b, TooManyLoadBalancers: Exceeded quota of account 590184136207 | |
kuadrant-system |
replicaset-controller |
limitador-limitador-64c8f475fb |
SuccessfulDelete |
Deleted pod: limitador-limitador-64c8f475fb-lhq28 | |
kuadrant-system |
deployment-controller |
limitador-limitador |
ScalingReplicaSet |
Scaled down replica set limitador-limitador-64c8f475fb from 1 to 0 | |
kuadrant-system |
kubelet |
limitador-limitador-64c8f475fb-lhq28 |
Killing |
Stopping container limitador | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled up replica set authorino-68bd676465 from 0 to 1 | |
kuadrant-system |
replicaset-controller |
authorino-68bd676465 |
SuccessfulCreate |
Created pod: authorino-68bd676465-vlxjh | |
kuadrant-system |
kubelet |
authorino-68bd676465-vlxjh |
Pulling |
Pulling image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c2208382e16c501e4ed58aea83f54d108567f36853cf79f7ffdf8ee54ff4ace8" | |
kuadrant-system |
multus |
authorino-68bd676465-vlxjh |
AddedInterface |
Add eth0 [10.134.0.32/23] from ovn-kubernetes | |
kuadrant-system |
replicaset-controller |
authorino-79cbc94b89 |
SuccessfulDelete |
Deleted pod: authorino-79cbc94b89-qkxtz | |
kuadrant-system |
kubelet |
authorino-79cbc94b89-qkxtz |
Killing |
Stopping container authorino | |
kuadrant-system |
deployment-controller |
authorino |
ScalingReplicaSet |
Scaled down replica set authorino-79cbc94b89 from 1 to 0 | |
kuadrant-system |
kubelet |
authorino-68bd676465-vlxjh |
Started |
Started container authorino | |
kuadrant-system |
kubelet |
authorino-68bd676465-vlxjh |
Created |
Created container: authorino | |
kuadrant-system |
kubelet |
authorino-68bd676465-vlxjh |
Pulled |
Successfully pulled image "registry.redhat.io/rhcl-1/authorino-rhel9@sha256:c2208382e16c501e4ed58aea83f54d108567f36853cf79f7ffdf8ee54ff4ace8" in 758ms (758ms including waiting). Image size: 199256829 bytes. | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-55ff986f96 |
SuccessfulCreate |
Created pod: istiod-openshift-gateway-55ff986f96-fjvbp | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled up replica set istiod-openshift-gateway-55ff986f96 from 0 to 1 | |
openshift-ingress |
multus |
istiod-openshift-gateway-55ff986f96-fjvbp |
AddedInterface |
Add eth0 [10.133.0.39/23] from ovn-kubernetes | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-55ff986f96-fjvbp |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-pilot-rhel9@sha256:028e10651db0d1ddb769a27c9483c6d41be6ac597f253afd9d599f395d9c82d8" already present on machine | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-55ff986f96-fjvbp |
Created |
Created container: discovery | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-55ff986f96-fjvbp |
Started |
Started container discovery | |
openshift-ingress |
replicaset-controller |
istiod-openshift-gateway-7cd77c7ffd |
SuccessfulDelete |
Deleted pod: istiod-openshift-gateway-7cd77c7ffd-h4tbj | |
openshift-ingress |
deployment-controller |
istiod-openshift-gateway |
ScalingReplicaSet |
Scaled down replica set istiod-openshift-gateway-7cd77c7ffd from 1 to 0 | |
openshift-ingress |
kubelet |
istiod-openshift-gateway-7cd77c7ffd-h4tbj |
Killing |
Stopping container discovery | |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x4) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: unable to get metrics for resource cpu: no metrics returned from resource metrics API |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedGetResourceMetric |
failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
| (x2) | openshift-ingress |
horizontal-pod-autoscaler |
istiod-openshift-gateway |
FailedComputeMetricsReplicas |
invalid metrics (1 invalid out of 1), first error is: failed to get cpu resource metric value: failed to get cpu utilization: did not receive metrics for targeted pods (pods might be unready) |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
SyncLoadBalancerFailed |
Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: ec2b36e3-7c80-444b-8a37-a4f94440d8fe, TooManyLoadBalancers: Exceeded quota of account 590184136207 | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-1-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-1-openshift-default-6c59fbf55c from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-1-openshift-default-6c59fbf55c |
SuccessfulCreate |
Created pod: router-gateway-1-openshift-default-6c59fbf55c-mqqmd | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-6c59fbf55c-mqqmd |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:d518f3d1539f45e1253c5c9fa22062802804601d4998cd50344e476a3cc388fe" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-6c59fbf55c-mqqmd |
Started |
Started container istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-1-openshift-default-6c59fbf55c-mqqmd |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
multus |
router-gateway-1-openshift-default-6c59fbf55c-mqqmd |
AddedInterface |
Add eth0 [10.133.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
SyncLoadBalancerFailed |
Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: 9fbd8ce6-cf50-44b6-a6fe-e308e344f826, TooManyLoadBalancers: Exceeded quota of account 590184136207 | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-inline-config-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-inline-config-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-inline-config-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-inline-config-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-inline-config-test-epp-rb | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-inline-config-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-inline-config-test-kserve-router-scheduler-d6db7746d from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-78b8847666-26b5f |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" | |
kserve-ci-e2e-test |
multus |
scheduler-inline-config-test-kserve-78b8847666-26b5f |
AddedInterface |
Add eth0 [10.132.0.28/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
SyncLoadBalancerFailed |
Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: 5d2ea1bb-6120-488f-9bb1-6dce0ed0c45b, TooManyLoadBalancers: Exceeded quota of account 590184136207 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-inline-config-test-kserve-78b8847666 |
SuccessfulCreate |
Created pod: scheduler-inline-config-test-kserve-78b8847666-26b5f | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-inline-config-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-inline-config-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-inline-config-test-kserve-router-scheduler-d6db7746d |
SuccessfulCreate |
Created pod: scheduler-inline-config-test-kserve-router-scheduler-d6db7h4vsv | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-inline-config-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-inline-config-test-epp-sa | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-inline-config-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-inline-config-test-kserve-78b8847666 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb | |
kserve-ci-e2e-test |
multus |
scheduler-inline-config-test-kserve-router-scheduler-d6db7h4vsv |
AddedInterface |
Add eth0 [10.133.0.44/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-inline-config-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d6db7h4vsv |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d6db7h4vsv |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-78b8847666-26b5f |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-78b8847666-26b5f |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-78b8847666-26b5f |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" in 4.251s (4.251s including waiting). Image size: 301492151 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d6db7h4vsv |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d6db7h4vsv |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d6db7h4vsv |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" in 3.83s (3.83s including waiting). Image size: 301492151 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d6db7h4vsv |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d6db7h4vsv |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d6db7h4vsv |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d6db7h4vsv |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" in 1.322s (1.322s including waiting). Image size: 87241021 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-78b8847666-26b5f |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-78b8847666-26b5f |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-78b8847666-26b5f |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-78b8847666-26b5f |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.093s (1.093s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
SyncLoadBalancerFailed |
Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: e998fd2e-fbf1-44a6-ba6a-84ae7f8d5792, TooManyLoadBalancers: Exceeded quota of account 590184136207 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve-workload-svc | |
kserve-ci-e2e-test |
deployment-controller |
gw-section-name-router-with-gat-2f0a622e-kserve |
ScalingReplicaSet |
Scaled up replica set gw-section-name-router-with-gat-2f0a622e-kserve-5db5b6c7cc from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-2f0a622e-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
gw-section-name-router-with-gat-2f0a622e-kserve-5db5b6c7cc |
SuccessfulCreate |
Created pod: gw-section-name-router-with-gat-2f0a622e-kserve-5db5b6c7cccrw6r | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-2f0a622e |
Created |
Created v1.Secret kserve-ci-e2e-test/gw-sec0c69dceeb48768325d1a53a749e65786-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-5db5b6c7cccrw6r |
Pulling |
Pulling image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" | |
kserve-ci-e2e-test |
multus |
gw-section-name-router-with-gat-2f0a622e-kserve-5db5b6c7cccrw6r |
AddedInterface |
Add eth0 [10.134.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-5db5b6c7cccrw6r |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-5db5b6c7cccrw6r |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-5db5b6c7cccrw6r |
Pulled |
Successfully pulled image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" in 3.212s (3.212s including waiting). Image size: 301492151 bytes. | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-5db5b6c7cccrw6r |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-5db5b6c7cccrw6r |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.142s (1.142s including waiting). Image size: 98346788 bytes. | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-5db5b6c7cccrw6r |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-5db5b6c7cccrw6r |
Created |
Created container: main | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
SyncLoadBalancerFailed |
Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: 1e12a5f9-f508-4cfb-8bb9-e3ac2aa2cfda, TooManyLoadBalancers: Exceeded quota of account 590184136207 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-inline-config-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d6db7h4vsv |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-2f0a622e-kserve-5db5b6c7cccrw6r |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d6db7h4vsv |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" in 31.261s (31.261s including waiting). Image size: 2907020949 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d6db7h4vsv |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-59f6ff894bf5hzn |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.Deployment kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve | |
kserve-ci-e2e-test |
multus |
gw-section-name-router-with-gat-f1d92d0f-kserve-59f6ff894bf5hzn |
AddedInterface |
Add eth0 [10.134.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-59f6ff894bf5hzn |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.Service kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
gw-section-name-router-with-gat-f1d92d0f-kserve-59f6ff894b |
SuccessfulCreate |
Created pod: gw-section-name-router-with-gat-f1d92d0f-kserve-59f6ff894bf5hzn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.Secret kserve-ci-e2e-test/gw-sec2774c263d49959f50d9eebc552e13bf9-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
gw-section-name-router-with-gat-f1d92d0f |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/gw-section-name-router-with-gat-f1d92d0f-kserve-workload-svc | |
kserve-ci-e2e-test |
deployment-controller |
gw-section-name-router-with-gat-f1d92d0f-kserve |
ScalingReplicaSet |
Scaled up replica set gw-section-name-router-with-gat-f1d92d0f-kserve-59f6ff894b from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-59f6ff894bf5hzn |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
gw-section-name-router-with-gat-f1d92d0f-kserve-59f6ff894bf5hzn |
Killing |
Stopping container storage-initializer | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-69b8c75f54 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-69b8c75f54sbwdk | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvad71fa5348b85aebd404221bba611457-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-69b8c75f54 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-69b8c75f54sbwdk |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-69b8c75f54sbwdk |
AddedInterface |
Add eth0 [10.134.0.35/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-route | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-69b8c75f54sbwdk |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-69b8c75f54sbwdk |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-6fa1027a |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvad71fa5348b85aebd404221bba611457-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-69b8c75f54sbwdk |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-69b8c75f54sbwdk |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-69b8c75f54sbwdk |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
SyncLoadBalancerFailed |
Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: 75a66ffb-d480-41d9-a7ef-c1eda34181a6, TooManyLoadBalancers: Exceeded quota of account 590184136207 | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
SyncLoadBalancerFailed |
Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: ef2cc8f7-92b7-41b0-b9cb-c9e74dd6991f, TooManyLoadBalancers: Exceeded quota of account 590184136207 | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
SyncLoadBalancerFailed |
Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: ba4cf09f-ff4c-4c49-9d80-fde6069456fe, TooManyLoadBalancers: Exceeded quota of account 590184136207 | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
SyncLoadBalancerFailed |
Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: f8f38d42-3462-4938-aa5b-ac227461f574, TooManyLoadBalancers: Exceeded quota of account 590184136207 | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
SyncLoadBalancerFailed |
Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: 84865c1c-04d0-4ee5-8ac9-db875c7d74fb, TooManyLoadBalancers: Exceeded quota of account 590184136207 | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
SyncLoadBalancerFailed |
Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: 800dee4c-fa1f-40a4-8f2c-19c6c1c31470, TooManyLoadBalancers: Exceeded quota of account 590184136207 | |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
SyncLoadBalancerFailed |
Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: 995304fc-8ebc-4a0a-a223-0fe9b527eba0, TooManyLoadBalancers: Exceeded quota of account 590184136207 | |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
SyncLoadBalancerFailed |
Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: daadc52e-d181-40ed-b357-cae19583892c, TooManyLoadBalancers: Exceeded quota of account 590184136207 | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-6fa1027a-kserve-69b8c75f54sbwdk |
Killing |
Stopping container main | |
| (x13) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-d75c5d878-d99kh |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-teste2c0c7deeb42f8b9846a7a45d2caecd2-llmisvc-mode | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-epp-service | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-d75c5d878 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-d75c5d878-d99kh | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisvdde380eaa9fe1facad32d45131f9e34d-kserve-self-signed-certs | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-d75c5d878 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheduler-6b7fdf9d95 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-scheduler-6b7fdf9d95 |
SuccessfulCreate |
Created pod: llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevm82l | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-d75c5d878-d99kh |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-d75c5d878-d99kh |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-d75c5d878-d99kh |
AddedInterface |
Add eth0 [10.134.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevm82l |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevm82l |
AddedInterface |
Add eth0 [10.133.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevm82l |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevm82l |
Started |
Started container storage-initializer | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevm82l |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevm82l |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevm82l |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevm82l |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevm82l |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevm82l |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-d75c5d878-d99kh |
Pulling |
Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisvdde380eaa9fe1facad32d45131f9e34d-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-d75c5d878-d99kh |
Pulled |
Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" in 45.164s (45.164s including waiting). Image size: 3531177328 bytes. | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-d75c5d878-d99kh |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-d75c5d878-d99kh |
Started |
Started container main | |
| (x9) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-d75c5d878-d99kh |
Unhealthy |
Startup probe failed: Get "https://10.134.0.36:8000/health": dial tcp 10.134.0.36:8000: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d6db7h4vsv |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-78b8847666-26b5f |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d6db7h4vsv |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-inline-config-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-inline-config-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-inline-config-test-kserve-router-scheduler-d6db7h4vsv |
Unhealthy |
Readiness probe failed: timeout: failed to connect service "10.133.0.44:9003" within 1s: context deadline exceeded | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-configmap-ref-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-configmap-ref-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-configmap-ref-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-88df5d794-kmp54 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-configmap-ref-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-configmap-ref-test-kserve-router-scheduler-86f46c54b6 from 0 to 1 | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-shadow-svc |
kserve-ci-e2e-test |
multus |
scheduler-configmap-ref-test-kserve-88df5d794-kmp54 |
AddedInterface |
Add eth0 [10.132.0.29/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-88df5d794-kmp54 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-role | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-88df5d794-kmp54 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-configmap-ref-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-workload-svc | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-configmap-ref-test-kserve-88df5d794 |
SuccessfulCreate |
Created pod: scheduler-configmap-ref-test-kserve-88df5d794-kmp54 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-configmap-ref-test-kserve-router-scheduler-86f46c54b6 |
SuccessfulCreate |
Created pod: scheduler-configmap-ref-test-kserve-router-scheduler-86f46sqqjs | |
kserve-ci-e2e-test |
multus |
scheduler-configmap-ref-test-kserve-router-scheduler-86f46sqqjs |
AddedInterface |
Add eth0 [10.133.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-86f46sqqjs |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-86f46sqqjs |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-86f46sqqjs |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-configmap-ref-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-configmap-ref-test-kserve-88df5d794 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-86f46sqqjs |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-86f46sqqjs |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-86f46sqqjs |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-86f46sqqjs |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-86f46sqqjs |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-86f46sqqjs |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-88df5d794-kmp54 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-88df5d794-kmp54 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-88df5d794-kmp54 |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-configmap-ref-test-kserve-self-signed-certs | |
| (x3) | kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
SyncLoadBalancerFailed |
(combined from similar events): Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: 4f40bed6-43ee-431f-911e-2ad5446cefe4, TooManyLoadBalancers: Exceeded quota of account 590184136207 |
| (x4) | openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
SyncLoadBalancerFailed |
(combined from similar events): Error syncing load balancer: failed to ensure load balancer: operation error Elastic Load Balancing: CreateLoadBalancer, https response error StatusCode: 400, RequestID: a0ccc5c7-ba8b-4b4e-80f8-f260475bf9ba, TooManyLoadBalancers: Exceeded quota of account 590184136207 |
| (x13) | kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer |
kserve-ci-e2e-test |
service-controller |
router-gateway-1-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
| (x14) | openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer |
openshift-ingress |
service-controller |
openshift-ai-inference-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevm82l |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvcdde380eaa9fe1facad32d45131f9e34d-kserve-router-schevm82l |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-55f7ae4a |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-teste2c0c7deeb42f8b9846a7a45d2caecd2-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-55f7ae4a-kserve-d75c5d878-d99kh |
Killing |
Stopping container main | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
custom-route-timeout-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-test-kserve-route" not found |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-test-kserve |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-test-kserve-7cc767b4f4 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Role kserve-ci-e2e-test/custom-route-timeout-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-test-epp-sa | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-test-kserve-7cc767b4f4 |
SuccessfulCreate |
Created pod: custom-route-timeout-test-kserve-7cc767b4f4-wpnr2 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-test-kserve-7cc767b4f4-wpnr2 |
AddedInterface |
Add eth0 [10.134.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-test-kserve-router-scheduler-7fccfb7cpgx66 |
AddedInterface |
Add eth0 [10.133.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7fccfb7cpgx66 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7fccfb7cpgx66 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7fccfb7cpgx66 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-test-kserve-router-scheduler-7fccfb7cd5 |
SuccessfulCreate |
Created pod: custom-route-timeout-test-kserve-router-scheduler-7fccfb7cpgx66 | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-7cc767b4f4-wpnr2 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-test-epp-rb | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-test-kserve-router-scheduler-7fccfb7cd5 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-7cc767b4f4-wpnr2 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-7cc767b4f4-wpnr2 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7fccfb7cpgx66 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7fccfb7cpgx66 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7fccfb7cpgx66 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7fccfb7cpgx66 |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7fccfb7cpgx66 |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7fccfb7cpgx66 |
Created |
Created container: main | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-test-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-88df5d794-kmp54 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-configmap-ref-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-configmap-ref-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-86f46sqqjs |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-configmap-ref-test-kserve-router-scheduler-86f46sqqjs |
Killing |
Stopping container main | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
scheduler-ha-replicas-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy scheduler-ha-replicas-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "scheduler-ha-replicas-test-kserve-route" not found |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-554847cfc4-8zh9q |
AddedInterface |
Add eth0 [10.132.0.30/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Role kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-554847cfc4 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-554847cfc4-8zh9q | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59888 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59sszp2 | |
kserve-ci-e2e-test |
replicaset-controller |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59888 |
SuccessfulCreate |
Created pod: scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59lqc2s | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
Created v1.Service kserve-ci-e2e-test/scheduler-ha-replicas-test-epp-service | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-ha-replicas-test-kserve |
ScalingReplicaSet |
Scaled up replica set scheduler-ha-replicas-test-kserve-554847cfc4 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
scheduler-ha-replicas-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59888 from 0 to 2 | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59sszp2 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59lqc2s |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-554847cfc4-8zh9q |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59sszp2 |
AddedInterface |
Add eth0 [10.133.0.48/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59sszp2 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59sszp2 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59lqc2s |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-554847cfc4-8zh9q |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-554847cfc4-8zh9q |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59lqc2s |
AddedInterface |
Add eth0 [10.132.0.31/23] from ovn-kubernetes | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59lqc2s |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59sszp2 |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59sszp2 |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59lqc2s |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59sszp2 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59sszp2 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59sszp2 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59sszp2 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-554847cfc4-8zh9q |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-554847cfc4-8zh9q |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-554847cfc4-8zh9q |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59lqc2s |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59lqc2s |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59lqc2s |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" in 9.062s (9.062s including waiting). Image size: 87241021 bytes. | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59lqc2s |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/scheduler-ha-replicas-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59sszp2 |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59sszp2 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
scheduler-ha-replicas-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-scheduler-ha-replicas-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-554847cfc4-8zh9q |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-554847cfc4-8zh9q |
Unhealthy |
Readiness probe failed: Get "https://10.132.0.30:8000/health": dial tcp 10.132.0.30:8000: connect: connection refused | |
kserve-ci-e2e-test |
deployment-controller |
precise-prefix-cache-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set precise-prefix-cache-test-kserve-router-scheduler-55c45dd7bd from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
precise-prefix-cache-test-kserve |
ScalingReplicaSet |
Scaled up replica set precise-prefix-cache-test-kserve-65747bccd4 from 0 to 2 | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-65747bccd4 |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-65747bccd4-b5kpp | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-65747bccd4 |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-65747bccd4-kk5ht | |
kserve-ci-e2e-test |
replicaset-controller |
precise-prefix-cache-test-kserve-router-scheduler-55c45dd7bd |
SuccessfulCreate |
Created pod: precise-prefix-cache-test-kserve-router-scheduler-55c45dd7scpbh | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
precise-prefix-cache-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy precise-prefix-cache-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/precise-prefix-cache-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "precise-prefix-cache-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/precise-prefix-cache-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Role kserve-ci-e2e-test/precise-prefix-cache-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/precise-prefix-cache-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/precise-prefix-cache-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-65747bccd4-kk5ht |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-65747bccd4-kk5ht |
Created |
Created container: storage-initializer | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/precise-prefix-cache-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-65747bccd4-kk5ht |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-55c45dd7scpbh |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-65747bccd4-kk5ht |
AddedInterface |
Add eth0 [10.134.0.38/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Created |
Created v1.Service kserve-ci-e2e-test/precise-prefix-cache-test-epp-service | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-55c45dd7scpbh |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-55c45dd7scpbh |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-router-scheduler-55c45dd7scpbh |
AddedInterface |
Add eth0 [10.133.0.49/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-55c45dd7scpbh |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-55c45dd7scpbh |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-55c45dd7scpbh |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-55c45dd7scpbh |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-55c45dd7scpbh |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-55c45dd7scpbh |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59lqc2s |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" in 35.557s (35.557s including waiting). Image size: 2907020949 bytes. | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-65747bccd4-b5kpp |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59lqc2s |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59lqc2s |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
multus |
precise-prefix-cache-test-kserve-65747bccd4-b5kpp |
AddedInterface |
Add eth0 [10.132.0.32/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-65747bccd4-b5kpp |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-65747bccd4-b5kpp |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59lqc2s |
Unhealthy |
Readiness probe failed: service unhealthy (responded with "NOT_SERVING") | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59lqc2s |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59lqc2s |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-65747bccd4-kk5ht |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-65747bccd4-kk5ht |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-65747bccd4-kk5ht |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-65747bccd4-b5kpp |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-65747bccd4-b5kpp |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-65747bccd4-b5kpp |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" already present on machine | |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/precise-prefix-cache-test-kserve-self-signed-certs |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-7cc767b4f4-wpnr2 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-7cc767b4f4-wpnr2 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-7cc767b4f4-wpnr2 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
| (x2) | kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-55c45dd7scpbh |
Unhealthy |
Liveness probe failed: timeout: failed to connect service "10.133.0.49:9003" within 1s: context deadline exceeded |
kserve-ci-e2e-test |
LLMInferenceServiceController |
precise-prefix-cache-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-precise-prefix-cache-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-65747bccd4-b5kpp |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-65747bccd4-kk5ht |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-55c45dd7scpbh |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
precise-prefix-cache-test-kserve-router-scheduler-55c45dd7scpbh |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
conv-test-round-trip |
Error |
Reconciliation failed: failed to combine base-configurations: failed to get LLMInferenceServiceConfig "conv-test-round-trip-config" from namespaces ["kserve-ci-e2e-test", "kserve"]: LLMInferenceServiceConfig.serving.kserve.io "conv-test-round-trip-config" not found | |
| (x3) | kserve-ci-e2e-test |
kubelet |
scheduler-ha-replicas-test-kserve-router-scheduler-57f8f59lqc2s |
Unhealthy |
Readiness probe failed: timeout: failed to connect service "10.132.0.31:9003" within 1s: context deadline exceeded |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Role kserve-ci-e2e-test/stop-feature-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/stop-feature-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-router-scheduler-d547597f from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-b8c47cf74 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-b8c47cf74 |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-b8c47cf74-d8fqg | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-router-scheduler-d547597f |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-router-scheduler-d547597f-fs6kk | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-stop-feature-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
Created v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-b8c47cf74-d8fqg |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-b8c47cf74-d8fqg |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-b8c47cf74-d8fqg |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-router-scheduler-d547597f-fs6kk |
AddedInterface |
Add eth0 [10.132.0.33/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-fs6kk |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-b8c47cf74-d8fqg |
AddedInterface |
Add eth0 [10.134.0.39/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-fs6kk |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-fs6kk |
Started |
Started container storage-initializer | |
| (x6) | kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/stop-feature-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-fs6kk |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-fs6kk |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-fs6kk |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-fs6kk |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-fs6kk |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-fs6kk |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-b8c47cf74-d8fqg |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-b8c47cf74-d8fqg |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-b8c47cf74-d8fqg |
Started |
Started container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
| (x11) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-7cc767b4f4-wpnr2 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.37:8000/health": dial tcp 10.134.0.37:8000: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7fccfb7cpgx66 |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-router-scheduler-7fccfb7cpgx66 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-test-kserve-7cc767b4f4-wpnr2 |
Killing |
Stopping container main | |
| (x4) | kserve-ci-e2e-test |
gateway_labeler_controller |
router-gateway-1 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway router-gateway-1 |
| (x11) | kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-b8c47cf74-d8fqg |
Unhealthy |
Startup probe failed: Get "https://10.134.0.39:8000/health": dial tcp 10.134.0.39:8000: connect: connection refused |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set router-with-refs-test-kserve-router-scheduler-69f799fd49 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-test-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Role kserve-ci-e2e-test/router-with-refs-test-epp-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-test-kserve | |
kserve-ci-e2e-test |
multus |
router-with-refs-test-kserve-c74cb6db6-m7zsv |
AddedInterface |
Add eth0 [10.134.0.40/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-c74cb6db6-m7zsv |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-test-kserve-c74cb6db6 |
SuccessfulCreate |
Created pod: router-with-refs-test-kserve-c74cb6db6-m7zsv | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-test-kserve-router-scheduler-69f799fd49 |
SuccessfulCreate |
Created pod: router-with-refs-test-kserve-router-scheduler-69f799fd49-2gjfr | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-test-kserve |
ScalingReplicaSet |
Scaled up replica set router-with-refs-test-kserve-c74cb6db6 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-c74cb6db6-m7zsv |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-c74cb6db6-m7zsv |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
Created v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-69f799fd49-2gjfr |
Created |
Created container: storage-initializer | |
| (x5) | kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-test-kserve-shadow-svc |
kserve-ci-e2e-test |
multus |
router-with-refs-test-kserve-router-scheduler-69f799fd49-2gjfr |
AddedInterface |
Add eth0 [10.133.0.50/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-69f799fd49-2gjfr |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-69f799fd49-2gjfr |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-69f799fd49-2gjfr |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-69f799fd49-2gjfr |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-69f799fd49-2gjfr |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-69f799fd49-2gjfr |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-69f799fd49-2gjfr |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-69f799fd49-2gjfr |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/router-with-refs-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-fs6kk |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-b8c47cf74-d8fqg |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-fs6kk |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Secret kserve-ci-e2e-test/stop-feature-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.ServiceAccount kserve-ci-e2e-test/stop-feature-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Deployment kserve-ci-e2e-test/stop-feature-test-kserve-router-scheduler | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1alpha2.InferencePool kserve-ci-e2e-test/stop-feature-test-inference-pool | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.InferencePool kserve-ci-e2e-test/stop-feature-test-inference-pool | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.Service kserve-ci-e2e-test/stop-feature-test-epp-service | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
Deleted v1.HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-c74cb6db6-m7zsv |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-c74cb6db6-m7zsv |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-c74cb6db6-m7zsv |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
| (x24) | kserve-ci-e2e-test |
OpenDataHubModelController |
stop-feature-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy stop-feature-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/stop-feature-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "stop-feature-test-kserve-route" not found |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-b8c47cf74-mvwrt |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-zmfgs |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-b8c47cf74 |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-b8c47cf74-mvwrt | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-router-scheduler-d547597f-zmfgs |
AddedInterface |
Add eth0 [10.132.0.34/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-zmfgs |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-b8c47cf74-mvwrt |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-b8c47cf74-mvwrt |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
multus |
stop-feature-test-kserve-b8c47cf74-mvwrt |
AddedInterface |
Add eth0 [10.134.0.41/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-zmfgs |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
replicaset-controller |
stop-feature-test-kserve-router-scheduler-d547597f |
SuccessfulCreate |
Created pod: stop-feature-test-kserve-router-scheduler-d547597f-zmfgs | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-router-scheduler-d547597f from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
stop-feature-test-kserve |
ScalingReplicaSet |
Scaled up replica set stop-feature-test-kserve-b8c47cf74 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-zmfgs |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-zmfgs |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-zmfgs |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-zmfgs |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-zmfgs |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-zmfgs |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-b8c47cf74-mvwrt |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-b8c47cf74-mvwrt |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-b8c47cf74-mvwrt |
Started |
Started container main | |
| (x11) | kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-c74cb6db6-m7zsv |
Unhealthy |
Startup probe failed: Get "https://10.134.0.40:8000/health": dial tcp 10.134.0.40:8000: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-69f799fd49-2gjfr |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-router-scheduler-69f799fd49-2gjfr |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-test-kserve-c74cb6db6-m7zsv |
Killing |
Stopping container main | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-route" not found |
| (x12) | kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-b8c47cf74-mvwrt |
Unhealthy |
Startup probe failed: Get "https://10.134.0.41:8000/health": dial tcp 10.134.0.41:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-role | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv8f1a6f044e8c7a4d31a250e0c4861caf-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-84pljnr |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-f84cb79f7-tppf9 |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.7.1" | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-84pljnr |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-84cb6847f4 from 0 to 1 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-f84cb79f7 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-84cb6847f4 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-84pljnr | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-f84cb79f7-tppf9 |
AddedInterface |
Add eth0 [10.134.0.42/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test4ce8108fb3d8aff064c322bee6e173f5-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-84pljnr |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-f84cb79f7 |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-f84cb79f7-tppf9 | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-84pljnr |
AddedInterface |
Add eth0 [10.134.0.43/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scheduler-6cb4fbf4b7 |
SuccessfulCreate |
Created pod: llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherzz78 | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scheduler-6cb4fbf4b7 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-f84cb79f7-tppf9 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherzz78 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherzz78 |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherzz78 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-f84cb79f7-tppf9 |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.7.1" in 814ms (814ms including waiting). Image size: 67767940 bytes. | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-f84cb79f7-tppf9 |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-f84cb79f7-tppf9 |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-f84cb79f7-tppf9 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-f84cb79f7-tppf9 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherzz78 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherzz78 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherzz78 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherzz78 |
AddedInterface |
Add eth0 [10.133.0.51/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherzz78 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherzz78 |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherzz78 |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-84pljnr |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-84pljnr |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-84pljnr |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-f84cb79f7-tppf9 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-f84cb79f7-tppf9 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-f84cb79f7-tppf9 |
Started |
Started container main | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-shadow-svc |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv8f1a6f044e8c7a4d31a250e0c4861caf-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-zmfgs |
Killing |
Stopping container tokenizer | |
| (x4) | kserve-ci-e2e-test |
LLMInferenceServiceController |
stop-feature-test |
Deleted |
(combined from similar events): Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-stop-feature-test-epp-auth-rb |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-router-scheduler-d547597f-zmfgs |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
stop-feature-test-kserve-b8c47cf74-mvwrt |
Killing |
Stopping container main | |
| (x10) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
Created |
Created v1.HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-route | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-workload-svc | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve |
ScalingReplicaSet |
Scaled up replica set llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-6d59c9877d from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-6d59c9877d |
SuccessfulCreate |
Created pod: llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-6d59c9877dfckvg | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
Created |
Created v1.Deployment kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
Created |
Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv8de1d74aab16d9cabd8b5aafeb5248e8-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-6d59c9877dfckvg |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-6d59c9877dfckvg |
AddedInterface |
Add eth0 [10.134.0.44/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-6d59c9877dfckvg |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-6d59c9877dfckvg |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-02ac88e7 |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv8de1d74aab16d9cabd8b5aafeb5248e8-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-6d59c9877dfckvg |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-6d59c9877dfckvg |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-6d59c9877dfckvg |
Created |
Created container: main | |
| (x14) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-84pljnr |
Unhealthy |
Startup probe failed: Get "https://10.134.0.43:8000/health": dial tcp 10.134.0.43:8000: connect: connection refused |
| (x14) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-f84cb79f7-tppf9 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.42:8001/health": dial tcp 10.134.0.42:8001: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherzz78 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-f84cb79f7-tppf9 |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-f84cb79f7-tppf9 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-05aa9bba-kserve-prefill-84pljnr |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc8f1a6f044e8c7a4d31a250e0c4861caf-kserve-router-scherzz78 |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-05aa9bba |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test4ce8108fb3d8aff064c322bee6e173f5-llmisvc-mode | |
| (x12) | kserve-ci-e2e-test |
OpenDataHubModelController |
custom-route-timeout-pd-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy custom-route-timeout-pd-test-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-route: HTTPRoute.gateway.networking.k8s.io "custom-route-timeout-pd-test-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Role kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-role | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-5cd8c8d959-p7545 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-5cd8c8d959-p7545 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-5cd8c8d959-p7545 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-prefill-5cd8c8d959-p7545 |
AddedInterface |
Add eth0 [10.134.0.46/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-6f974f4c44 |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-6f974f4c44-cwjhg | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Service kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-rb | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-prefill-5cd8c8d959 |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-prefill-5cd8c8d959-p7545 | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-prefill-5cd8c8d959 from 0 to 1 | |
kserve-ci-e2e-test |
replicaset-controller |
custom-route-timeout-pd-test-kserve-router-scheduler-85998678c6 |
SuccessfulCreate |
Created pod: custom-route-timeout-pd-test-kserve-router-scheduler-85998xvffb | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f974f4c44-cwjhg |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f974f4c44-cwjhg |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f974f4c44-cwjhg |
Pulled |
Container image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-router-scheduler-85998678c6 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve | |
kserve-ci-e2e-test |
deployment-controller |
custom-route-timeout-pd-test-kserve |
ScalingReplicaSet |
Scaled up replica set custom-route-timeout-pd-test-kserve-6f974f4c44 from 0 to 1 | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-6f974f4c44-cwjhg |
AddedInterface |
Add eth0 [10.134.0.45/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-85998xvffb |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-85998xvffb |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
multus |
custom-route-timeout-pd-test-kserve-router-scheduler-85998xvffb |
AddedInterface |
Add eth0 [10.132.0.36/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-85998xvffb |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-85998xvffb |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-85998xvffb |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-85998xvffb |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f974f4c44-cwjhg |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f974f4c44-cwjhg |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
| (x10) | kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f974f4c44-cwjhg |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-85998xvffb |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-85998xvffb |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-85998xvffb |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f974f4c44-cwjhg |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f974f4c44-cwjhg |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f974f4c44-cwjhg |
Created |
Created container: main | |
| (x11) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-6d59c9877dfckvg |
Unhealthy |
Startup probe failed: Get "https://10.134.0.44:8000/health": dial tcp 10.134.0.44:8000: connect: connection refused |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/custom-route-timeout-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-02ac88e7-kserve-6d59c9877dfckvg |
Killing |
Stopping container main | |
| (x11) | kserve-ci-e2e-test |
OpenDataHubModelController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to get HTTPRoute for AuthPolicy llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-route-authn: failed to get HTTPRoute kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-route: HTTPRoute.gateway.networking.k8s.io "llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-route" not found |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.Secret kserve-ci-e2e-test/llmisv4e643bc258191ffc517a31cd1d0ddd27-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-scc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn |
CreatingRevision |
Creating revision with key 7dddf75df4 for a newly created LeaderWorkerSet | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedlwqk |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
SuccessfulCreate |
create Pod llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 in StatefulSet llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 successful | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
AddedInterface |
Add eth0 [10.134.0.47/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
multus |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
AddedInterface |
Add eth0 [10.133.0.52/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-epp-rb | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-epp-sa | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedlwqk |
AddedInterface |
Add eth0 [10.133.0.53/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.Role kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-epp-role | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedlwqk |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedlwqk |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-testc9aefdf01a18c3acb55ce247710ebb71-llmisvc-mode | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn |
GroupsProgressing |
Created leader statefulset llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn |
GroupsProgressing |
Replicas are progressing, with 0 groups ready of total 1 groups | |
kserve-ci-e2e-test |
statefulset-controller |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn |
SuccessfulCreate |
create Pod llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 in StatefulSet llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn successful | |
kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn |
GroupsProgressing |
Created worker statefulset for leader pod llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 | |
kserve-ci-e2e-test |
replicaset-controller |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheduler-6fb4d44b8f |
SuccessfulCreate |
Created pod: llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedlwqk | |
kserve-ci-e2e-test |
deployment-controller |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-scheduler-6fb4d44b8f from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.LeaderWorkerSet kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
Created v1.Service kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-workload-svc | |
| (x8) | kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-shadow-svc |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedlwqk |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedlwqk |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedlwqk |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedlwqk |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedlwqk |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedlwqk |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Created |
Created container: main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Updated |
Updated v1.Secret kserve-ci-e2e-test/llmisv4e643bc258191ffc517a31cd1d0ddd27-kserve-self-signed-certs | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-5cd8c8d959-p7545 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-5cd8c8d959-p7545 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-5cd8c8d959-p7545 |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Pulling |
Pulling image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" | |
| (x10) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f974f4c44-cwjhg |
Unhealthy |
Startup probe failed: Get "https://10.134.0.45:8001/health": dial tcp 10.134.0.45:8001: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Pulled |
Successfully pulled image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" in 27.128s (27.128s including waiting). Image size: 3531177328 bytes. | |
| (x10) | kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.47:8000/health": dial tcp 10.134.0.47:8000: connect: connection refused |
| (x2) | kserve-ci-e2e-test |
leaderworkerset |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn |
AllGroupsReady |
All replicas are ready, with 1 groups ready of total 1 groups |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedlwqk |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
llmisvc-model-fb-opt-125m-route-f312f5ec |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-testc9aefdf01a18c3acb55ce247710ebb71-llmisvc-mode | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedlwqk |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
llmisvc4e643bc258191ffc517a31cd1d0ddd27-kserve-router-schedlwqk |
Unhealthy |
Readiness probe failed: timeout: failed to connect service "10.133.0.53:9003" within 1s: context deadline exceeded | |
kserve-ci-e2e-test |
kubelet |
llmisvc-model-fb-opt-125m-route-f312f5ec-kserve-mn-0-1 |
Killing |
Stopping container main | |
| (x10) | kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-5cd8c8d959-p7545 |
Unhealthy |
Startup probe failed: Get "https://10.134.0.46:8000/health": dial tcp 10.134.0.46:8000: connect: connection refused |
kserve-ci-e2e-test |
replicaset-controller |
router-gateway-2-openshift-default-6866b85949 |
SuccessfulCreate |
Created pod: router-gateway-2-openshift-default-6866b85949-kqbbn | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-prefill-5cd8c8d959-p7545 |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f974f4c44-cwjhg |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-85998xvffb |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
custom-route-timeout-pd-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-custom-route-timeout-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
deployment-controller |
router-gateway-2-openshift-default |
ScalingReplicaSet |
Scaled up replica set router-gateway-2-openshift-default-6866b85949 from 0 to 1 | |
kserve-ci-e2e-test |
service-controller |
router-gateway-2-openshift-default |
EnsuringLoadBalancer |
Ensuring load balancer | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-85998xvffb |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
gateway_labeler_controller |
router-gateway-2 |
AddedLabel |
Added label istio.io/rev=openshift-gateway to gateway router-gateway-2 | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-6f974f4c44-cwjhg |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
multus |
router-gateway-2-openshift-default-6866b85949-kqbbn |
AddedInterface |
Add eth0 [10.133.0.54/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
OpenDataHubModelController |
router-with-refs-pd-test |
ReconcileError |
Failed to reconcile LLMInferenceService: 1 error occurred: * failed to create HTTPRoute AuthPolicy router-route-4-authn: could not CREATE AuthPolicy kserve-ci-e2e-test/router-route-4-authn: authpolicies.kuadrant.io "router-route-4-authn" already exists | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-6866b85949-kqbbn |
Created |
Created container: istio-proxy | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-6866b85949-kqbbn |
Pulled |
Container image "registry.redhat.io/openshift-service-mesh/istio-proxyv2-rhel9@sha256:d518f3d1539f45e1253c5c9fa22062802804601d4998cd50344e476a3cc388fe" already present on machine | |
kserve-ci-e2e-test |
kubelet |
custom-route-timeout-pd-test-kserve-router-scheduler-85998xvffb |
Unhealthy |
Readiness probe failed: timeout: failed to connect service "10.132.0.36:9003" within 1s: context deadline exceeded | |
kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-6866b85949-kqbbn |
Started |
Started container istio-proxy | |
| (x2) | kserve-ci-e2e-test |
kubelet |
router-gateway-2-openshift-default-6866b85949-kqbbn |
Unhealthy |
Startup probe failed: Get "http://10.133.0.54:15021/healthz/ready": dial tcp 10.133.0.54:15021: connect: connection refused |
kserve-ci-e2e-test |
service-controller |
router-gateway-2-openshift-default |
EnsuredLoadBalancer |
Ensured load balancer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Role kserve-ci-e2e-test/router-with-refs-pd-test-kserve-role | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve-prefill |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-prefill-7d9f7645f from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-epp-sa | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Service kserve-ci-e2e-test/router-with-refs-pd-test-kserve-workload-svc | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve-prefill | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Deployment kserve-ci-e2e-test/router-with-refs-pd-test-kserve | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-d9f6bb5b8 |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-d9f6bb5b8-pckhm | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-prefill-7d9f7645f |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-prefill-7d9f7645f-glgwk | |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-d9f6bb5b8 from 0 to 1 | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ServiceAccount kserve-ci-e2e-test/router-with-refs-pd-test-kserve | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.RoleBinding kserve-ci-e2e-test/router-with-refs-pd-test-kserve-rb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-7d9f7645f-glgwk |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-7d9f7645f-glgwk |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-d9f6bb5b8-pckhm |
AddedInterface |
Add eth0 [10.133.0.55/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-d9f6bb5b8-pckhm |
Pulling |
Pulling image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.7.1" | |
| (x9) | kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
(combined from similar events): Created v1.DestinationRule kserve-ci-e2e-test/router-with-refs-pd-test-kserve-shadow-svc |
kserve-ci-e2e-test |
deployment-controller |
router-with-refs-pd-test-kserve-router-scheduler |
ScalingReplicaSet |
Scaled up replica set router-with-refs-pd-test-kserve-router-scheduler-668db9fc84 from 0 to 1 | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-7d9f7645f-glgwk |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-prefill-7d9f7645f-glgwk |
AddedInterface |
Add eth0 [10.133.0.56/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Created |
Created v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
replicaset-controller |
router-with-refs-pd-test-kserve-router-scheduler-668db9fc84 |
SuccessfulCreate |
Created pod: router-with-refs-pd-test-kserve-router-scheduler-668db9fc8bmjbq | |
kserve-ci-e2e-test |
multus |
router-with-refs-pd-test-kserve-router-scheduler-668db9fc8bmjbq |
AddedInterface |
Add eth0 [10.132.0.37/23] from ovn-kubernetes | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-d9f6bb5b8-pckhm |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-668db9fc8bmjbq |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-668db9fc8bmjbq |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-668db9fc8bmjbq |
Pulled |
Container image "quay.io/opendatahub/kserve-storage-initializer@sha256:48bcc0e7da25ba7560a82df7216c0ad464b268d851c665b85b9195165f27b89d" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-d9f6bb5b8-pckhm |
Pulled |
Successfully pulled image "ghcr.io/llm-d/llm-d-routing-sidecar:v0.7.1" in 928ms (928ms including waiting). Image size: 67767940 bytes. | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-d9f6bb5b8-pckhm |
Created |
Created container: llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-d9f6bb5b8-pckhm |
Started |
Started container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-d9f6bb5b8-pckhm |
Created |
Created container: storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-d9f6bb5b8-pckhm |
Started |
Started container storage-initializer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-668db9fc8bmjbq |
Started |
Started container tokenizer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-668db9fc8bmjbq |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-668db9fc8bmjbq |
Created |
Created container: tokenizer | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-668db9fc8bmjbq |
Pulled |
Container image "ghcr.io/llm-d/llm-d-inference-scheduler:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-668db9fc8bmjbq |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-668db9fc8bmjbq |
Pulled |
Container image "ghcr.io/llm-d/llm-d-uds-tokenizer:v0.7.1" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-7d9f7645f-glgwk |
Started |
Started container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-7d9f7645f-glgwk |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-7d9f7645f-glgwk |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-d9f6bb5b8-pckhm |
Pulled |
Container image "public.ecr.aws/q9t5s3a7/vllm-cpu-release-repo:v0.19.0" already present on machine | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-d9f6bb5b8-pckhm |
Created |
Created container: main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-d9f6bb5b8-pckhm |
Started |
Started container main | |
| (x2) | kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Updated |
Updated v1.Secret kserve-ci-e2e-test/router-with-refs-pd-test-kserve-self-signed-certs |
| (x14) | kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-7d9f7645f-glgwk |
Unhealthy |
Startup probe failed: Get "https://10.133.0.56:8000/health": dial tcp 10.133.0.56:8000: connect: connection refused |
| (x14) | kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-d9f6bb5b8-pckhm |
Unhealthy |
Startup probe failed: Get "https://10.133.0.55:8001/health": dial tcp 10.133.0.55:8001: connect: connection refused |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-d9f6bb5b8-pckhm |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-d9f6bb5b8-pckhm |
Killing |
Stopping container llm-d-routing-sidecar | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-668db9fc8bmjbq |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-prefill-7d9f7645f-glgwk |
Killing |
Stopping container main | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-668db9fc8bmjbq |
Killing |
Stopping container tokenizer | |
kserve-ci-e2e-test |
LLMInferenceServiceController |
router-with-refs-pd-test |
Deleted |
Deleted v1.ClusterRoleBinding /kserve-ci-e2e-test-router-with-refs-pd-test-epp-auth-rb | |
kserve-ci-e2e-test |
kubelet |
router-with-refs-pd-test-kserve-router-scheduler-668db9fc8bmjbq |
Unhealthy |
Readiness probe failed: timeout: failed to connect service "10.132.0.37:9003" within 1s: context deadline exceeded |