=== events in llm (2026-10-30T20:23:59Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 3m55s Warning ModelNameConflict maasmodelref/e2e-same-id-b-376d5a58 Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-376d5a58 24m Normal Scheduled pod/e2e-trlp-test-simulated-kserve-69b588897d-f4snn Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-f4snn to ip-10-0-132-173.ec2.internal 24m Normal Scheduled pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xhhj2 Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xhhj2 to ip-10-0-132-173.ec2.internal 3m55s Warning ModelNameConflict maasmodelref/e2e-same-id-a-376d5a58 Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-376d5a58 4m16s Normal Scheduled pod/e2e-same-id-b-376d5a58-kserve-85c9b7d7df-jwnct Successfully assigned llm/e2e-same-id-b-376d5a58-kserve-85c9b7d7df-jwnct to ip-10-0-142-168.ec2.internal 24m Normal Scheduled pod/e2e-distinct-2-simulated-kserve-cbd4f5586-svmf9 Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-svmf9 to ip-10-0-132-173.ec2.internal 24m Normal Scheduled pod/e2e-embedding-simulated-kserve-67bf594cd6-wtlm7 Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-wtlm7 to ip-10-0-132-173.ec2.internal 24m Normal Scheduled pod/facebook-opt-125m-simulated-kserve-84b4ff656c-vwndz Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-vwndz to ip-10-0-142-168.ec2.internal 4m32s Normal Scheduled pod/e2e-same-id-a-376d5a58-kserve-7bd9c8b45-kbvj9 Successfully assigned llm/e2e-same-id-a-376d5a58-kserve-7bd9c8b45-kbvj9 to ip-10-0-142-168.ec2.internal 24m Normal Scheduled pod/e2e-distinct-simulated-kserve-7b998b79d9-j9kd2 Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-j9kd2 to ip-10-0-142-168.ec2.internal 3m40s Normal ModelNameConflictResolved maasmodelref/e2e-same-id-b-376d5a58 Model identity is no longer shared with any other MaaSModelRef in this namespace 24m Normal Scheduled pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8sc2p6 Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8sc2p6 to ip-10-0-142-168.ec2.internal 24m Normal SuccessfulCreate replicaset/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8sc2p6 24m Normal ScalingReplicaSet deployment/e2e-unconfigured-facebook-opt-125m-simulated-kserve Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1 24m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs 24m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve 24m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc 24m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route 24m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc 24m Normal Pulling pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8sc2p6 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 24m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default 24m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping 24m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine 24m Normal AddedInterface pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8sc2p6 Add eth0 [10.133.0.31/23] from ovn-kubernetes 24m Normal SuccessfulCreate replicaset/facebook-opt-125m-simulated-kserve-84b4ff656c Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-vwndz 24m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Deployment llm/facebook-opt-125m-simulated-kserve 24m Normal Started pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8sc2p6 Container started 24m Normal Created pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8sc2p6 Container created 24m Normal Pulled pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8sc2p6 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.154s (1.154s including waiting). Image size: 98346788 bytes. 24m Normal ScalingReplicaSet deployment/facebook-opt-125m-simulated-kserve Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1 24m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs 24m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc 24m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route 24m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc 24m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine 24m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default 24m Normal Started pod/facebook-opt-125m-simulated-kserve-84b4ff656c-vwndz Container started 24m Normal AddedInterface pod/facebook-opt-125m-simulated-kserve-84b4ff656c-vwndz Add eth0 [10.133.0.32/23] from ovn-kubernetes 24m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping 24m Normal Pulling pod/facebook-opt-125m-simulated-kserve-84b4ff656c-vwndz Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 24m Normal Pulled pod/facebook-opt-125m-simulated-kserve-84b4ff656c-vwndz Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 185ms (185ms including waiting). Image size: 98346788 bytes. 24m Normal Created pod/facebook-opt-125m-simulated-kserve-84b4ff656c-vwndz Container created 24m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route 24m Normal AddedInterface pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xhhj2 Add eth0 [10.132.0.45/23] from ovn-kubernetes 24m Normal SuccessfulCreate replicaset/premium-simulated-simulated-premium-kserve-5f5c4b459f Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-xhhj2 24m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping 24m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine 24m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default 24m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc 24m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Deployment llm/premium-simulated-simulated-premium-kserve 24m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc 24m Normal ScalingReplicaSet deployment/premium-simulated-simulated-premium-kserve Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1 24m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs 24m Normal Pulling pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xhhj2 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 24m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Deployment llm/e2e-distinct-2-simulated-kserve 24m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default 24m Normal Created pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xhhj2 Container created 24m Normal Pulled pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xhhj2 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.038s (1.038s including waiting). Image size: 98346788 bytes. 24m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping 24m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine 24m Normal SuccessfulCreate replicaset/e2e-distinct-2-simulated-kserve-cbd4f5586 Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-svmf9 24m Normal ScalingReplicaSet deployment/e2e-distinct-2-simulated-kserve Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1 24m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs 24m Normal Started pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xhhj2 Container started 24m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc 24m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route 24m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc 24m Normal Created pod/e2e-distinct-2-simulated-kserve-cbd4f5586-svmf9 Container created 24m Normal AddedInterface pod/e2e-distinct-2-simulated-kserve-cbd4f5586-svmf9 Add eth0 [10.132.0.46/23] from ovn-kubernetes 24m Normal Started pod/e2e-distinct-2-simulated-kserve-cbd4f5586-svmf9 Container started 24m Normal Pulling pod/e2e-distinct-2-simulated-kserve-cbd4f5586-svmf9 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 24m Normal Pulled pod/e2e-distinct-2-simulated-kserve-cbd4f5586-svmf9 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 184ms (184ms including waiting). Image size: 98346788 bytes. 24m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine 24m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Deployment llm/e2e-distinct-simulated-kserve 24m Normal AddedInterface pod/e2e-distinct-simulated-kserve-7b998b79d9-j9kd2 Add eth0 [10.133.0.34/23] from ovn-kubernetes 24m Normal Pulling pod/e2e-distinct-simulated-kserve-7b998b79d9-j9kd2 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 24m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default 24m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc 24m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route 24m Normal SuccessfulCreate replicaset/e2e-distinct-simulated-kserve-7b998b79d9 Created pod: e2e-distinct-simulated-kserve-7b998b79d9-j9kd2 24m Normal ScalingReplicaSet deployment/e2e-distinct-simulated-kserve Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1 24m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs 24m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping 24m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc 24m Normal Started pod/e2e-distinct-simulated-kserve-7b998b79d9-j9kd2 Container started 24m Normal Created pod/e2e-distinct-simulated-kserve-7b998b79d9-j9kd2 Container created 24m Normal Pulled pod/e2e-distinct-simulated-kserve-7b998b79d9-j9kd2 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 229ms (229ms including waiting). Image size: 98346788 bytes. 24m Normal ScalingReplicaSet deployment/e2e-embedding-simulated-kserve Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1 24m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default 24m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping 24m Normal SuccessfulCreate replicaset/e2e-embedding-simulated-kserve-67bf594cd6 Created pod: e2e-embedding-simulated-kserve-67bf594cd6-wtlm7 24m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine 24m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc 24m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs 24m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Deployment llm/e2e-embedding-simulated-kserve 24m Normal Pulling pod/e2e-embedding-simulated-kserve-67bf594cd6-wtlm7 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 24m Normal AddedInterface pod/e2e-embedding-simulated-kserve-67bf594cd6-wtlm7 Add eth0 [10.132.0.47/23] from ovn-kubernetes 24m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route 24m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc 24m Normal Pulled pod/e2e-embedding-simulated-kserve-67bf594cd6-wtlm7 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 186ms (186ms including waiting). Image size: 98346788 bytes. 24m Normal Created pod/e2e-embedding-simulated-kserve-67bf594cd6-wtlm7 Container created 24m Normal Started pod/e2e-embedding-simulated-kserve-67bf594cd6-wtlm7 Container started 24m Normal SuccessfulCreate replicaset/e2e-trlp-test-simulated-kserve-69b588897d Created pod: e2e-trlp-test-simulated-kserve-69b588897d-f4snn 24m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Deployment llm/e2e-trlp-test-simulated-kserve 24m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default 24m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc 24m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route 24m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc 24m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs 24m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine 24m Normal ScalingReplicaSet deployment/e2e-trlp-test-simulated-kserve Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1 24m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping 24m Normal Pulling pod/e2e-trlp-test-simulated-kserve-69b588897d-f4snn Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 24m Normal AddedInterface pod/e2e-trlp-test-simulated-kserve-69b588897d-f4snn Add eth0 [10.132.0.48/23] from ovn-kubernetes 24m Normal Started pod/e2e-trlp-test-simulated-kserve-69b588897d-f4snn Container started 24m Normal Created pod/e2e-trlp-test-simulated-kserve-69b588897d-f4snn Container created 24m Normal Pulled pod/e2e-trlp-test-simulated-kserve-69b588897d-f4snn Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 189ms (189ms including waiting). Image size: 98346788 bytes. 24m Normal Updated llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs 24m Normal LLMInferenceServiceReady llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready 24m Normal Updated llminferenceservice/facebook-opt-125m-simulated Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs 24m Normal LLMInferenceServiceReady llminferenceservice/facebook-opt-125m-simulated LLMInferenceService [facebook-opt-125m-simulated] is Ready 24m Normal Updated llminferenceservice/premium-simulated-simulated-premium Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs 24m Normal Updated llminferenceservice/e2e-distinct-2-simulated Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs 24m Normal Updated llminferenceservice/e2e-distinct-simulated Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs 24m Normal LLMInferenceServiceReady llminferenceservice/e2e-distinct-2-simulated LLMInferenceService [e2e-distinct-2-simulated] is Ready 24m Normal LLMInferenceServiceReady llminferenceservice/e2e-distinct-simulated LLMInferenceService [e2e-distinct-simulated] is Ready 24m Normal Updated llminferenceservice/e2e-embedding-simulated Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs 24m Normal LLMInferenceServiceReady llminferenceservice/e2e-embedding-simulated LLMInferenceService [e2e-embedding-simulated] is Ready 24m Normal LLMInferenceServiceReady llminferenceservice/e2e-trlp-test-simulated LLMInferenceService [e2e-trlp-test-simulated] is Ready 24m Normal Updated llminferenceservice/e2e-trlp-test-simulated Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs 18m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xhhj2 Liveness probe failed: Get "https://10.132.0.45:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 18m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xhhj2 Readiness probe failed: Get "https://10.132.0.45:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 17m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xhhj2 Readiness probe failed: Get "https://10.132.0.45:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 17m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xhhj2 Readiness probe failed: Get "https://10.132.0.45:8000/ready": context deadline exceeded 17m Warning Unhealthy pod/e2e-embedding-simulated-kserve-67bf594cd6-wtlm7 Readiness probe failed: Get "https://10.132.0.47:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 17m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-f4snn Readiness probe failed: Get "https://10.132.0.48:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 17m Warning Unhealthy pod/e2e-distinct-2-simulated-kserve-cbd4f5586-svmf9 Readiness probe failed: Get "https://10.132.0.46:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 16m Warning Unhealthy pod/e2e-embedding-simulated-kserve-67bf594cd6-wtlm7 Readiness probe failed: Get "https://10.132.0.47:8000/ready": context deadline exceeded 16m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-f4snn Readiness probe failed: Get "https://10.132.0.48:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 16m Warning Unhealthy pod/e2e-distinct-2-simulated-kserve-cbd4f5586-svmf9 Readiness probe failed: Get "https://10.132.0.46:8000/ready": context deadline exceeded 16m Warning Unhealthy pod/e2e-embedding-simulated-kserve-67bf594cd6-wtlm7 Readiness probe failed: Get "https://10.132.0.47:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 15m Warning LLMInferenceServiceNotReady llminferenceservice/premium-simulated-simulated-premium LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady 15m Normal LLMInferenceServiceReady llminferenceservice/premium-simulated-simulated-premium LLMInferenceService [premium-simulated-simulated-premium] is Ready 4m33s Normal Created llminferenceservice/e2e-same-id-a-376d5a58 Created v1.DestinationRule llm/e2e-same-id-a-376d5a58-kserve-workload-svc 4m33s Normal Created llminferenceservice/e2e-same-id-a-376d5a58 Created v1.Deployment llm/e2e-same-id-a-376d5a58-kserve 4m33s Normal Created llminferenceservice/e2e-same-id-a-376d5a58 Created v1.HTTPRoute llm/e2e-same-id-a-376d5a58-kserve-route 4m33s Normal Created llminferenceservice/e2e-same-id-a-376d5a58 Created v1.Service llm/e2e-same-id-a-376d5a58-kserve-workload-svc 4m33s Normal SuccessfulCreate replicaset/e2e-same-id-a-376d5a58-kserve-7bd9c8b45 Created pod: e2e-same-id-a-376d5a58-kserve-7bd9c8b45-kbvj9 4m33s Normal ScalingReplicaSet deployment/e2e-same-id-a-376d5a58-kserve Scaled up replica set e2e-same-id-a-376d5a58-kserve-7bd9c8b45 from 0 to 1 4m33s Normal Created llminferenceservice/e2e-same-id-a-376d5a58 Created v1.Secret llm/e2e-same-id-a-376d5a58-kserve-self-signed-certs 4m32s Normal Pulled pod/e2e-same-id-a-376d5a58-kserve-7bd9c8b45-kbvj9 Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod 4m32s Normal Started pod/e2e-same-id-a-376d5a58-kserve-7bd9c8b45-kbvj9 Container started 4m32s Normal Created pod/e2e-same-id-a-376d5a58-kserve-7bd9c8b45-kbvj9 Container created 4m32s Normal AddedInterface pod/e2e-same-id-a-376d5a58-kserve-7bd9c8b45-kbvj9 Add eth0 [10.133.0.86/23] from ovn-kubernetes 4m32s Normal Created llminferenceservice/e2e-same-id-a-376d5a58 Created v1.PodMonitor llm/e2e-same-id-a-376d5a58-kserve-llmisvc-engine-default 4m32s Normal Created llminferenceservice/e2e-same-id-a-376d5a58 Created v1.PodMonitor llm/e2e-same-id-a-376d5a58-kserve-llmisvc-engine 4m32s Normal Created llminferenceservice/e2e-same-id-a-376d5a58 Created v1.NetworkPolicy llm/e2e-same-id-a-376d5a58-prometheus-scraping 4m24s Normal Updated llminferenceservice/e2e-same-id-a-376d5a58 Updated v1.Secret llm/e2e-same-id-a-376d5a58-kserve-self-signed-certs 4m21s Normal LLMInferenceServiceReady llminferenceservice/e2e-same-id-a-376d5a58 LLMInferenceService [e2e-same-id-a-376d5a58] is Ready 4m16s Normal Created llminferenceservice/e2e-same-id-b-376d5a58 Created v1.DestinationRule llm/e2e-same-id-b-376d5a58-kserve-workload-svc 4m16s Normal Created llminferenceservice/e2e-same-id-b-376d5a58 Created v1.PodMonitor llm/e2e-same-id-b-376d5a58-kserve-llmisvc-engine-default 4m16s Normal Pulled pod/e2e-same-id-b-376d5a58-kserve-85c9b7d7df-jwnct Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod 4m16s Normal Created llminferenceservice/e2e-same-id-b-376d5a58 Created v1.NetworkPolicy llm/e2e-same-id-b-376d5a58-prometheus-scraping 4m16s Normal Created llminferenceservice/e2e-same-id-b-376d5a58 Created v1.PodMonitor llm/e2e-same-id-b-376d5a58-kserve-llmisvc-engine 4m16s Normal Created llminferenceservice/e2e-same-id-b-376d5a58 Created v1.HTTPRoute llm/e2e-same-id-b-376d5a58-kserve-route 4m16s Normal SuccessfulCreate replicaset/e2e-same-id-b-376d5a58-kserve-85c9b7d7df Created pod: e2e-same-id-b-376d5a58-kserve-85c9b7d7df-jwnct 4m16s Normal ScalingReplicaSet deployment/e2e-same-id-b-376d5a58-kserve Scaled up replica set e2e-same-id-b-376d5a58-kserve-85c9b7d7df from 0 to 1 4m16s Normal Created llminferenceservice/e2e-same-id-b-376d5a58 Created v1.Secret llm/e2e-same-id-b-376d5a58-kserve-self-signed-certs 4m16s Normal Created llminferenceservice/e2e-same-id-b-376d5a58 Created v1.Deployment llm/e2e-same-id-b-376d5a58-kserve 4m16s Normal AddedInterface pod/e2e-same-id-b-376d5a58-kserve-85c9b7d7df-jwnct Add eth0 [10.133.0.87/23] from ovn-kubernetes 4m16s Normal Created llminferenceservice/e2e-same-id-b-376d5a58 Created v1.Service llm/e2e-same-id-b-376d5a58-kserve-workload-svc 4m15s Normal Started pod/e2e-same-id-b-376d5a58-kserve-85c9b7d7df-jwnct Container started 4m15s Normal Created pod/e2e-same-id-b-376d5a58-kserve-85c9b7d7df-jwnct Container created 4m10s Normal Updated llminferenceservice/e2e-same-id-b-376d5a58 Updated v1.Secret llm/e2e-same-id-b-376d5a58-kserve-self-signed-certs 4m1s Normal LLMInferenceServiceReady llminferenceservice/e2e-same-id-b-376d5a58 LLMInferenceService [e2e-same-id-b-376d5a58] is Ready 3m51s Warning ModelNameCollision llminferenceservice/e2e-same-id-b-376d5a58 model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-376d5a58 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-376d5a58; safe to ignore if traffic splitting is planned 3m50s Warning ModelNameCollision llminferenceservice/e2e-same-id-a-376d5a58 model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-376d5a58 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-376d5a58; safe to ignore if traffic splitting is planned 3m40s Normal Killing pod/e2e-same-id-a-376d5a58-kserve-7bd9c8b45-kbvj9 Stopping container main 3m37s Normal Killing pod/e2e-same-id-b-376d5a58-kserve-85c9b7d7df-jwnct Stopping container main 3m24s Warning Unhealthy pod/e2e-same-id-a-376d5a58-kserve-7bd9c8b45-kbvj9 Readiness probe failed: Get "https://10.133.0.86:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)