=== events in llm (2026-11-03T19:55:57Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 4m16s Normal ModelNameConflictResolved maasmodelref/e2e-same-id-b-8840718e Model identity is no longer shared with any other MaaSModelRef in this namespace 59m Normal Scheduled pod/e2e-distinct-simulated-kserve-7b998b79d9-lzknn Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-lzknn to ip-10-0-139-179.us-west-2.compute.internal 59m Normal Scheduled pod/e2e-distinct-2-simulated-kserve-cbd4f5586-vp8wr Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-vp8wr to ip-10-0-137-192.us-west-2.compute.internal 5m40s Normal Scheduled pod/e2e-same-id-a-8840718e-kserve-6ccb858497-zj9bf Successfully assigned llm/e2e-same-id-a-8840718e-kserve-6ccb858497-zj9bf to ip-10-0-137-192.us-west-2.compute.internal 4m33s Warning ModelNameConflict maasmodelref/e2e-same-id-a-8840718e Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-8840718e 4m58s Normal Scheduled pod/e2e-same-id-b-8840718e-kserve-56f5579fd5-tczgj Successfully assigned llm/e2e-same-id-b-8840718e-kserve-56f5579fd5-tczgj to ip-10-0-137-192.us-west-2.compute.internal 59m Normal Scheduled pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8kndlp Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8kndlp to ip-10-0-139-179.us-west-2.compute.internal 59m Normal Scheduled pod/facebook-opt-125m-simulated-kserve-84b4ff656c-6xkxn Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-6xkxn to ip-10-0-137-192.us-west-2.compute.internal 4m33s Warning ModelNameConflict maasmodelref/e2e-same-id-b-8840718e Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-8840718e 59m Normal Scheduled pod/e2e-embedding-simulated-kserve-67bf594cd6-vspbc Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-vspbc to ip-10-0-139-179.us-west-2.compute.internal 59m Normal Scheduled pod/e2e-trlp-test-simulated-kserve-69b588897d-8nk8p Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-8nk8p to ip-10-0-137-192.us-west-2.compute.internal 59m Normal Scheduled pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-wdkl7 Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-wdkl7 to ip-10-0-137-192.us-west-2.compute.internal 59m Normal SuccessfulCreate replicaset/e2e-distinct-2-simulated-kserve-cbd4f5586 Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-vp8wr 59m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc 59m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs 59m Normal ScalingReplicaSet deployment/e2e-distinct-2-simulated-kserve Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1 59m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Deployment llm/e2e-distinct-2-simulated-kserve 59m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route 59m Normal Pulling pod/e2e-distinct-2-simulated-kserve-cbd4f5586-vp8wr Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 59m Normal AddedInterface pod/e2e-distinct-2-simulated-kserve-cbd4f5586-vp8wr Add eth0 [10.134.0.27/23] from ovn-kubernetes 59m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default 59m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc 59m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping 59m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine 59m Normal Created pod/e2e-distinct-2-simulated-kserve-cbd4f5586-vp8wr Container created 59m Normal Started pod/e2e-distinct-2-simulated-kserve-cbd4f5586-vp8wr Container started 59m Normal Pulled pod/e2e-distinct-2-simulated-kserve-cbd4f5586-vp8wr Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 2.24s (2.24s including waiting). Image size: 98346788 bytes. 59m Normal ScalingReplicaSet deployment/premium-simulated-simulated-premium-kserve Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1 59m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc 59m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc 59m Normal SuccessfulCreate replicaset/premium-simulated-simulated-premium-kserve-5f5c4b459f Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-wdkl7 59m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route 59m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs 59m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Deployment llm/premium-simulated-simulated-premium-kserve 59m Normal Pulled pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-wdkl7 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 585ms (585ms including waiting). Image size: 98346788 bytes. 59m Normal Created pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-wdkl7 Container created 59m Normal Started pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-wdkl7 Container started 59m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default 59m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine 59m Normal Pulling pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-wdkl7 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 59m Normal AddedInterface pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-wdkl7 Add eth0 [10.134.0.28/23] from ovn-kubernetes 59m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping 59m Normal Updated llminferenceservice/e2e-distinct-2-simulated Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs 59m Normal ScalingReplicaSet deployment/e2e-distinct-simulated-kserve Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1 59m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs 59m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Deployment llm/e2e-distinct-simulated-kserve 59m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc 59m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route 59m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc 59m Normal SuccessfulCreate replicaset/e2e-distinct-simulated-kserve-7b998b79d9 Created pod: e2e-distinct-simulated-kserve-7b998b79d9-lzknn 59m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default 59m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine 59m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping 59m Normal AddedInterface pod/e2e-distinct-simulated-kserve-7b998b79d9-lzknn Add eth0 [10.132.0.54/23] from ovn-kubernetes 59m Normal Pulling pod/e2e-distinct-simulated-kserve-7b998b79d9-lzknn Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 59m Normal Started pod/e2e-distinct-simulated-kserve-7b998b79d9-lzknn Container started 59m Normal Created pod/e2e-distinct-simulated-kserve-7b998b79d9-lzknn Container created 59m Normal Pulled pod/e2e-distinct-simulated-kserve-7b998b79d9-lzknn Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.574s (1.574s including waiting). Image size: 98346788 bytes. 59m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc 59m Normal SuccessfulCreate replicaset/e2e-embedding-simulated-kserve-67bf594cd6 Created pod: e2e-embedding-simulated-kserve-67bf594cd6-vspbc 59m Normal ScalingReplicaSet deployment/e2e-embedding-simulated-kserve Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1 59m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs 59m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Deployment llm/e2e-embedding-simulated-kserve 59m Normal Pulling pod/e2e-embedding-simulated-kserve-67bf594cd6-vspbc Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 59m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route 59m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc 59m Normal AddedInterface pod/e2e-embedding-simulated-kserve-67bf594cd6-vspbc Add eth0 [10.132.0.55/23] from ovn-kubernetes 59m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine 59m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default 59m Normal Created pod/e2e-embedding-simulated-kserve-67bf594cd6-vspbc Container created 59m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping 59m Normal Pulled pod/e2e-embedding-simulated-kserve-67bf594cd6-vspbc Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 620ms (620ms including waiting). Image size: 98346788 bytes. 59m Normal Started pod/e2e-embedding-simulated-kserve-67bf594cd6-vspbc Container started 59m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs 59m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc 59m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc 59m Normal SuccessfulCreate replicaset/e2e-trlp-test-simulated-kserve-69b588897d Created pod: e2e-trlp-test-simulated-kserve-69b588897d-8nk8p 59m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route 59m Normal ScalingReplicaSet deployment/e2e-trlp-test-simulated-kserve Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1 59m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Deployment llm/e2e-trlp-test-simulated-kserve 59m Normal Pulling pod/e2e-trlp-test-simulated-kserve-69b588897d-8nk8p Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 59m Normal AddedInterface pod/e2e-trlp-test-simulated-kserve-69b588897d-8nk8p Add eth0 [10.134.0.29/23] from ovn-kubernetes 59m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default 59m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine 59m Normal Created pod/e2e-trlp-test-simulated-kserve-69b588897d-8nk8p Container created 59m Normal Started pod/e2e-trlp-test-simulated-kserve-69b588897d-8nk8p Container started 59m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping 59m Normal Pulled pod/e2e-trlp-test-simulated-kserve-69b588897d-8nk8p Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 568ms (568ms including waiting). Image size: 98346788 bytes. 59m Normal AddedInterface pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8kndlp Add eth0 [10.132.0.56/23] from ovn-kubernetes 59m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc 59m Normal Pulling pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8kndlp Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 59m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc 59m Normal SuccessfulCreate replicaset/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8kndlp 59m Normal ScalingReplicaSet deployment/e2e-unconfigured-facebook-opt-125m-simulated-kserve Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1 59m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default 59m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs 59m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve 59m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route 59m Normal Pulled pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8kndlp Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 715ms (715ms including waiting). Image size: 98346788 bytes. 59m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine 59m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping 59m Normal Created pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8kndlp Container created 59m Normal Started pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8kndlp Container started 59m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route 59m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Deployment llm/facebook-opt-125m-simulated-kserve 59m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc 59m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs 59m Normal ScalingReplicaSet deployment/facebook-opt-125m-simulated-kserve Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1 59m Normal SuccessfulCreate replicaset/facebook-opt-125m-simulated-kserve-84b4ff656c Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-6xkxn 59m Normal Pulling pod/facebook-opt-125m-simulated-kserve-84b4ff656c-6xkxn Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 59m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine 59m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default 59m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc 59m Normal AddedInterface pod/facebook-opt-125m-simulated-kserve-84b4ff656c-6xkxn Add eth0 [10.134.0.30/23] from ovn-kubernetes 59m Normal Pulled pod/facebook-opt-125m-simulated-kserve-84b4ff656c-6xkxn Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 637ms (637ms including waiting). Image size: 98346788 bytes. 59m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping 59m Normal Created pod/facebook-opt-125m-simulated-kserve-84b4ff656c-6xkxn Container created 59m Normal Started pod/facebook-opt-125m-simulated-kserve-84b4ff656c-6xkxn Container started 59m Normal Updated llminferenceservice/premium-simulated-simulated-premium Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs 59m Normal LLMInferenceServiceReady llminferenceservice/premium-simulated-simulated-premium LLMInferenceService [premium-simulated-simulated-premium] is Ready 59m Normal LLMInferenceServiceReady llminferenceservice/e2e-distinct-2-simulated LLMInferenceService [e2e-distinct-2-simulated] is Ready 59m Normal Updated llminferenceservice/e2e-distinct-simulated Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs 59m Normal LLMInferenceServiceReady llminferenceservice/e2e-distinct-simulated LLMInferenceService [e2e-distinct-simulated] is Ready 59m Normal Updated llminferenceservice/e2e-embedding-simulated Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs 59m Normal LLMInferenceServiceReady llminferenceservice/e2e-embedding-simulated LLMInferenceService [e2e-embedding-simulated] is Ready 59m Normal Updated llminferenceservice/e2e-trlp-test-simulated Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs 59m Normal LLMInferenceServiceReady llminferenceservice/e2e-trlp-test-simulated LLMInferenceService [e2e-trlp-test-simulated] is Ready 59m Normal Updated llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs 58m Normal Updated llminferenceservice/facebook-opt-125m-simulated Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs 58m Normal LLMInferenceServiceReady llminferenceservice/facebook-opt-125m-simulated LLMInferenceService [facebook-opt-125m-simulated] is Ready 51m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-wdkl7 Liveness probe failed: Get "https://10.134.0.28:8000/health": context deadline exceeded 47m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-wdkl7 Liveness probe failed: Get "https://10.134.0.28:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 47m Warning Unhealthy pod/e2e-embedding-simulated-kserve-67bf594cd6-vspbc Readiness probe failed: Get "https://10.132.0.55:8000/ready": context deadline exceeded 47m Warning Unhealthy pod/e2e-distinct-simulated-kserve-7b998b79d9-lzknn Readiness probe failed: Get "https://10.132.0.54:8000/ready": context deadline exceeded 46m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-wdkl7 Readiness probe failed: Get "https://10.134.0.28:8000/ready": context deadline exceeded 46m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-wdkl7 Readiness probe failed: Get "https://10.134.0.28:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 46m Warning Unhealthy pod/e2e-distinct-2-simulated-kserve-cbd4f5586-vp8wr Liveness probe failed: Get "https://10.134.0.27:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 46m Warning Unhealthy pod/e2e-embedding-simulated-kserve-67bf594cd6-vspbc Readiness probe failed: Get "https://10.132.0.55:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 40m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-wdkl7 Readiness probe failed: Get "https://10.134.0.28:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 5m41s Normal Created llminferenceservice/e2e-same-id-a-8840718e Created v1.Secret llm/e2e-same-id-a-8840718e-kserve-self-signed-certs 5m41s Normal Created llminferenceservice/e2e-same-id-a-8840718e Created v1.Deployment llm/e2e-same-id-a-8840718e-kserve 5m41s Normal SuccessfulCreate replicaset/e2e-same-id-a-8840718e-kserve-6ccb858497 Created pod: e2e-same-id-a-8840718e-kserve-6ccb858497-zj9bf 5m41s Normal ScalingReplicaSet deployment/e2e-same-id-a-8840718e-kserve Scaled up replica set e2e-same-id-a-8840718e-kserve-6ccb858497 from 0 to 1 5m41s Normal Created llminferenceservice/e2e-same-id-a-8840718e Created v1.Service llm/e2e-same-id-a-8840718e-kserve-workload-svc 5m40s Normal Created llminferenceservice/e2e-same-id-a-8840718e Created v1.HTTPRoute llm/e2e-same-id-a-8840718e-kserve-route 5m40s Normal Pulled pod/e2e-same-id-a-8840718e-kserve-6ccb858497-zj9bf Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod 5m40s Normal Created pod/e2e-same-id-a-8840718e-kserve-6ccb858497-zj9bf Container created 5m40s Normal AddedInterface pod/e2e-same-id-a-8840718e-kserve-6ccb858497-zj9bf Add eth0 [10.134.1.43/23] from ovn-kubernetes 5m40s Normal Started pod/e2e-same-id-a-8840718e-kserve-6ccb858497-zj9bf Container started 5m40s Normal Created llminferenceservice/e2e-same-id-a-8840718e Created v1.DestinationRule llm/e2e-same-id-a-8840718e-kserve-workload-svc 5m40s Normal Created llminferenceservice/e2e-same-id-a-8840718e Created v1.PodMonitor llm/e2e-same-id-a-8840718e-kserve-llmisvc-engine-default 5m40s Normal Created llminferenceservice/e2e-same-id-a-8840718e Created v1.PodMonitor llm/e2e-same-id-a-8840718e-kserve-llmisvc-engine 5m39s Normal Created llminferenceservice/e2e-same-id-a-8840718e Created v1.NetworkPolicy llm/e2e-same-id-a-8840718e-prometheus-scraping 5m36s Normal Updated llminferenceservice/e2e-same-id-a-8840718e Updated v1.Secret llm/e2e-same-id-a-8840718e-kserve-self-signed-certs 5m17s Normal LLMInferenceServiceReady llminferenceservice/e2e-same-id-a-8840718e LLMInferenceService [e2e-same-id-a-8840718e] is Ready 4m59s Normal Created llminferenceservice/e2e-same-id-b-8840718e Created v1.Service llm/e2e-same-id-b-8840718e-kserve-workload-svc 4m59s Normal SuccessfulCreate replicaset/e2e-same-id-b-8840718e-kserve-56f5579fd5 Created pod: e2e-same-id-b-8840718e-kserve-56f5579fd5-tczgj 4m59s Normal Created llminferenceservice/e2e-same-id-b-8840718e Created v1.Deployment llm/e2e-same-id-b-8840718e-kserve 4m59s Normal Created llminferenceservice/e2e-same-id-b-8840718e Created v1.Secret llm/e2e-same-id-b-8840718e-kserve-self-signed-certs 4m59s Normal ScalingReplicaSet deployment/e2e-same-id-b-8840718e-kserve Scaled up replica set e2e-same-id-b-8840718e-kserve-56f5579fd5 from 0 to 1 4m58s Normal Started pod/e2e-same-id-b-8840718e-kserve-56f5579fd5-tczgj Container started 4m58s Normal Created llminferenceservice/e2e-same-id-b-8840718e Created v1.PodMonitor llm/e2e-same-id-b-8840718e-kserve-llmisvc-engine-default 4m58s Normal Created pod/e2e-same-id-b-8840718e-kserve-56f5579fd5-tczgj Container created 4m58s Normal Pulled pod/e2e-same-id-b-8840718e-kserve-56f5579fd5-tczgj Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod 4m58s Normal AddedInterface pod/e2e-same-id-b-8840718e-kserve-56f5579fd5-tczgj Add eth0 [10.134.1.44/23] from ovn-kubernetes 4m58s Normal Created llminferenceservice/e2e-same-id-b-8840718e Created v1.HTTPRoute llm/e2e-same-id-b-8840718e-kserve-route 4m58s Normal Created llminferenceservice/e2e-same-id-b-8840718e Created v1.DestinationRule llm/e2e-same-id-b-8840718e-kserve-workload-svc 4m58s Normal Created llminferenceservice/e2e-same-id-b-8840718e Created v1.PodMonitor llm/e2e-same-id-b-8840718e-kserve-llmisvc-engine 4m57s Normal Created llminferenceservice/e2e-same-id-b-8840718e Created v1.NetworkPolicy llm/e2e-same-id-b-8840718e-prometheus-scraping 4m51s Normal Updated llminferenceservice/e2e-same-id-b-8840718e Updated v1.Secret llm/e2e-same-id-b-8840718e-kserve-self-signed-certs 4m35s Normal LLMInferenceServiceReady llminferenceservice/e2e-same-id-b-8840718e LLMInferenceService [e2e-same-id-b-8840718e] is Ready 4m24s Warning ModelNameCollision llminferenceservice/e2e-same-id-a-8840718e model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-8840718e in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-8840718e; safe to ignore if traffic splitting is planned 4m22s Warning ModelNameCollision llminferenceservice/e2e-same-id-b-8840718e model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-8840718e in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-8840718e; safe to ignore if traffic splitting is planned 4m15s Normal Killing pod/e2e-same-id-a-8840718e-kserve-6ccb858497-zj9bf Stopping container main 4m Warning Unhealthy pod/e2e-same-id-a-8840718e-kserve-6ccb858497-zj9bf Readiness probe failed: Get "https://10.134.1.43:8000/ready": dial tcp 10.134.1.43:8000: connect: connection refused 4m Normal Killing pod/e2e-same-id-b-8840718e-kserve-56f5579fd5-tczgj Stopping container main 3m45s Warning Unhealthy pod/e2e-same-id-b-8840718e-kserve-56f5579fd5-tczgj Readiness probe failed: Get "https://10.134.1.44:8000/ready": dial tcp 10.134.1.44:8000: connect: connection refused 3m43s Warning LLMInferenceServiceNotReady llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is no longer Ready because of: HTTPRoutesReady, RouterReady 3m43s Warning Error llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Reconciliation failed: failed to reconcile networking: failed to reconcile HTTP routes: failed to reconcile HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route: failed to get defaults for v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route: Operation cannot be fulfilled on httproutes.gateway.networking.k8s.io "e2e-unconfigured-facebook-opt-125m-simulated-kserve-route": the object has been modified; please apply your changes to the latest version and try again 3m40s Normal LLMInferenceServiceReady llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready