=== events in llm (2026-10-30T18:32:29Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 68m Normal Scheduled pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9z2vj Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9z2vj to ip-10-0-135-170.ec2.internal 68m Normal Scheduled pod/e2e-distinct-simulated-kserve-7b998b79d9-r5kxv Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-r5kxv to ip-10-0-135-170.ec2.internal 68m Normal Scheduled pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mztb6 Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mztb6 to ip-10-0-135-170.ec2.internal 8m31s Warning ModelNameConflict maasmodelref/e2e-same-id-a-47a62668 Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-47a62668 68m Normal Scheduled pod/e2e-embedding-simulated-kserve-67bf594cd6-q6l6h Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-q6l6h to ip-10-0-139-222.ec2.internal 9m8s Normal Scheduled pod/e2e-same-id-a-47a62668-kserve-766fb4cf6f-2l5dl Successfully assigned llm/e2e-same-id-a-47a62668-kserve-766fb4cf6f-2l5dl to ip-10-0-143-147.ec2.internal 68m Normal Scheduled pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-cbznx Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-cbznx to ip-10-0-135-170.ec2.internal 8m31s Warning ModelNameConflict maasmodelref/e2e-same-id-b-47a62668 Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-47a62668 8m8s Normal ModelNameConflictResolved maasmodelref/e2e-same-id-b-47a62668 Model identity is no longer shared with any other MaaSModelRef in this namespace 68m Normal Scheduled pod/e2e-trlp-test-simulated-kserve-69b588897d-st6hg Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-st6hg to ip-10-0-139-222.ec2.internal 68m Normal Scheduled pod/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9vs Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9vs to ip-10-0-139-222.ec2.internal 8m47s Normal Scheduled pod/e2e-same-id-b-47a62668-kserve-57d5dbffd5-srm49 Successfully assigned llm/e2e-same-id-b-47a62668-kserve-57d5dbffd5-srm49 to ip-10-0-143-147.ec2.internal 68m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs 68m Normal ScalingReplicaSet deployment/e2e-distinct-2-simulated-kserve Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1 68m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default 68m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine 68m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping 68m Normal AddedInterface pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9z2vj Add eth0 [10.133.0.25/23] from ovn-kubernetes 68m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Deployment llm/e2e-distinct-2-simulated-kserve 68m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route 68m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc 68m Normal SuccessfulCreate replicaset/e2e-distinct-2-simulated-kserve-cbd4f5586 Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-9z2vj 68m Normal Pulling pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9z2vj Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 68m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc 68m Normal Pulled pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9z2vj Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.196s (1.196s including waiting). Image size: 98346788 bytes. 68m Normal Created pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9z2vj Container created 68m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs 68m Normal ScalingReplicaSet deployment/e2e-distinct-simulated-kserve Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1 68m Normal SuccessfulCreate replicaset/e2e-distinct-simulated-kserve-7b998b79d9 Created pod: e2e-distinct-simulated-kserve-7b998b79d9-r5kxv 68m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Deployment llm/e2e-distinct-simulated-kserve 68m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc 68m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route 68m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc 68m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default 68m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine 68m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping 68m Normal Started pod/e2e-distinct-simulated-kserve-7b998b79d9-r5kxv Container started 68m Normal Created pod/e2e-distinct-simulated-kserve-7b998b79d9-r5kxv Container created 68m Normal Pulled pod/e2e-distinct-simulated-kserve-7b998b79d9-r5kxv Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 228ms (228ms including waiting). Image size: 98346788 bytes. 68m Normal Started pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9z2vj Container started 68m Normal AddedInterface pod/e2e-distinct-simulated-kserve-7b998b79d9-r5kxv Add eth0 [10.133.0.26/23] from ovn-kubernetes 68m Normal Pulling pod/e2e-distinct-simulated-kserve-7b998b79d9-r5kxv Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 68m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route 68m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc 68m Normal SuccessfulCreate replicaset/e2e-embedding-simulated-kserve-67bf594cd6 Created pod: e2e-embedding-simulated-kserve-67bf594cd6-q6l6h 68m Normal ScalingReplicaSet deployment/e2e-embedding-simulated-kserve Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1 68m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs 68m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Deployment llm/e2e-embedding-simulated-kserve 68m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc 68m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine 68m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default 68m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping 68m Normal Pulling pod/e2e-embedding-simulated-kserve-67bf594cd6-q6l6h Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 68m Normal AddedInterface pod/e2e-embedding-simulated-kserve-67bf594cd6-q6l6h Add eth0 [10.132.0.45/23] from ovn-kubernetes 68m Normal Created pod/e2e-embedding-simulated-kserve-67bf594cd6-q6l6h Container created 68m Normal Started pod/e2e-embedding-simulated-kserve-67bf594cd6-q6l6h Container started 68m Normal Pulled pod/e2e-embedding-simulated-kserve-67bf594cd6-q6l6h Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.045s (1.045s including waiting). Image size: 98346788 bytes. 68m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine 68m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route 68m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Deployment llm/e2e-trlp-test-simulated-kserve 68m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs 68m Normal ScalingReplicaSet deployment/e2e-trlp-test-simulated-kserve Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1 68m Normal SuccessfulCreate replicaset/e2e-trlp-test-simulated-kserve-69b588897d Created pod: e2e-trlp-test-simulated-kserve-69b588897d-st6hg 68m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default 68m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc 68m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc 68m Normal Created pod/e2e-trlp-test-simulated-kserve-69b588897d-st6hg Container created 68m Normal AddedInterface pod/e2e-trlp-test-simulated-kserve-69b588897d-st6hg Add eth0 [10.132.0.46/23] from ovn-kubernetes 68m Normal Pulling pod/e2e-trlp-test-simulated-kserve-69b588897d-st6hg Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 68m Normal Pulled pod/e2e-trlp-test-simulated-kserve-69b588897d-st6hg Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 217ms (217ms including waiting). Image size: 98346788 bytes. 68m Normal Started pod/e2e-trlp-test-simulated-kserve-69b588897d-st6hg Container started 68m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping 68m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping 68m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs 68m Normal AddedInterface pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mztb6 Add eth0 [10.133.0.27/23] from ovn-kubernetes 68m Normal Pulling pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mztb6 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 68m Normal ScalingReplicaSet deployment/e2e-unconfigured-facebook-opt-125m-simulated-kserve Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1 68m Normal SuccessfulCreate replicaset/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mztb6 68m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve 68m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine 68m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default 68m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc 68m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route 68m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc 68m Normal SuccessfulCreate replicaset/facebook-opt-125m-simulated-kserve-84b4ff656c Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-dl9vs 68m Normal ScalingReplicaSet deployment/facebook-opt-125m-simulated-kserve Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1 68m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs 68m Normal Started pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mztb6 Container started 68m Normal Created pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mztb6 Container created 68m Normal Pulled pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8mztb6 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 228ms (228ms including waiting). Image size: 98346788 bytes. 68m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Deployment llm/facebook-opt-125m-simulated-kserve 68m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc 68m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping 68m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine 68m Normal Pulling pod/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9vs Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 68m Normal Pulled pod/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9vs Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 220ms (220ms including waiting). Image size: 98346788 bytes. 68m Normal Created pod/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9vs Container created 68m Normal Started pod/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9vs Container started 68m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route 68m Normal AddedInterface pod/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9vs Add eth0 [10.132.0.47/23] from ovn-kubernetes 68m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc 68m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default 68m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc 68m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route 68m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping 68m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine 68m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default 68m Normal Pulling pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-cbznx Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 68m Normal AddedInterface pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-cbznx Add eth0 [10.133.0.28/23] from ovn-kubernetes 68m Normal ScalingReplicaSet deployment/premium-simulated-simulated-premium-kserve Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1 68m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs 68m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Deployment llm/premium-simulated-simulated-premium-kserve 68m Normal SuccessfulCreate replicaset/premium-simulated-simulated-premium-kserve-5f5c4b459f Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-cbznx 68m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc 68m Normal Pulled pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-cbznx Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 220ms (220ms including waiting). Image size: 98346788 bytes. 68m Normal Created pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-cbznx Container created 68m Normal Started pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-cbznx Container started 68m Normal Updated llminferenceservice/e2e-distinct-2-simulated Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs 68m Normal LLMInferenceServiceReady llminferenceservice/e2e-distinct-2-simulated LLMInferenceService [e2e-distinct-2-simulated] is Ready 68m Normal Updated llminferenceservice/e2e-distinct-simulated Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs 68m Normal LLMInferenceServiceReady llminferenceservice/e2e-distinct-simulated LLMInferenceService [e2e-distinct-simulated] is Ready 68m Normal Updated llminferenceservice/e2e-embedding-simulated Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs 68m Normal LLMInferenceServiceReady llminferenceservice/e2e-embedding-simulated LLMInferenceService [e2e-embedding-simulated] is Ready 68m Normal Updated llminferenceservice/e2e-trlp-test-simulated Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs 68m Normal LLMInferenceServiceReady llminferenceservice/e2e-trlp-test-simulated LLMInferenceService [e2e-trlp-test-simulated] is Ready 68m Normal LLMInferenceServiceReady llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready 68m Normal Updated llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs 67m Normal Updated llminferenceservice/facebook-opt-125m-simulated Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs 67m Normal LLMInferenceServiceReady llminferenceservice/facebook-opt-125m-simulated LLMInferenceService [facebook-opt-125m-simulated] is Ready 67m Normal Updated llminferenceservice/premium-simulated-simulated-premium Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs 61m Warning Unhealthy pod/facebook-opt-125m-simulated-kserve-84b4ff656c-dl9vs Readiness probe failed: Get "https://10.132.0.47:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 59m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-cbznx Liveness probe failed: Get "https://10.133.0.28:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 59m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-cbznx Liveness probe failed: Get "https://10.133.0.28:8000/health": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 59m Warning Unhealthy pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9z2vj Readiness probe failed: Get "https://10.133.0.25:8000/ready": context deadline exceeded 59m Warning Unhealthy pod/e2e-distinct-simulated-kserve-7b998b79d9-r5kxv Readiness probe failed: Get "https://10.133.0.26:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 58m Warning LLMInferenceServiceNotReady llminferenceservice/premium-simulated-simulated-premium LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady 58m Normal LLMInferenceServiceReady llminferenceservice/premium-simulated-simulated-premium LLMInferenceService [premium-simulated-simulated-premium] is Ready 56m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-st6hg Liveness probe failed: Get "https://10.132.0.46:8000/health": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 49m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-cbznx Readiness probe failed: Get "https://10.133.0.28:8000/ready": context deadline exceeded 44m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-cbznx Readiness probe failed: Get "https://10.133.0.28:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 9m8s Normal Created llminferenceservice/e2e-same-id-a-47a62668 Created v1.PodMonitor llm/e2e-same-id-a-47a62668-kserve-llmisvc-engine 9m8s Normal Pulled pod/e2e-same-id-a-47a62668-kserve-766fb4cf6f-2l5dl Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod 9m8s Normal SuccessfulCreate replicaset/e2e-same-id-a-47a62668-kserve-766fb4cf6f Created pod: e2e-same-id-a-47a62668-kserve-766fb4cf6f-2l5dl 9m8s Normal Created pod/e2e-same-id-a-47a62668-kserve-766fb4cf6f-2l5dl Container created 9m8s Normal Created llminferenceservice/e2e-same-id-a-47a62668 Created v1.NetworkPolicy llm/e2e-same-id-a-47a62668-prometheus-scraping 9m8s Normal Created llminferenceservice/e2e-same-id-a-47a62668 Created v1.Service llm/e2e-same-id-a-47a62668-kserve-workload-svc 9m8s Normal ScalingReplicaSet deployment/e2e-same-id-a-47a62668-kserve Scaled up replica set e2e-same-id-a-47a62668-kserve-766fb4cf6f from 0 to 1 9m8s Normal Created llminferenceservice/e2e-same-id-a-47a62668 Created v1.HTTPRoute llm/e2e-same-id-a-47a62668-kserve-route 9m8s Normal Created llminferenceservice/e2e-same-id-a-47a62668 Created v1.Deployment llm/e2e-same-id-a-47a62668-kserve 9m8s Normal AddedInterface pod/e2e-same-id-a-47a62668-kserve-766fb4cf6f-2l5dl Add eth0 [10.134.0.211/23] from ovn-kubernetes 9m8s Normal Created llminferenceservice/e2e-same-id-a-47a62668 Created v1.Secret llm/e2e-same-id-a-47a62668-kserve-self-signed-certs 9m8s Normal Started pod/e2e-same-id-a-47a62668-kserve-766fb4cf6f-2l5dl Container started 9m8s Normal Created llminferenceservice/e2e-same-id-a-47a62668 Created v1.PodMonitor llm/e2e-same-id-a-47a62668-kserve-llmisvc-engine-default 9m8s Normal Created llminferenceservice/e2e-same-id-a-47a62668 Created v1.DestinationRule llm/e2e-same-id-a-47a62668-kserve-workload-svc 8m59s Normal Updated llminferenceservice/e2e-same-id-a-47a62668 Updated v1.Secret llm/e2e-same-id-a-47a62668-kserve-self-signed-certs 8m53s Normal LLMInferenceServiceReady llminferenceservice/e2e-same-id-a-47a62668 LLMInferenceService [e2e-same-id-a-47a62668] is Ready 8m47s Normal ScalingReplicaSet deployment/e2e-same-id-b-47a62668-kserve Scaled up replica set e2e-same-id-b-47a62668-kserve-57d5dbffd5 from 0 to 1 8m47s Normal SuccessfulCreate replicaset/e2e-same-id-b-47a62668-kserve-57d5dbffd5 Created pod: e2e-same-id-b-47a62668-kserve-57d5dbffd5-srm49 8m47s Normal Created llminferenceservice/e2e-same-id-b-47a62668 Created v1.PodMonitor llm/e2e-same-id-b-47a62668-kserve-llmisvc-engine 8m47s Normal Created llminferenceservice/e2e-same-id-b-47a62668 Created v1.Secret llm/e2e-same-id-b-47a62668-kserve-self-signed-certs 8m47s Normal Created llminferenceservice/e2e-same-id-b-47a62668 Created v1.HTTPRoute llm/e2e-same-id-b-47a62668-kserve-route 8m47s Normal Created llminferenceservice/e2e-same-id-b-47a62668 Created v1.Deployment llm/e2e-same-id-b-47a62668-kserve 8m47s Normal Created llminferenceservice/e2e-same-id-b-47a62668 Created v1.Service llm/e2e-same-id-b-47a62668-kserve-workload-svc 8m47s Normal Created llminferenceservice/e2e-same-id-b-47a62668 Created v1.DestinationRule llm/e2e-same-id-b-47a62668-kserve-workload-svc 8m47s Normal AddedInterface pod/e2e-same-id-b-47a62668-kserve-57d5dbffd5-srm49 Add eth0 [10.134.0.212/23] from ovn-kubernetes 8m47s Normal Created llminferenceservice/e2e-same-id-b-47a62668 Created v1.PodMonitor llm/e2e-same-id-b-47a62668-kserve-llmisvc-engine-default 8m47s Normal Created llminferenceservice/e2e-same-id-b-47a62668 Created v1.NetworkPolicy llm/e2e-same-id-b-47a62668-prometheus-scraping 8m46s Normal Started pod/e2e-same-id-b-47a62668-kserve-57d5dbffd5-srm49 Container started 8m46s Normal Created pod/e2e-same-id-b-47a62668-kserve-57d5dbffd5-srm49 Container created 8m46s Normal Pulled pod/e2e-same-id-b-47a62668-kserve-57d5dbffd5-srm49 Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod 8m39s Normal Updated llminferenceservice/e2e-same-id-b-47a62668 Updated v1.Secret llm/e2e-same-id-b-47a62668-kserve-self-signed-certs 8m35s Normal LLMInferenceServiceReady llminferenceservice/e2e-same-id-b-47a62668 LLMInferenceService [e2e-same-id-b-47a62668] is Ready 8m17s Warning ModelNameCollision llminferenceservice/e2e-same-id-a-47a62668 model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-47a62668 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-47a62668; safe to ignore if traffic splitting is planned 8m16s Warning ModelNameCollision llminferenceservice/e2e-same-id-b-47a62668 model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-47a62668 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-47a62668; safe to ignore if traffic splitting is planned 8m8s Normal Killing pod/e2e-same-id-a-47a62668-kserve-766fb4cf6f-2l5dl Stopping container main 8m6s Normal Killing pod/e2e-same-id-b-47a62668-kserve-57d5dbffd5-srm49 Stopping container main 7m52s Warning Unhealthy pod/e2e-same-id-a-47a62668-kserve-766fb4cf6f-2l5dl Readiness probe failed: Get "https://10.134.0.211:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)