=== events in llm (2026-11-02T18:34:25Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 6m34s Warning ModelNameConflict maasmodelref/e2e-same-id-a-d04a7d07 Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-d04a7d07 57m Normal Scheduled pod/e2e-distinct-2-simulated-kserve-cbd4f5586-8rrp4 Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-8rrp4 to ip-10-0-141-87.ec2.internal 57m Normal Scheduled pod/facebook-opt-125m-simulated-kserve-84b4ff656c-v7b9k Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-v7b9k to ip-10-0-141-87.ec2.internal 57m Normal Scheduled pod/echo-simulator-kserve-64b6f8f96c-j2l7j Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-j2l7j to ip-10-0-142-26.ec2.internal 57m Normal Scheduled pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8jrc66 Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8jrc66 to ip-10-0-142-26.ec2.internal 57m Normal Scheduled pod/e2e-distinct-simulated-kserve-7b998b79d9-drrc4 Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-drrc4 to ip-10-0-142-26.ec2.internal 7m6s Normal Scheduled pod/e2e-same-id-a-d04a7d07-kserve-977f44f6f-86v8t Successfully assigned llm/e2e-same-id-a-d04a7d07-kserve-977f44f6f-86v8t to ip-10-0-136-153.ec2.internal 57m Normal Scheduled pod/e2e-trlp-test-simulated-kserve-69b588897d-xc9kg Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-xc9kg to ip-10-0-141-87.ec2.internal 57m Normal Scheduled pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-hpk4h Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-hpk4h to ip-10-0-142-26.ec2.internal 6m21s Normal ModelNameConflictResolved maasmodelref/e2e-same-id-b-d04a7d07 Model identity is no longer shared with any other MaaSModelRef in this namespace 6m49s Normal Scheduled pod/e2e-same-id-b-d04a7d07-kserve-58cb574f4f-55jpw Successfully assigned llm/e2e-same-id-b-d04a7d07-kserve-58cb574f4f-55jpw to ip-10-0-141-87.ec2.internal 6m34s Warning ModelNameConflict maasmodelref/e2e-same-id-b-d04a7d07 Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-d04a7d07 57m Normal Scheduled pod/e2e-embedding-simulated-kserve-67bf594cd6-v25sf Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-v25sf to ip-10-0-142-26.ec2.internal 57m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs 57m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc 57m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Deployment llm/e2e-embedding-simulated-kserve 57m Normal AddedInterface pod/e2e-embedding-simulated-kserve-67bf594cd6-v25sf Add eth0 [10.133.0.28/23] from ovn-kubernetes 57m Normal Pulling pod/e2e-embedding-simulated-kserve-67bf594cd6-v25sf Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 57m Normal SuccessfulCreate replicaset/e2e-embedding-simulated-kserve-67bf594cd6 Created pod: e2e-embedding-simulated-kserve-67bf594cd6-v25sf 57m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping 57m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine 57m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default 57m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc 57m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route 57m Normal ScalingReplicaSet deployment/e2e-embedding-simulated-kserve Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1 57m Normal SuccessfulCreate replicaset/e2e-trlp-test-simulated-kserve-69b588897d Created pod: e2e-trlp-test-simulated-kserve-69b588897d-xc9kg 57m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route 57m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc 57m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc 57m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Deployment llm/e2e-trlp-test-simulated-kserve 57m Normal Started pod/e2e-embedding-simulated-kserve-67bf594cd6-v25sf Container started 57m Normal Created pod/e2e-embedding-simulated-kserve-67bf594cd6-v25sf Container created 57m Normal Pulled pod/e2e-embedding-simulated-kserve-67bf594cd6-v25sf Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.051s (1.051s including waiting). Image size: 98346788 bytes. 57m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs 57m Normal ScalingReplicaSet deployment/e2e-trlp-test-simulated-kserve Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1 57m Normal AddedInterface pod/e2e-trlp-test-simulated-kserve-69b588897d-xc9kg Add eth0 [10.134.0.30/23] from ovn-kubernetes 57m Normal Pulling pod/e2e-trlp-test-simulated-kserve-69b588897d-xc9kg Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 57m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default 57m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine 57m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping 57m Normal Started pod/e2e-trlp-test-simulated-kserve-69b588897d-xc9kg Container started 57m Normal Created pod/e2e-trlp-test-simulated-kserve-69b588897d-xc9kg Container created 57m Normal Pulled pod/e2e-trlp-test-simulated-kserve-69b588897d-xc9kg Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.098s (1.098s including waiting). Image size: 98346788 bytes. 57m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve 57m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route 57m Normal Pulling pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8jrc66 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 57m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping 57m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine 57m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default 57m Normal ScalingReplicaSet deployment/e2e-unconfigured-facebook-opt-125m-simulated-kserve Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1 57m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs 57m Normal SuccessfulCreate replicaset/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8jrc66 57m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc 57m Normal AddedInterface pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8jrc66 Add eth0 [10.133.0.29/23] from ovn-kubernetes 57m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc 57m Normal Started pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8jrc66 Container started 57m Normal Created pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8jrc66 Container created 57m Normal Pulled pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8jrc66 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 225ms (225ms including waiting). Image size: 98346788 bytes. 57m Normal Created llminferenceservice/echo-simulator Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default 57m Normal Created llminferenceservice/echo-simulator Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping 57m Normal AddedInterface pod/echo-simulator-kserve-64b6f8f96c-j2l7j Add eth0 [10.133.0.30/23] from ovn-kubernetes 57m Normal Pulling pod/echo-simulator-kserve-64b6f8f96c-j2l7j Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" 57m Normal SuccessfulCreate replicaset/echo-simulator-kserve-64b6f8f96c Created pod: echo-simulator-kserve-64b6f8f96c-j2l7j 57m Normal ScalingReplicaSet deployment/echo-simulator-kserve Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1 57m Normal Created llminferenceservice/echo-simulator Created v1.Secret llm/echo-simulator-kserve-self-signed-certs 57m Normal Created llminferenceservice/echo-simulator Created v1.Deployment llm/echo-simulator-kserve 57m Normal Created llminferenceservice/echo-simulator Created v1.Service llm/echo-simulator-kserve-workload-svc 57m Normal Created llminferenceservice/echo-simulator Created v1.HTTPRoute llm/echo-simulator-kserve-route 57m Normal Created llminferenceservice/echo-simulator Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc 57m Normal Created llminferenceservice/echo-simulator Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine 57m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc 57m Normal SuccessfulCreate replicaset/facebook-opt-125m-simulated-kserve-84b4ff656c Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-v7b9k 57m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc 57m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs 57m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Deployment llm/facebook-opt-125m-simulated-kserve 57m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route 57m Normal ScalingReplicaSet deployment/facebook-opt-125m-simulated-kserve Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1 57m Normal Created pod/facebook-opt-125m-simulated-kserve-84b4ff656c-v7b9k Container created 57m Normal AddedInterface pod/facebook-opt-125m-simulated-kserve-84b4ff656c-v7b9k Add eth0 [10.134.0.31/23] from ovn-kubernetes 57m Normal Started pod/facebook-opt-125m-simulated-kserve-84b4ff656c-v7b9k Container started 57m Normal Pulled pod/facebook-opt-125m-simulated-kserve-84b4ff656c-v7b9k Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 210ms (210ms including waiting). Image size: 98346788 bytes. 57m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping 57m Normal Started pod/echo-simulator-kserve-64b6f8f96c-j2l7j Container started 57m Normal Created pod/echo-simulator-kserve-64b6f8f96c-j2l7j Container created 57m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine 57m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default 57m Normal Pulled pod/echo-simulator-kserve-64b6f8f96c-j2l7j Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 1.438s (1.438s including waiting). Image size: 78208878 bytes. 57m Normal Pulling pod/facebook-opt-125m-simulated-kserve-84b4ff656c-v7b9k Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 57m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc 57m Normal SuccessfulCreate replicaset/premium-simulated-simulated-premium-kserve-5f5c4b459f Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-hpk4h 57m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping 57m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine 57m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc 57m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route 57m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default 57m Normal AddedInterface pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-hpk4h Add eth0 [10.133.0.31/23] from ovn-kubernetes 57m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Deployment llm/premium-simulated-simulated-premium-kserve 57m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs 57m Normal ScalingReplicaSet deployment/premium-simulated-simulated-premium-kserve Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1 57m Normal Created pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-hpk4h Container created 57m Normal Started pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-hpk4h Container started 57m Normal Pulled pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-hpk4h Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 211ms (211ms including waiting). Image size: 98346788 bytes. 57m Normal Pulling pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-hpk4h Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 57m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine 57m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs 57m Normal ScalingReplicaSet deployment/e2e-distinct-2-simulated-kserve Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1 57m Normal SuccessfulCreate replicaset/e2e-distinct-2-simulated-kserve-cbd4f5586 Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-8rrp4 57m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Deployment llm/e2e-distinct-2-simulated-kserve 57m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc 57m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route 57m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc 57m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default 57m Normal Started pod/e2e-distinct-2-simulated-kserve-cbd4f5586-8rrp4 Container started 57m Normal AddedInterface pod/e2e-distinct-2-simulated-kserve-cbd4f5586-8rrp4 Add eth0 [10.134.0.32/23] from ovn-kubernetes 57m Normal Pulled pod/e2e-distinct-2-simulated-kserve-cbd4f5586-8rrp4 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 222ms (222ms including waiting). Image size: 98346788 bytes. 57m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping 57m Normal Pulling pod/e2e-distinct-2-simulated-kserve-cbd4f5586-8rrp4 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 57m Normal Created pod/e2e-distinct-2-simulated-kserve-cbd4f5586-8rrp4 Container created 57m Normal SuccessfulCreate replicaset/e2e-distinct-simulated-kserve-7b998b79d9 Created pod: e2e-distinct-simulated-kserve-7b998b79d9-drrc4 57m Normal ScalingReplicaSet deployment/e2e-distinct-simulated-kserve Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1 57m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs 57m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc 57m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route 57m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc 57m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Deployment llm/e2e-distinct-simulated-kserve 57m Normal Created pod/e2e-distinct-simulated-kserve-7b998b79d9-drrc4 Container created 57m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default 57m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping 57m Normal Pulled pod/e2e-distinct-simulated-kserve-7b998b79d9-drrc4 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 214ms (214ms including waiting). Image size: 98346788 bytes. 57m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine 57m Normal AddedInterface pod/e2e-distinct-simulated-kserve-7b998b79d9-drrc4 Add eth0 [10.133.0.32/23] from ovn-kubernetes 57m Normal Pulling pod/e2e-distinct-simulated-kserve-7b998b79d9-drrc4 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 57m Normal Started pod/e2e-distinct-simulated-kserve-7b998b79d9-drrc4 Container started 57m Normal LLMInferenceServiceReady llminferenceservice/e2e-embedding-simulated LLMInferenceService [e2e-embedding-simulated] is Ready 57m Normal Updated llminferenceservice/e2e-embedding-simulated Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs 57m Normal Updated llminferenceservice/e2e-trlp-test-simulated Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs 57m Normal Updated llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs 57m Normal LLMInferenceServiceReady llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready 57m Normal LLMInferenceServiceReady llminferenceservice/echo-simulator LLMInferenceService [echo-simulator] is Ready 57m Normal Updated llminferenceservice/echo-simulator Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs 57m Normal Updated llminferenceservice/facebook-opt-125m-simulated Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs 57m Normal Updated llminferenceservice/premium-simulated-simulated-premium Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs 57m Normal LLMInferenceServiceReady llminferenceservice/premium-simulated-simulated-premium LLMInferenceService [premium-simulated-simulated-premium] is Ready 57m Normal Updated llminferenceservice/e2e-distinct-simulated Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs 57m Normal Updated llminferenceservice/e2e-distinct-2-simulated Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs 57m Normal LLMInferenceServiceReady llminferenceservice/e2e-distinct-simulated LLMInferenceService [e2e-distinct-simulated] is Ready 50m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-hpk4h Liveness probe failed: Get "https://10.133.0.31:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 49m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-hpk4h Liveness probe failed: Get "https://10.133.0.31:8000/health": context deadline exceeded 49m Warning Unhealthy pod/e2e-embedding-simulated-kserve-67bf594cd6-v25sf Liveness probe failed: Get "https://10.133.0.28:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 49m Warning Unhealthy pod/e2e-embedding-simulated-kserve-67bf594cd6-v25sf Readiness probe failed: Get "https://10.133.0.28:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 41m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-hpk4h Readiness probe failed: Get "https://10.133.0.31:8000/ready": context deadline exceeded 31m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-hpk4h Readiness probe failed: Get "https://10.133.0.31:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 29m Warning Unhealthy pod/e2e-distinct-2-simulated-kserve-cbd4f5586-8rrp4 Liveness probe failed: Get "https://10.134.0.32:8000/health": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 28m Warning NodeNotReady pod/e2e-trlp-test-simulated-kserve-69b588897d-xc9kg Node is not ready 28m Warning NodeNotReady pod/e2e-distinct-2-simulated-kserve-cbd4f5586-8rrp4 Node is not ready 28m Warning NodeNotReady pod/facebook-opt-125m-simulated-kserve-84b4ff656c-v7b9k Node is not ready 28m Warning LLMInferenceServiceNotReady llminferenceservice/facebook-opt-125m-simulated LLMInferenceService [facebook-opt-125m-simulated] is no longer Ready because of: MainWorkloadReady, WorkloadsReady 27m Warning LLMInferenceServiceNotReady llminferenceservice/e2e-distinct-2-simulated LLMInferenceService [e2e-distinct-2-simulated] is no longer Ready because of: MainWorkloadReady, WorkloadsReady 27m Warning LLMInferenceServiceNotReady llminferenceservice/e2e-trlp-test-simulated LLMInferenceService [e2e-trlp-test-simulated] is no longer Ready because of: MainWorkloadReady, WorkloadsReady 26m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-xc9kg Readiness probe failed: Get "https://10.134.0.30:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 26m Warning Unhealthy pod/facebook-opt-125m-simulated-kserve-84b4ff656c-v7b9k Readiness probe failed: Get "https://10.134.0.31:8000/ready": context deadline exceeded 26m Warning Unhealthy pod/facebook-opt-125m-simulated-kserve-84b4ff656c-v7b9k Readiness probe failed: Get "https://10.134.0.31:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 26m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-xc9kg Readiness probe failed: Get "https://10.134.0.30:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 26m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-xc9kg Readiness probe failed: Get "https://10.134.0.30:8000/ready": context deadline exceeded 26m Warning Unhealthy pod/facebook-opt-125m-simulated-kserve-84b4ff656c-v7b9k Readiness probe failed: Get "https://10.134.0.31:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 25m Warning Unhealthy pod/facebook-opt-125m-simulated-kserve-84b4ff656c-v7b9k Liveness probe failed: Get "https://10.134.0.31:8000/health": context deadline exceeded 25m Warning Unhealthy pod/e2e-distinct-2-simulated-kserve-cbd4f5586-8rrp4 Readiness probe failed: Get "https://10.134.0.32:8000/ready": context deadline exceeded 25m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-xc9kg Liveness probe failed: Get "https://10.134.0.30:8000/health": context deadline exceeded 23m Warning Unhealthy pod/facebook-opt-125m-simulated-kserve-84b4ff656c-v7b9k Liveness probe failed: Get "https://10.134.0.31:8000/health": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 23m Warning Unhealthy pod/e2e-distinct-2-simulated-kserve-cbd4f5586-8rrp4 Readiness probe failed: Get "https://10.134.0.32:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 23m Warning Unhealthy pod/e2e-distinct-2-simulated-kserve-cbd4f5586-8rrp4 Liveness probe failed: Get "https://10.134.0.32:8000/health": context deadline exceeded 23m Warning Unhealthy pod/facebook-opt-125m-simulated-kserve-84b4ff656c-v7b9k Liveness probe failed: Get "https://10.134.0.31:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 23m Warning Unhealthy pod/e2e-distinct-2-simulated-kserve-cbd4f5586-8rrp4 Readiness probe failed: Get "https://10.134.0.32:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 23m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-xc9kg Liveness probe failed: Get "https://10.134.0.30:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 23m Warning Unhealthy pod/e2e-distinct-2-simulated-kserve-cbd4f5586-8rrp4 Liveness probe failed: Get "https://10.134.0.32:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 23m Normal TaintManagerEviction pod/e2e-trlp-test-simulated-kserve-69b588897d-xc9kg Cancelling deletion of Pod llm/e2e-trlp-test-simulated-kserve-69b588897d-xc9kg 23m Normal TaintManagerEviction pod/e2e-distinct-2-simulated-kserve-cbd4f5586-8rrp4 Cancelling deletion of Pod llm/e2e-distinct-2-simulated-kserve-cbd4f5586-8rrp4 23m Normal TaintManagerEviction pod/facebook-opt-125m-simulated-kserve-84b4ff656c-v7b9k Cancelling deletion of Pod llm/facebook-opt-125m-simulated-kserve-84b4ff656c-v7b9k 23m Normal LLMInferenceServiceReady llminferenceservice/e2e-trlp-test-simulated LLMInferenceService [e2e-trlp-test-simulated] is Ready 23m Normal LLMInferenceServiceReady llminferenceservice/e2e-distinct-2-simulated LLMInferenceService [e2e-distinct-2-simulated] is Ready 23m Normal LLMInferenceServiceReady llminferenceservice/facebook-opt-125m-simulated LLMInferenceService [facebook-opt-125m-simulated] is Ready 7m6s Normal Created llminferenceservice/e2e-same-id-a-d04a7d07 Created v1.Secret llm/e2e-same-id-a-d04a7d07-kserve-self-signed-certs 7m6s Normal Created llminferenceservice/e2e-same-id-a-d04a7d07 Created v1.HTTPRoute llm/e2e-same-id-a-d04a7d07-kserve-route 7m6s Normal Created llminferenceservice/e2e-same-id-a-d04a7d07 Created v1.DestinationRule llm/e2e-same-id-a-d04a7d07-kserve-workload-svc 7m6s Normal Created llminferenceservice/e2e-same-id-a-d04a7d07 Created v1.Service llm/e2e-same-id-a-d04a7d07-kserve-workload-svc 7m6s Normal Created llminferenceservice/e2e-same-id-a-d04a7d07 Created v1.Deployment llm/e2e-same-id-a-d04a7d07-kserve 7m6s Normal ScalingReplicaSet deployment/e2e-same-id-a-d04a7d07-kserve Scaled up replica set e2e-same-id-a-d04a7d07-kserve-977f44f6f from 0 to 1 7m6s Normal SuccessfulCreate replicaset/e2e-same-id-a-d04a7d07-kserve-977f44f6f Created pod: e2e-same-id-a-d04a7d07-kserve-977f44f6f-86v8t 7m5s Normal Pulled pod/e2e-same-id-a-d04a7d07-kserve-977f44f6f-86v8t Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod 7m5s Normal Started pod/e2e-same-id-a-d04a7d07-kserve-977f44f6f-86v8t Container started 7m5s Normal Created pod/e2e-same-id-a-d04a7d07-kserve-977f44f6f-86v8t Container created 7m5s Normal AddedInterface pod/e2e-same-id-a-d04a7d07-kserve-977f44f6f-86v8t Add eth0 [10.132.0.208/23] from ovn-kubernetes 7m5s Normal Created llminferenceservice/e2e-same-id-a-d04a7d07 Created v1.PodMonitor llm/e2e-same-id-a-d04a7d07-kserve-llmisvc-engine-default 7m5s Normal Created llminferenceservice/e2e-same-id-a-d04a7d07 Created v1.PodMonitor llm/e2e-same-id-a-d04a7d07-kserve-llmisvc-engine 7m5s Normal Created llminferenceservice/e2e-same-id-a-d04a7d07 Created v1.NetworkPolicy llm/e2e-same-id-a-d04a7d07-prometheus-scraping 7m4s Normal Updated llminferenceservice/e2e-same-id-a-d04a7d07 Updated v1.Secret llm/e2e-same-id-a-d04a7d07-kserve-self-signed-certs 6m54s Normal LLMInferenceServiceReady llminferenceservice/e2e-same-id-a-d04a7d07 LLMInferenceService [e2e-same-id-a-d04a7d07] is Ready 6m49s Normal Created llminferenceservice/e2e-same-id-b-d04a7d07 Created v1.Service llm/e2e-same-id-b-d04a7d07-kserve-workload-svc 6m49s Normal Created llminferenceservice/e2e-same-id-b-d04a7d07 Created v1.PodMonitor llm/e2e-same-id-b-d04a7d07-kserve-llmisvc-engine-default 6m49s Normal Created llminferenceservice/e2e-same-id-b-d04a7d07 Created v1.NetworkPolicy llm/e2e-same-id-b-d04a7d07-prometheus-scraping 6m49s Normal Created llminferenceservice/e2e-same-id-b-d04a7d07 Created v1.PodMonitor llm/e2e-same-id-b-d04a7d07-kserve-llmisvc-engine 6m49s Normal Created llminferenceservice/e2e-same-id-b-d04a7d07 Created v1.DestinationRule llm/e2e-same-id-b-d04a7d07-kserve-workload-svc 6m49s Normal Created llminferenceservice/e2e-same-id-b-d04a7d07 Created v1.HTTPRoute llm/e2e-same-id-b-d04a7d07-kserve-route 6m49s Normal Created llminferenceservice/e2e-same-id-b-d04a7d07 Created v1.Deployment llm/e2e-same-id-b-d04a7d07-kserve 6m49s Normal Created llminferenceservice/e2e-same-id-b-d04a7d07 Created v1.Secret llm/e2e-same-id-b-d04a7d07-kserve-self-signed-certs 6m49s Normal SuccessfulCreate replicaset/e2e-same-id-b-d04a7d07-kserve-58cb574f4f Created pod: e2e-same-id-b-d04a7d07-kserve-58cb574f4f-55jpw 6m49s Normal ScalingReplicaSet deployment/e2e-same-id-b-d04a7d07-kserve Scaled up replica set e2e-same-id-b-d04a7d07-kserve-58cb574f4f from 0 to 1 6m48s Normal Started pod/e2e-same-id-b-d04a7d07-kserve-58cb574f4f-55jpw Container started 6m48s Normal Created pod/e2e-same-id-b-d04a7d07-kserve-58cb574f4f-55jpw Container created 6m48s Normal Pulled pod/e2e-same-id-b-d04a7d07-kserve-58cb574f4f-55jpw Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod 6m48s Normal AddedInterface pod/e2e-same-id-b-d04a7d07-kserve-58cb574f4f-55jpw Add eth0 [10.134.1.50/23] from ovn-kubernetes 6m42s Normal Updated llminferenceservice/e2e-same-id-b-d04a7d07 Updated v1.Secret llm/e2e-same-id-b-d04a7d07-kserve-self-signed-certs 6m36s Normal LLMInferenceServiceReady llminferenceservice/e2e-same-id-b-d04a7d07 LLMInferenceService [e2e-same-id-b-d04a7d07] is Ready 6m29s Warning ModelNameCollision llminferenceservice/e2e-same-id-b-d04a7d07 model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-d04a7d07 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-d04a7d07; safe to ignore if traffic splitting is planned 6m29s Warning ModelNameCollision llminferenceservice/e2e-same-id-a-d04a7d07 model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-d04a7d07 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-d04a7d07; safe to ignore if traffic splitting is planned 6m21s Normal Killing pod/e2e-same-id-a-d04a7d07-kserve-977f44f6f-86v8t Stopping container main 6m16s Normal Killing pod/e2e-same-id-b-d04a7d07-kserve-58cb574f4f-55jpw Stopping container main 6m1s Warning Unhealthy pod/e2e-same-id-b-d04a7d07-kserve-58cb574f4f-55jpw Readiness probe failed: Get "https://10.134.1.50:8000/ready": EOF