=== events in llm (2026-10-30T18:53:03Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 44m Normal Scheduled pod/echo-simulator-kserve-64b6f8f96c-7wj9m Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-7wj9m to ip-10-0-133-47.ec2.internal 6m56s Normal Scheduled pod/e2e-same-id-b-c4c39655-kserve-5c4998bf45-kfr5m Successfully assigned llm/e2e-same-id-b-c4c39655-kserve-5c4998bf45-kfr5m to ip-10-0-141-106.ec2.internal 6m41s Warning ModelNameConflict maasmodelref/e2e-same-id-b-c4c39655 Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-c4c39655 6m29s Normal ModelNameConflictResolved maasmodelref/e2e-same-id-b-c4c39655 Model identity is no longer shared with any other MaaSModelRef in this namespace 43m Normal Scheduled pod/e2e-trlp-test-simulated-kserve-69b588897d-lz5rk Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-lz5rk to ip-10-0-133-47.ec2.internal 43m Normal Scheduled pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b89khc2 Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b89khc2 to ip-10-0-141-106.ec2.internal 44m Normal Scheduled pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9nrcz Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9nrcz to ip-10-0-133-47.ec2.internal 7m13s Normal Scheduled pod/e2e-same-id-a-c4c39655-kserve-6d899465d5-mglk8 Successfully assigned llm/e2e-same-id-a-c4c39655-kserve-6d899465d5-mglk8 to ip-10-0-141-106.ec2.internal 44m Normal Scheduled pod/e2e-distinct-simulated-kserve-7b998b79d9-7gjfw Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-7gjfw to ip-10-0-133-47.ec2.internal 6m41s Warning ModelNameConflict maasmodelref/e2e-same-id-a-c4c39655 Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-c4c39655 44m Normal Scheduled pod/e2e-embedding-simulated-kserve-67bf594cd6-7k4cr Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-7k4cr to ip-10-0-141-106.ec2.internal 44m Normal Scheduled pod/facebook-opt-125m-simulated-kserve-84b4ff656c-vz5dk Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-vz5dk to ip-10-0-133-47.ec2.internal 44m Normal Scheduled pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xbqdd Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xbqdd to ip-10-0-133-47.ec2.internal 44m Normal Created llminferenceservice/echo-simulator Created v1.Secret llm/echo-simulator-kserve-self-signed-certs 44m Normal Created llminferenceservice/echo-simulator Created v1.Service llm/echo-simulator-kserve-workload-svc 44m Normal Created llminferenceservice/echo-simulator Created v1.Deployment llm/echo-simulator-kserve 44m Normal Created llminferenceservice/echo-simulator Created v1.HTTPRoute llm/echo-simulator-kserve-route 44m Normal Created llminferenceservice/echo-simulator Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc 44m Normal Created llminferenceservice/echo-simulator Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default 44m Normal Created llminferenceservice/echo-simulator Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine 44m Normal ScalingReplicaSet deployment/echo-simulator-kserve Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1 44m Normal SuccessfulCreate replicaset/echo-simulator-kserve-64b6f8f96c Created pod: echo-simulator-kserve-64b6f8f96c-7wj9m 44m Normal Created llminferenceservice/echo-simulator Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping 44m Normal Pulling pod/echo-simulator-kserve-64b6f8f96c-7wj9m Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" 44m Normal AddedInterface pod/echo-simulator-kserve-64b6f8f96c-7wj9m Add eth0 [10.134.0.46/23] from ovn-kubernetes 44m Normal SuccessfulCreate replicaset/facebook-opt-125m-simulated-kserve-84b4ff656c Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-vz5dk 44m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs 44m Normal ScalingReplicaSet deployment/facebook-opt-125m-simulated-kserve Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1 44m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping 44m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Deployment llm/facebook-opt-125m-simulated-kserve 44m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine 44m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default 44m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc 44m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route 44m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc 44m Normal ScalingReplicaSet deployment/premium-simulated-simulated-premium-kserve Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1 44m Normal AddedInterface pod/facebook-opt-125m-simulated-kserve-84b4ff656c-vz5dk Add eth0 [10.134.0.47/23] from ovn-kubernetes 44m Normal Pulling pod/facebook-opt-125m-simulated-kserve-84b4ff656c-vz5dk Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 44m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Deployment llm/premium-simulated-simulated-premium-kserve 44m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc 44m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route 44m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs 44m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc 44m Normal SuccessfulCreate replicaset/premium-simulated-simulated-premium-kserve-5f5c4b459f Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-xbqdd 44m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine 44m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping 44m Normal Pulling pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xbqdd Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 44m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default 44m Normal AddedInterface pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xbqdd Add eth0 [10.134.0.48/23] from ovn-kubernetes 44m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine 44m Normal ScalingReplicaSet deployment/e2e-distinct-2-simulated-kserve Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1 44m Normal SuccessfulCreate replicaset/e2e-distinct-2-simulated-kserve-cbd4f5586 Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-9nrcz 44m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default 44m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc 44m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route 44m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc 44m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Deployment llm/e2e-distinct-2-simulated-kserve 44m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs 44m Normal AddedInterface pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9nrcz Add eth0 [10.134.0.49/23] from ovn-kubernetes 44m Normal Pulling pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9nrcz Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 44m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping 44m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route 44m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs 44m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc 44m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping 44m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc 44m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Deployment llm/e2e-distinct-simulated-kserve 44m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine 44m Normal SuccessfulCreate replicaset/e2e-distinct-simulated-kserve-7b998b79d9 Created pod: e2e-distinct-simulated-kserve-7b998b79d9-7gjfw 44m Normal Pulled pod/echo-simulator-kserve-64b6f8f96c-7wj9m Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 6.058s (6.058s including waiting). Image size: 78208878 bytes. 44m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default 44m Normal ScalingReplicaSet deployment/e2e-distinct-simulated-kserve Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1 44m Normal Created pod/echo-simulator-kserve-64b6f8f96c-7wj9m Container created 44m Normal Started pod/facebook-opt-125m-simulated-kserve-84b4ff656c-vz5dk Container started 44m Normal Started pod/echo-simulator-kserve-64b6f8f96c-7wj9m Container started 44m Normal Pulling pod/e2e-distinct-simulated-kserve-7b998b79d9-7gjfw Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 44m Normal AddedInterface pod/e2e-distinct-simulated-kserve-7b998b79d9-7gjfw Add eth0 [10.134.0.50/23] from ovn-kubernetes 44m Normal Created pod/facebook-opt-125m-simulated-kserve-84b4ff656c-vz5dk Container created 44m Normal Pulled pod/facebook-opt-125m-simulated-kserve-84b4ff656c-vz5dk Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 5.499s (5.499s including waiting). Image size: 98346788 bytes. 44m Normal ScalingReplicaSet deployment/e2e-embedding-simulated-kserve Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1 44m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Deployment llm/e2e-embedding-simulated-kserve 44m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route 44m Normal Pulled pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9nrcz Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 2.768s (2.768s including waiting). Image size: 98346788 bytes. 44m Normal Created pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9nrcz Container created 44m Normal Started pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9nrcz Container started 44m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc 44m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default 44m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs 44m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc 44m Normal SuccessfulCreate replicaset/e2e-embedding-simulated-kserve-67bf594cd6 Created pod: e2e-embedding-simulated-kserve-67bf594cd6-7k4cr 44m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine 44m Normal Created pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xbqdd Container created 44m Normal Pulled pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xbqdd Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 4.906s (4.906s including waiting). Image size: 98346788 bytes. 44m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping 44m Normal Started pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xbqdd Container started 44m Normal Pulled pod/e2e-distinct-simulated-kserve-7b998b79d9-7gjfw Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.788s (1.788s including waiting). Image size: 98346788 bytes. 44m Normal Created pod/e2e-distinct-simulated-kserve-7b998b79d9-7gjfw Container created 44m Normal Started pod/e2e-distinct-simulated-kserve-7b998b79d9-7gjfw Container started 44m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs 44m Normal Pulling pod/e2e-embedding-simulated-kserve-67bf594cd6-7k4cr Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 44m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Deployment llm/e2e-trlp-test-simulated-kserve 44m Normal AddedInterface pod/e2e-embedding-simulated-kserve-67bf594cd6-7k4cr Add eth0 [10.133.0.25/23] from ovn-kubernetes 43m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route 43m Normal SuccessfulCreate replicaset/e2e-trlp-test-simulated-kserve-69b588897d Created pod: e2e-trlp-test-simulated-kserve-69b588897d-lz5rk 43m Normal Pulled pod/e2e-embedding-simulated-kserve-67bf594cd6-7k4cr Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.306s (1.306s including waiting). Image size: 98346788 bytes. 43m Normal ScalingReplicaSet deployment/e2e-trlp-test-simulated-kserve Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1 43m Normal Created pod/e2e-embedding-simulated-kserve-67bf594cd6-7k4cr Container created 43m Normal Started pod/e2e-embedding-simulated-kserve-67bf594cd6-7k4cr Container started 43m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc 43m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc 43m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default 43m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine 43m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping 43m Normal Pulling pod/e2e-trlp-test-simulated-kserve-69b588897d-lz5rk Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 43m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc 43m Normal AddedInterface pod/e2e-trlp-test-simulated-kserve-69b588897d-lz5rk Add eth0 [10.134.0.51/23] from ovn-kubernetes 43m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs 43m Normal Pulled pod/e2e-trlp-test-simulated-kserve-69b588897d-lz5rk Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 218ms (218ms including waiting). Image size: 98346788 bytes. 43m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine 43m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default 43m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping 43m Normal ScalingReplicaSet deployment/e2e-unconfigured-facebook-opt-125m-simulated-kserve Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1 43m Normal SuccessfulCreate replicaset/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b89khc2 43m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve 43m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc 43m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route 43m Normal AddedInterface pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b89khc2 Add eth0 [10.133.0.26/23] from ovn-kubernetes 43m Normal Pulling pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b89khc2 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 43m Normal Started pod/e2e-trlp-test-simulated-kserve-69b588897d-lz5rk Container started 43m Normal Pulled pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b89khc2 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 257ms (257ms including waiting). Image size: 98346788 bytes. 43m Normal Created pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b89khc2 Container created 43m Normal Started pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b89khc2 Container started 43m Normal Created pod/e2e-trlp-test-simulated-kserve-69b588897d-lz5rk Container created 43m Normal Updated llminferenceservice/echo-simulator Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs 43m Normal Updated llminferenceservice/facebook-opt-125m-simulated Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs 43m Normal Updated llminferenceservice/premium-simulated-simulated-premium Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs 43m Normal Updated llminferenceservice/e2e-distinct-2-simulated Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs 43m Normal Updated llminferenceservice/e2e-distinct-simulated Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs 43m Normal LLMInferenceServiceReady llminferenceservice/e2e-distinct-simulated LLMInferenceService [e2e-distinct-simulated] is Ready 43m Normal Updated llminferenceservice/e2e-embedding-simulated Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs 43m Normal LLMInferenceServiceReady llminferenceservice/e2e-embedding-simulated LLMInferenceService [e2e-embedding-simulated] is Ready 43m Normal Updated llminferenceservice/e2e-trlp-test-simulated Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs 43m Normal Updated llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs 43m Normal LLMInferenceServiceReady llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready 39m Warning Unhealthy pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9nrcz Liveness probe failed: Get "https://10.134.0.49:8000/health": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 39m Warning Unhealthy pod/echo-simulator-kserve-64b6f8f96c-7wj9m Readiness probe failed: Get "https://10.134.0.46:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 39m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xbqdd Readiness probe failed: Get "https://10.134.0.48:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 38m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xbqdd Liveness probe failed: Get "https://10.134.0.48:8000/health": context deadline exceeded 38m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xbqdd Liveness probe failed: Get "https://10.134.0.48:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 38m Warning Unhealthy pod/facebook-opt-125m-simulated-kserve-84b4ff656c-vz5dk Readiness probe failed: Get "https://10.134.0.47:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 38m Warning Unhealthy pod/e2e-distinct-simulated-kserve-7b998b79d9-7gjfw Liveness probe failed: Get "https://10.134.0.50:8000/health": context deadline exceeded 38m Warning Unhealthy pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9nrcz Readiness probe failed: Get "https://10.134.0.49:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 37m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-lz5rk Liveness probe failed: Get "https://10.134.0.51:8000/health": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 37m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-lz5rk Readiness probe failed: Get "https://10.134.0.51:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 37m Warning Unhealthy pod/echo-simulator-kserve-64b6f8f96c-7wj9m Readiness probe failed: Get "https://10.134.0.46:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 37m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-lz5rk Liveness probe failed: Get "https://10.134.0.51:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 35m Warning Unhealthy pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b89khc2 Readiness probe failed: Get "https://10.133.0.26:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 35m Warning Unhealthy pod/e2e-embedding-simulated-kserve-67bf594cd6-7k4cr Readiness probe failed: Get "https://10.133.0.25:8000/ready": context deadline exceeded 35m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xbqdd Readiness probe failed: Get "https://10.134.0.48:8000/ready": context deadline exceeded 34m Warning Unhealthy pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b89khc2 Readiness probe failed: Get "https://10.133.0.26:8000/ready": context deadline exceeded 34m Warning Unhealthy pod/e2e-distinct-simulated-kserve-7b998b79d9-7gjfw Readiness probe failed: Get "https://10.134.0.50:8000/ready": context deadline exceeded 34m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-lz5rk Readiness probe failed: Get "https://10.134.0.51:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 34m Warning Unhealthy pod/e2e-embedding-simulated-kserve-67bf594cd6-7k4cr Readiness probe failed: Get "https://10.133.0.25:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 34m Warning Unhealthy pod/e2e-distinct-simulated-kserve-7b998b79d9-7gjfw Readiness probe failed: Get "https://10.134.0.50:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 34m Warning Unhealthy pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9nrcz Liveness probe failed: Get "https://10.134.0.49:8000/health": context deadline exceeded 30m Warning NodeNotReady pod/e2e-trlp-test-simulated-kserve-69b588897d-lz5rk Node is not ready 30m Warning NodeNotReady pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9nrcz Node is not ready 30m Warning NodeNotReady pod/echo-simulator-kserve-64b6f8f96c-7wj9m Node is not ready 30m Warning NodeNotReady pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xbqdd Node is not ready 30m Warning LLMInferenceServiceNotReady llminferenceservice/echo-simulator LLMInferenceService [echo-simulator] is no longer Ready because of: MainWorkloadReady, WorkloadsReady 30m Warning NodeNotReady pod/facebook-opt-125m-simulated-kserve-84b4ff656c-vz5dk Node is not ready 30m Warning NodeNotReady pod/e2e-distinct-simulated-kserve-7b998b79d9-7gjfw Node is not ready 30m Warning LLMInferenceServiceNotReady llminferenceservice/e2e-distinct-2-simulated LLMInferenceService [e2e-distinct-2-simulated] is no longer Ready because of: MainWorkloadReady, WorkloadsReady 30m Warning LLMInferenceServiceNotReady llminferenceservice/e2e-trlp-test-simulated LLMInferenceService [e2e-trlp-test-simulated] is no longer Ready because of: MainWorkloadReady, WorkloadsReady 30m Normal TaintManagerEviction pod/e2e-trlp-test-simulated-kserve-69b588897d-lz5rk Cancelling deletion of Pod llm/e2e-trlp-test-simulated-kserve-69b588897d-lz5rk 30m Normal TaintManagerEviction pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xbqdd Cancelling deletion of Pod llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-xbqdd 30m Normal TaintManagerEviction pod/echo-simulator-kserve-64b6f8f96c-7wj9m Cancelling deletion of Pod llm/echo-simulator-kserve-64b6f8f96c-7wj9m 30m Normal TaintManagerEviction pod/facebook-opt-125m-simulated-kserve-84b4ff656c-vz5dk Cancelling deletion of Pod llm/facebook-opt-125m-simulated-kserve-84b4ff656c-vz5dk 30m Normal TaintManagerEviction pod/e2e-distinct-simulated-kserve-7b998b79d9-7gjfw Cancelling deletion of Pod llm/e2e-distinct-simulated-kserve-7b998b79d9-7gjfw 30m Normal TaintManagerEviction pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9nrcz Cancelling deletion of Pod llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9nrcz 30m Normal LLMInferenceServiceReady llminferenceservice/echo-simulator LLMInferenceService [echo-simulator] is Ready 30m Normal LLMInferenceServiceReady llminferenceservice/e2e-distinct-2-simulated LLMInferenceService [e2e-distinct-2-simulated] is Ready 30m Normal LLMInferenceServiceReady llminferenceservice/e2e-trlp-test-simulated LLMInferenceService [e2e-trlp-test-simulated] is Ready 28m Warning Unhealthy pod/echo-simulator-kserve-64b6f8f96c-7wj9m Readiness probe failed: Get "https://10.134.0.46:8000/ready": context deadline exceeded 28m Warning Unhealthy pod/facebook-opt-125m-simulated-kserve-84b4ff656c-vz5dk Readiness probe failed: Get "https://10.134.0.47:8000/ready": context deadline exceeded 28m Warning Unhealthy pod/e2e-distinct-simulated-kserve-7b998b79d9-7gjfw Liveness probe failed: Get "https://10.134.0.50:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 28m Warning Unhealthy pod/facebook-opt-125m-simulated-kserve-84b4ff656c-vz5dk Liveness probe failed: Get "https://10.134.0.47:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 28m Warning Unhealthy pod/echo-simulator-kserve-64b6f8f96c-7wj9m Liveness probe failed: Get "https://10.134.0.46:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 28m Warning Unhealthy pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9nrcz Liveness probe failed: Get "https://10.134.0.49:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 28m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-lz5rk Readiness probe failed: Get "https://10.134.0.51:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 28m Warning Unhealthy pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9nrcz Readiness probe failed: Get "https://10.134.0.49:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 28m Warning Unhealthy pod/e2e-distinct-2-simulated-kserve-cbd4f5586-9nrcz Readiness probe failed: Get "https://10.134.0.49:8000/ready": context deadline exceeded 28m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-lz5rk Liveness probe failed: Get "https://10.134.0.51:8000/health": context deadline exceeded 28m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-lz5rk Readiness probe failed: Get "https://10.134.0.51:8000/ready": context deadline exceeded 28m Warning Unhealthy pod/facebook-opt-125m-simulated-kserve-84b4ff656c-vz5dk Readiness probe failed: Get "https://10.134.0.47:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 28m Warning Unhealthy pod/echo-simulator-kserve-64b6f8f96c-7wj9m Readiness probe failed: Get "https://10.134.0.46:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 28m Warning Unhealthy pod/e2e-distinct-simulated-kserve-7b998b79d9-7gjfw Readiness probe failed: Get "https://10.134.0.50:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 28m Warning LLMInferenceServiceNotReady llminferenceservice/facebook-opt-125m-simulated LLMInferenceService [facebook-opt-125m-simulated] is no longer Ready because of: MainWorkloadReady, WorkloadsReady 28m Normal LLMInferenceServiceReady llminferenceservice/facebook-opt-125m-simulated LLMInferenceService [facebook-opt-125m-simulated] is Ready 27m Warning Unhealthy pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b89khc2 Readiness probe failed: Get "https://10.133.0.26:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 26m Warning LLMInferenceServiceNotReady llminferenceservice/premium-simulated-simulated-premium LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady 26m Normal LLMInferenceServiceReady llminferenceservice/premium-simulated-simulated-premium LLMInferenceService [premium-simulated-simulated-premium] is Ready 25m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-xbqdd Readiness probe failed: Get "https://10.134.0.48:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 7m14s Normal Created llminferenceservice/e2e-same-id-a-c4c39655 Created v1.Secret llm/e2e-same-id-a-c4c39655-kserve-self-signed-certs 7m14s Normal Created llminferenceservice/e2e-same-id-a-c4c39655 Created v1.PodMonitor llm/e2e-same-id-a-c4c39655-kserve-llmisvc-engine 7m14s Normal Created llminferenceservice/e2e-same-id-a-c4c39655 Created v1.Deployment llm/e2e-same-id-a-c4c39655-kserve 7m14s Normal Created llminferenceservice/e2e-same-id-a-c4c39655 Created v1.Service llm/e2e-same-id-a-c4c39655-kserve-workload-svc 7m14s Normal Created llminferenceservice/e2e-same-id-a-c4c39655 Created v1.HTTPRoute llm/e2e-same-id-a-c4c39655-kserve-route 7m14s Normal Created llminferenceservice/e2e-same-id-a-c4c39655 Created v1.DestinationRule llm/e2e-same-id-a-c4c39655-kserve-workload-svc 7m14s Normal Created llminferenceservice/e2e-same-id-a-c4c39655 Created v1.PodMonitor llm/e2e-same-id-a-c4c39655-kserve-llmisvc-engine-default 7m14s Normal ScalingReplicaSet deployment/e2e-same-id-a-c4c39655-kserve Scaled up replica set e2e-same-id-a-c4c39655-kserve-6d899465d5 from 0 to 1 7m14s Normal SuccessfulCreate replicaset/e2e-same-id-a-c4c39655-kserve-6d899465d5 Created pod: e2e-same-id-a-c4c39655-kserve-6d899465d5-mglk8 7m13s Normal AddedInterface pod/e2e-same-id-a-c4c39655-kserve-6d899465d5-mglk8 Add eth0 [10.133.1.22/23] from ovn-kubernetes 7m13s Normal Created llminferenceservice/e2e-same-id-a-c4c39655 Created v1.NetworkPolicy llm/e2e-same-id-a-c4c39655-prometheus-scraping 7m13s Normal Created pod/e2e-same-id-a-c4c39655-kserve-6d899465d5-mglk8 Container created 7m13s Normal Started pod/e2e-same-id-a-c4c39655-kserve-6d899465d5-mglk8 Container started 7m13s Normal Pulled pod/e2e-same-id-a-c4c39655-kserve-6d899465d5-mglk8 Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod 7m6s Normal Updated llminferenceservice/e2e-same-id-a-c4c39655 Updated v1.Secret llm/e2e-same-id-a-c4c39655-kserve-self-signed-certs 7m3s Normal LLMInferenceServiceReady llminferenceservice/e2e-same-id-a-c4c39655 LLMInferenceService [e2e-same-id-a-c4c39655] is Ready 6m57s Normal Created llminferenceservice/e2e-same-id-b-c4c39655 Created v1.Secret llm/e2e-same-id-b-c4c39655-kserve-self-signed-certs 6m57s Normal Created llminferenceservice/e2e-same-id-b-c4c39655 Created v1.DestinationRule llm/e2e-same-id-b-c4c39655-kserve-workload-svc 6m57s Normal Created llminferenceservice/e2e-same-id-b-c4c39655 Created v1.PodMonitor llm/e2e-same-id-b-c4c39655-kserve-llmisvc-engine-default 6m57s Normal SuccessfulCreate replicaset/e2e-same-id-b-c4c39655-kserve-5c4998bf45 Created pod: e2e-same-id-b-c4c39655-kserve-5c4998bf45-kfr5m 6m57s Normal Created llminferenceservice/e2e-same-id-b-c4c39655 Created v1.Service llm/e2e-same-id-b-c4c39655-kserve-workload-svc 6m57s Normal Created llminferenceservice/e2e-same-id-b-c4c39655 Created v1.Deployment llm/e2e-same-id-b-c4c39655-kserve 6m57s Normal Created llminferenceservice/e2e-same-id-b-c4c39655 Created v1.HTTPRoute llm/e2e-same-id-b-c4c39655-kserve-route 6m57s Normal ScalingReplicaSet deployment/e2e-same-id-b-c4c39655-kserve Scaled up replica set e2e-same-id-b-c4c39655-kserve-5c4998bf45 from 0 to 1 6m56s Normal Pulled pod/e2e-same-id-b-c4c39655-kserve-5c4998bf45-kfr5m Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod 6m56s Normal Created llminferenceservice/e2e-same-id-b-c4c39655 Created v1.NetworkPolicy llm/e2e-same-id-b-c4c39655-prometheus-scraping 6m56s Normal Created pod/e2e-same-id-b-c4c39655-kserve-5c4998bf45-kfr5m Container created 6m56s Normal AddedInterface pod/e2e-same-id-b-c4c39655-kserve-5c4998bf45-kfr5m Add eth0 [10.133.1.23/23] from ovn-kubernetes 6m56s Normal Started pod/e2e-same-id-b-c4c39655-kserve-5c4998bf45-kfr5m Container started 6m56s Normal Created llminferenceservice/e2e-same-id-b-c4c39655 Created v1.PodMonitor llm/e2e-same-id-b-c4c39655-kserve-llmisvc-engine 6m49s Normal Updated llminferenceservice/e2e-same-id-b-c4c39655 Updated v1.Secret llm/e2e-same-id-b-c4c39655-kserve-self-signed-certs 6m45s Normal LLMInferenceServiceReady llminferenceservice/e2e-same-id-b-c4c39655 LLMInferenceService [e2e-same-id-b-c4c39655] is Ready 6m37s Warning ModelNameCollision llminferenceservice/e2e-same-id-a-c4c39655 model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-c4c39655 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-c4c39655; safe to ignore if traffic splitting is planned 6m36s Warning ModelNameCollision llminferenceservice/e2e-same-id-b-c4c39655 model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-c4c39655 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-c4c39655; safe to ignore if traffic splitting is planned 6m29s Normal Killing pod/e2e-same-id-a-c4c39655-kserve-6d899465d5-mglk8 Stopping container main 6m23s Normal Killing pod/e2e-same-id-b-c4c39655-kserve-5c4998bf45-kfr5m Stopping container main 6m7s Warning Unhealthy pod/e2e-same-id-b-c4c39655-kserve-5c4998bf45-kfr5m Readiness probe failed: Get "https://10.133.1.23:8000/ready": dial tcp 10.133.1.23:8000: connect: connection refused