=== events in llm (2026-10-31T14:22:21Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 58m Normal Scheduled pod/e2e-embedding-simulated-kserve-67bf594cd6-h4g6w Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-h4g6w to ip-10-0-128-41.us-east-2.compute.internal 58m Normal Scheduled pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-sz264 Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-sz264 to ip-10-0-128-41.us-east-2.compute.internal 58m Normal Scheduled pod/facebook-opt-125m-simulated-kserve-84b4ff656c-sngft Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-sngft to ip-10-0-128-41.us-east-2.compute.internal 58m Normal Scheduled pod/e2e-distinct-2-simulated-kserve-cbd4f5586-msvrg Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-msvrg to ip-10-0-136-168.us-east-2.compute.internal 58m Normal Scheduled pod/echo-simulator-kserve-64b6f8f96c-8b7s6 Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-8b7s6 to ip-10-0-136-168.us-east-2.compute.internal 6m23s Warning ModelNameConflict maasmodelref/e2e-same-id-a-9e257301 Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-9e257301 58m Normal Scheduled pod/e2e-distinct-simulated-kserve-7b998b79d9-596gr Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-596gr to ip-10-0-136-168.us-east-2.compute.internal 6m37s Normal Scheduled pod/e2e-same-id-b-9e257301-kserve-5c7c8c6f89-7kdcq Successfully assigned llm/e2e-same-id-b-9e257301-kserve-5c7c8c6f89-7kdcq to ip-10-0-136-168.us-east-2.compute.internal 6m23s Warning ModelNameConflict maasmodelref/e2e-same-id-b-9e257301 Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-9e257301 6m10s Normal ModelNameConflictResolved maasmodelref/e2e-same-id-b-9e257301 Model identity is no longer shared with any other MaaSModelRef in this namespace 6m53s Normal Scheduled pod/e2e-same-id-a-9e257301-kserve-7757f88cc-cc2wt Successfully assigned llm/e2e-same-id-a-9e257301-kserve-7757f88cc-cc2wt to ip-10-0-136-168.us-east-2.compute.internal 59m Normal Scheduled pod/e2e-trlp-test-simulated-kserve-69b588897d-hql47 Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-hql47 to ip-10-0-136-168.us-east-2.compute.internal 59m Normal Scheduled pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87cf59 Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87cf59 to ip-10-0-136-168.us-east-2.compute.internal 59m Normal AddedInterface pod/e2e-trlp-test-simulated-kserve-69b588897d-hql47 Add eth0 [10.134.0.32/23] from ovn-kubernetes 59m Normal SuccessfulCreate replicaset/e2e-trlp-test-simulated-kserve-69b588897d Created pod: e2e-trlp-test-simulated-kserve-69b588897d-hql47 59m Normal ScalingReplicaSet deployment/e2e-trlp-test-simulated-kserve Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1 59m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs 59m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Deployment llm/e2e-trlp-test-simulated-kserve 59m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc 59m Normal Pulling pod/e2e-trlp-test-simulated-kserve-69b588897d-hql47 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 59m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route 59m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc 59m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping 59m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine 59m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default 59m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc 59m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route 59m Normal Pulling pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87cf59 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 59m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping 59m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine 59m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default 59m Normal SuccessfulCreate replicaset/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87cf59 59m Normal Started pod/e2e-trlp-test-simulated-kserve-69b588897d-hql47 Container started 59m Normal Created pod/e2e-trlp-test-simulated-kserve-69b588897d-hql47 Container created 59m Normal Pulled pod/e2e-trlp-test-simulated-kserve-69b588897d-hql47 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.806s (1.806s including waiting). Image size: 98346788 bytes. 59m Normal ScalingReplicaSet deployment/e2e-unconfigured-facebook-opt-125m-simulated-kserve Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1 59m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs 59m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve 59m Normal AddedInterface pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87cf59 Add eth0 [10.134.0.33/23] from ovn-kubernetes 59m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc 59m Normal Started pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87cf59 Container started 59m Normal Created pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87cf59 Container created 59m Normal Pulled pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87cf59 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 414ms (414ms including waiting). Image size: 98346788 bytes. 58m Normal ScalingReplicaSet deployment/echo-simulator-kserve Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1 58m Normal Created llminferenceservice/echo-simulator Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine 58m Normal SuccessfulCreate replicaset/echo-simulator-kserve-64b6f8f96c Created pod: echo-simulator-kserve-64b6f8f96c-8b7s6 58m Normal Created llminferenceservice/echo-simulator Created v1.Secret llm/echo-simulator-kserve-self-signed-certs 58m Normal Created llminferenceservice/echo-simulator Created v1.Deployment llm/echo-simulator-kserve 58m Normal Created llminferenceservice/echo-simulator Created v1.Service llm/echo-simulator-kserve-workload-svc 58m Normal Created llminferenceservice/echo-simulator Created v1.HTTPRoute llm/echo-simulator-kserve-route 58m Normal Created llminferenceservice/echo-simulator Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc 58m Normal Created llminferenceservice/echo-simulator Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default 58m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine 58m Normal SuccessfulCreate replicaset/facebook-opt-125m-simulated-kserve-84b4ff656c Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-sngft 58m Normal AddedInterface pod/echo-simulator-kserve-64b6f8f96c-8b7s6 Add eth0 [10.134.0.34/23] from ovn-kubernetes 58m Normal Pulling pod/echo-simulator-kserve-64b6f8f96c-8b7s6 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" 58m Normal Created llminferenceservice/echo-simulator Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping 58m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc 58m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route 58m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Deployment llm/facebook-opt-125m-simulated-kserve 58m Normal ScalingReplicaSet deployment/facebook-opt-125m-simulated-kserve Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1 58m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping 58m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs 58m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default 58m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc 58m Normal Pulling pod/facebook-opt-125m-simulated-kserve-84b4ff656c-sngft Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 58m Normal AddedInterface pod/facebook-opt-125m-simulated-kserve-84b4ff656c-sngft Add eth0 [10.132.0.38/23] from ovn-kubernetes 58m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default 58m Normal ScalingReplicaSet deployment/premium-simulated-simulated-premium-kserve Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1 58m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping 58m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine 58m Normal SuccessfulCreate replicaset/premium-simulated-simulated-premium-kserve-5f5c4b459f Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-sz264 58m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc 58m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route 58m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc 58m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Deployment llm/premium-simulated-simulated-premium-kserve 58m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs 58m Normal AddedInterface pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-sz264 Add eth0 [10.132.0.39/23] from ovn-kubernetes 58m Normal Pulled pod/echo-simulator-kserve-64b6f8f96c-8b7s6 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 2.615s (2.615s including waiting). Image size: 78208878 bytes. 58m Normal Created pod/echo-simulator-kserve-64b6f8f96c-8b7s6 Container created 58m Normal Pulling pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-sz264 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 58m Normal Started pod/echo-simulator-kserve-64b6f8f96c-8b7s6 Container started 58m Normal Started pod/facebook-opt-125m-simulated-kserve-84b4ff656c-sngft Container started 58m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs 58m Normal Created pod/facebook-opt-125m-simulated-kserve-84b4ff656c-sngft Container created 58m Normal ScalingReplicaSet deployment/e2e-distinct-2-simulated-kserve Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1 58m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc 58m Normal Pulled pod/facebook-opt-125m-simulated-kserve-84b4ff656c-sngft Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 3.455s (3.455s including waiting). Image size: 98346788 bytes. 58m Normal Pulled pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-sz264 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.905s (1.905s including waiting). Image size: 98346788 bytes. 58m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Deployment llm/e2e-distinct-2-simulated-kserve 58m Normal SuccessfulCreate replicaset/e2e-distinct-2-simulated-kserve-cbd4f5586 Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-msvrg 58m Normal Started pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-sz264 Container started 58m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine 58m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping 58m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default 58m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc 58m Normal Created pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-sz264 Container created 58m Normal Pulling pod/e2e-distinct-2-simulated-kserve-cbd4f5586-msvrg Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 58m Normal AddedInterface pod/e2e-distinct-2-simulated-kserve-cbd4f5586-msvrg Add eth0 [10.134.0.35/23] from ovn-kubernetes 58m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route 58m Normal Pulled pod/e2e-distinct-2-simulated-kserve-cbd4f5586-msvrg Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 391ms (391ms including waiting). Image size: 98346788 bytes. 58m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs 58m Normal Created pod/e2e-distinct-2-simulated-kserve-cbd4f5586-msvrg Container created 58m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping 58m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine 58m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default 58m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc 58m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route 58m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc 58m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Deployment llm/e2e-distinct-simulated-kserve 58m Normal Started pod/e2e-distinct-2-simulated-kserve-cbd4f5586-msvrg Container started 58m Normal SuccessfulCreate replicaset/e2e-distinct-simulated-kserve-7b998b79d9 Created pod: e2e-distinct-simulated-kserve-7b998b79d9-596gr 58m Normal ScalingReplicaSet deployment/e2e-distinct-simulated-kserve Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1 58m Normal AddedInterface pod/e2e-distinct-simulated-kserve-7b998b79d9-596gr Add eth0 [10.134.0.36/23] from ovn-kubernetes 58m Normal Started pod/e2e-distinct-simulated-kserve-7b998b79d9-596gr Container started 58m Normal Pulling pod/e2e-distinct-simulated-kserve-7b998b79d9-596gr Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 58m Normal Pulled pod/e2e-distinct-simulated-kserve-7b998b79d9-596gr Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 274ms (274ms including waiting). Image size: 98346788 bytes. 58m Normal Created pod/e2e-distinct-simulated-kserve-7b998b79d9-596gr Container created 58m Normal SuccessfulCreate replicaset/e2e-embedding-simulated-kserve-67bf594cd6 Created pod: e2e-embedding-simulated-kserve-67bf594cd6-h4g6w 58m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default 58m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc 58m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc 58m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route 58m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping 58m Normal ScalingReplicaSet deployment/e2e-embedding-simulated-kserve Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1 58m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Deployment llm/e2e-embedding-simulated-kserve 58m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs 58m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine 58m Normal Pulling pod/e2e-embedding-simulated-kserve-67bf594cd6-h4g6w Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 58m Normal Updated llminferenceservice/e2e-trlp-test-simulated Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs 58m Normal Pulled pod/e2e-embedding-simulated-kserve-67bf594cd6-h4g6w Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 511ms (511ms including waiting). Image size: 98346788 bytes. 58m Normal AddedInterface pod/e2e-embedding-simulated-kserve-67bf594cd6-h4g6w Add eth0 [10.132.0.40/23] from ovn-kubernetes 58m Normal LLMInferenceServiceReady llminferenceservice/e2e-trlp-test-simulated LLMInferenceService [e2e-trlp-test-simulated] is Ready 58m Normal Created pod/e2e-embedding-simulated-kserve-67bf594cd6-h4g6w Container created 58m Normal Started pod/e2e-embedding-simulated-kserve-67bf594cd6-h4g6w Container started 58m Normal Updated llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs 58m Normal LLMInferenceServiceReady llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready 58m Normal Updated llminferenceservice/echo-simulator Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs 58m Normal LLMInferenceServiceReady llminferenceservice/echo-simulator LLMInferenceService [echo-simulator] is Ready 58m Normal Updated llminferenceservice/facebook-opt-125m-simulated Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs 58m Normal LLMInferenceServiceReady llminferenceservice/facebook-opt-125m-simulated LLMInferenceService [facebook-opt-125m-simulated] is Ready 58m Normal Updated llminferenceservice/premium-simulated-simulated-premium Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs 58m Normal LLMInferenceServiceReady llminferenceservice/e2e-distinct-2-simulated LLMInferenceService [e2e-distinct-2-simulated] is Ready 58m Normal Updated llminferenceservice/e2e-distinct-simulated Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs 58m Normal Updated llminferenceservice/e2e-distinct-2-simulated Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs 58m Normal LLMInferenceServiceReady llminferenceservice/e2e-distinct-simulated LLMInferenceService [e2e-distinct-simulated] is Ready 58m Normal Updated llminferenceservice/e2e-embedding-simulated Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs 58m Normal LLMInferenceServiceReady llminferenceservice/e2e-embedding-simulated LLMInferenceService [e2e-embedding-simulated] is Ready 53m Warning Unhealthy pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87cf59 Readiness probe failed: Get "https://10.134.0.33:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 52m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-sz264 Liveness probe failed: Get "https://10.132.0.39:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 52m Warning Unhealthy pod/echo-simulator-kserve-64b6f8f96c-8b7s6 Readiness probe failed: Get "https://10.134.0.34:8000/ready": context deadline exceeded 52m Warning Unhealthy pod/e2e-distinct-simulated-kserve-7b998b79d9-596gr Readiness probe failed: Get "https://10.134.0.36:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 52m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-hql47 Readiness probe failed: Get "https://10.134.0.32:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 52m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-sz264 Liveness probe failed: Get "https://10.132.0.39:8000/health": context deadline exceeded 52m Warning Unhealthy pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87cf59 Readiness probe failed: Get "https://10.134.0.33:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 52m Warning Unhealthy pod/e2e-distinct-simulated-kserve-7b998b79d9-596gr Readiness probe failed: Get "https://10.134.0.36:8000/ready": context deadline exceeded 52m Warning Unhealthy pod/facebook-opt-125m-simulated-kserve-84b4ff656c-sngft Readiness probe failed: Get "https://10.132.0.38:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 52m Warning Unhealthy pod/e2e-distinct-simulated-kserve-7b998b79d9-596gr Liveness probe failed: Get "https://10.134.0.36:8000/health": context deadline exceeded 52m Warning Unhealthy pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87cf59 Readiness probe failed: Get "https://10.134.0.33:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 51m Warning Unhealthy pod/e2e-embedding-simulated-kserve-67bf594cd6-h4g6w Readiness probe failed: Get "https://10.132.0.40:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 50m Warning Unhealthy pod/e2e-distinct-simulated-kserve-7b998b79d9-596gr Readiness probe failed: Get "https://10.134.0.36:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 50m Warning Unhealthy pod/e2e-distinct-2-simulated-kserve-cbd4f5586-msvrg Readiness probe failed: Get "https://10.134.0.35:8000/ready": context deadline exceeded 50m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-hql47 Readiness probe failed: Get "https://10.134.0.32:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 50m Warning Unhealthy pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b87cf59 Readiness probe failed: Get "https://10.134.0.33:8000/ready": context deadline exceeded 47m Warning LLMInferenceServiceNotReady llminferenceservice/premium-simulated-simulated-premium LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady 47m Warning Unhealthy pod/e2e-embedding-simulated-kserve-67bf594cd6-h4g6w Readiness probe failed: Get "https://10.132.0.40:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 47m Warning Unhealthy pod/e2e-embedding-simulated-kserve-67bf594cd6-h4g6w Readiness probe failed: Get "https://10.132.0.40:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 47m Normal LLMInferenceServiceReady llminferenceservice/premium-simulated-simulated-premium LLMInferenceService [premium-simulated-simulated-premium] is Ready 46m Warning Unhealthy pod/echo-simulator-kserve-64b6f8f96c-8b7s6 Readiness probe failed: Get "https://10.134.0.34:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 43m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-hql47 Readiness probe failed: Get "https://10.134.0.32:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 39m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-sz264 Readiness probe failed: Get "https://10.132.0.39:8000/ready": context deadline exceeded 27m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-sz264 Liveness probe failed: Get "https://10.132.0.39:8000/health": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 27m Warning Unhealthy pod/facebook-opt-125m-simulated-kserve-84b4ff656c-sngft Readiness probe failed: Get "https://10.132.0.38:8000/ready": context deadline exceeded 27m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-sz264 Readiness probe failed: Get "https://10.132.0.39:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 6m54s Normal Created llminferenceservice/e2e-same-id-a-9e257301 Created v1.Service llm/e2e-same-id-a-9e257301-kserve-workload-svc 6m54s Normal Created llminferenceservice/e2e-same-id-a-9e257301 Created v1.Deployment llm/e2e-same-id-a-9e257301-kserve 6m54s Normal Created llminferenceservice/e2e-same-id-a-9e257301 Created v1.Secret llm/e2e-same-id-a-9e257301-kserve-self-signed-certs 6m54s Normal ScalingReplicaSet deployment/e2e-same-id-a-9e257301-kserve Scaled up replica set e2e-same-id-a-9e257301-kserve-7757f88cc from 0 to 1 6m54s Normal SuccessfulCreate replicaset/e2e-same-id-a-9e257301-kserve-7757f88cc Created pod: e2e-same-id-a-9e257301-kserve-7757f88cc-cc2wt 6m53s Normal Created llminferenceservice/e2e-same-id-a-9e257301 Created v1.NetworkPolicy llm/e2e-same-id-a-9e257301-prometheus-scraping 6m53s Normal Created pod/e2e-same-id-a-9e257301-kserve-7757f88cc-cc2wt Container created 6m53s Normal Pulled pod/e2e-same-id-a-9e257301-kserve-7757f88cc-cc2wt Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod 6m53s Normal AddedInterface pod/e2e-same-id-a-9e257301-kserve-7757f88cc-cc2wt Add eth0 [10.134.1.89/23] from ovn-kubernetes 6m53s Normal Started pod/e2e-same-id-a-9e257301-kserve-7757f88cc-cc2wt Container started 6m53s Normal Created llminferenceservice/e2e-same-id-a-9e257301 Created v1.HTTPRoute llm/e2e-same-id-a-9e257301-kserve-route 6m53s Normal Created llminferenceservice/e2e-same-id-a-9e257301 Created v1.DestinationRule llm/e2e-same-id-a-9e257301-kserve-workload-svc 6m53s Normal Created llminferenceservice/e2e-same-id-a-9e257301 Created v1.PodMonitor llm/e2e-same-id-a-9e257301-kserve-llmisvc-engine-default 6m53s Normal Created llminferenceservice/e2e-same-id-a-9e257301 Created v1.PodMonitor llm/e2e-same-id-a-9e257301-kserve-llmisvc-engine 6m49s Normal Updated llminferenceservice/e2e-same-id-a-9e257301 Updated v1.Secret llm/e2e-same-id-a-9e257301-kserve-self-signed-certs 6m42s Normal LLMInferenceServiceReady llminferenceservice/e2e-same-id-a-9e257301 LLMInferenceService [e2e-same-id-a-9e257301] is Ready 6m37s Normal ScalingReplicaSet deployment/e2e-same-id-b-9e257301-kserve Scaled up replica set e2e-same-id-b-9e257301-kserve-5c7c8c6f89 from 0 to 1 6m37s Normal Created llminferenceservice/e2e-same-id-b-9e257301 Created v1.Deployment llm/e2e-same-id-b-9e257301-kserve 6m37s Normal Created llminferenceservice/e2e-same-id-b-9e257301 Created v1.NetworkPolicy llm/e2e-same-id-b-9e257301-prometheus-scraping 6m37s Normal AddedInterface pod/e2e-same-id-b-9e257301-kserve-5c7c8c6f89-7kdcq Add eth0 [10.134.1.90/23] from ovn-kubernetes 6m37s Normal Pulled pod/e2e-same-id-b-9e257301-kserve-5c7c8c6f89-7kdcq Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod 6m37s Normal Created pod/e2e-same-id-b-9e257301-kserve-5c7c8c6f89-7kdcq Container created 6m37s Normal Started pod/e2e-same-id-b-9e257301-kserve-5c7c8c6f89-7kdcq Container started 6m37s Normal Created llminferenceservice/e2e-same-id-b-9e257301 Created v1.PodMonitor llm/e2e-same-id-b-9e257301-kserve-llmisvc-engine 6m37s Normal SuccessfulCreate replicaset/e2e-same-id-b-9e257301-kserve-5c7c8c6f89 Created pod: e2e-same-id-b-9e257301-kserve-5c7c8c6f89-7kdcq 6m37s Normal Created llminferenceservice/e2e-same-id-b-9e257301 Created v1.PodMonitor llm/e2e-same-id-b-9e257301-kserve-llmisvc-engine-default 6m37s Normal Created llminferenceservice/e2e-same-id-b-9e257301 Created v1.DestinationRule llm/e2e-same-id-b-9e257301-kserve-workload-svc 6m37s Normal Created llminferenceservice/e2e-same-id-b-9e257301 Created v1.Service llm/e2e-same-id-b-9e257301-kserve-workload-svc 6m37s Normal Created llminferenceservice/e2e-same-id-b-9e257301 Created v1.Secret llm/e2e-same-id-b-9e257301-kserve-self-signed-certs 6m37s Normal Created llminferenceservice/e2e-same-id-b-9e257301 Created v1.HTTPRoute llm/e2e-same-id-b-9e257301-kserve-route 6m30s Normal Updated llminferenceservice/e2e-same-id-b-9e257301 Updated v1.Secret llm/e2e-same-id-b-9e257301-kserve-self-signed-certs 6m26s Normal LLMInferenceServiceReady llminferenceservice/e2e-same-id-b-9e257301 LLMInferenceService [e2e-same-id-b-9e257301] is Ready 6m20s Warning ModelNameCollision llminferenceservice/e2e-same-id-a-9e257301 model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-9e257301 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-9e257301; safe to ignore if traffic splitting is planned 6m19s Warning ModelNameCollision llminferenceservice/e2e-same-id-b-9e257301 model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-9e257301 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-9e257301; safe to ignore if traffic splitting is planned 6m10s Normal Killing pod/e2e-same-id-a-9e257301-kserve-7757f88cc-cc2wt Stopping container main 6m8s Normal Killing pod/e2e-same-id-b-9e257301-kserve-5c7c8c6f89-7kdcq Stopping container main 5m54s Warning Unhealthy pod/e2e-same-id-a-9e257301-kserve-7757f88cc-cc2wt Readiness probe failed: Get "https://10.134.1.89:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)