=== events in llm (2026-10-29T23:21:28Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 54m Normal Scheduled pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-2cbqb Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-2cbqb to ip-10-0-139-29.ec2.internal 55m Normal Scheduled pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8xtnm2 Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8xtnm2 to ip-10-0-133-251.ec2.internal 3m46s Warning ModelNameConflict maasmodelref/e2e-same-id-a-e33378d4 Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-e33378d4 4m Normal Scheduled pod/e2e-same-id-b-e33378d4-kserve-c658b6fb9-l8d6q Successfully assigned llm/e2e-same-id-b-e33378d4-kserve-c658b6fb9-l8d6q to ip-10-0-139-29.ec2.internal 55m Normal Scheduled pod/e2e-embedding-simulated-kserve-67bf594cd6-zzjpn Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-zzjpn to ip-10-0-139-29.ec2.internal 55m Normal Scheduled pod/e2e-distinct-simulated-kserve-7b998b79d9-zz4np Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-zz4np to ip-10-0-139-29.ec2.internal 54m Normal Scheduled pod/facebook-opt-125m-simulated-kserve-84b4ff656c-r2w9j Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-r2w9j to ip-10-0-133-251.ec2.internal 54m Normal Scheduled pod/e2e-distinct-2-simulated-kserve-cbd4f5586-bx292 Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bx292 to ip-10-0-139-29.ec2.internal 3m46s Warning ModelNameConflict maasmodelref/e2e-same-id-b-e33378d4 Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-e33378d4 3m34s Normal ModelNameConflictResolved maasmodelref/e2e-same-id-b-e33378d4 Model identity is no longer shared with any other MaaSModelRef in this namespace 55m Normal Scheduled pod/e2e-trlp-test-simulated-kserve-69b588897d-dwclk Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-dwclk to ip-10-0-133-251.ec2.internal 4m23s Normal Scheduled pod/e2e-same-id-a-e33378d4-kserve-859d798777-czq98 Successfully assigned llm/e2e-same-id-a-e33378d4-kserve-859d798777-czq98 to ip-10-0-139-29.ec2.internal 55m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs 55m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc 55m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route 55m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc 55m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Deployment llm/e2e-distinct-simulated-kserve 55m Normal ScalingReplicaSet deployment/e2e-distinct-simulated-kserve Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1 55m Normal SuccessfulCreate replicaset/e2e-distinct-simulated-kserve-7b998b79d9 Created pod: e2e-distinct-simulated-kserve-7b998b79d9-zz4np 55m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default 55m Normal AddedInterface pod/e2e-distinct-simulated-kserve-7b998b79d9-zz4np Add eth0 [10.133.0.38/23] from ovn-kubernetes 55m Normal Pulling pod/e2e-distinct-simulated-kserve-7b998b79d9-zz4np Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 55m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping 55m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine 55m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default 55m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route 55m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc 55m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc 55m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Deployment llm/e2e-embedding-simulated-kserve 55m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs 55m Normal ScalingReplicaSet deployment/e2e-embedding-simulated-kserve Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1 55m Normal SuccessfulCreate replicaset/e2e-embedding-simulated-kserve-67bf594cd6 Created pod: e2e-embedding-simulated-kserve-67bf594cd6-zzjpn 55m Normal Started pod/e2e-distinct-simulated-kserve-7b998b79d9-zz4np Container started 55m Normal Created pod/e2e-distinct-simulated-kserve-7b998b79d9-zz4np Container created 55m Normal Pulled pod/e2e-distinct-simulated-kserve-7b998b79d9-zz4np Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.142s (1.142s including waiting). Image size: 98346788 bytes. 55m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine 55m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping 55m Normal Pulling pod/e2e-embedding-simulated-kserve-67bf594cd6-zzjpn Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 55m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs 55m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Deployment llm/e2e-trlp-test-simulated-kserve 55m Normal Pulled pod/e2e-embedding-simulated-kserve-67bf594cd6-zzjpn Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 191ms (191ms including waiting). Image size: 98346788 bytes. 55m Normal Created pod/e2e-embedding-simulated-kserve-67bf594cd6-zzjpn Container created 55m Normal Started pod/e2e-embedding-simulated-kserve-67bf594cd6-zzjpn Container started 55m Normal AddedInterface pod/e2e-embedding-simulated-kserve-67bf594cd6-zzjpn Add eth0 [10.133.0.39/23] from ovn-kubernetes 55m Normal SuccessfulCreate replicaset/e2e-trlp-test-simulated-kserve-69b588897d Created pod: e2e-trlp-test-simulated-kserve-69b588897d-dwclk 55m Normal ScalingReplicaSet deployment/e2e-trlp-test-simulated-kserve Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1 55m Normal Pulling pod/e2e-trlp-test-simulated-kserve-69b588897d-dwclk Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 55m Normal AddedInterface pod/e2e-trlp-test-simulated-kserve-69b588897d-dwclk Add eth0 [10.134.0.35/23] from ovn-kubernetes 55m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc 55m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route 55m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc 55m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default 55m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine 55m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping 55m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default 55m Normal Created pod/e2e-trlp-test-simulated-kserve-69b588897d-dwclk Container created 55m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine 55m Normal Pulling pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8xtnm2 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 55m Normal AddedInterface pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8xtnm2 Add eth0 [10.134.0.36/23] from ovn-kubernetes 55m Normal SuccessfulCreate replicaset/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8xtnm2 55m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc 55m Normal ScalingReplicaSet deployment/e2e-unconfigured-facebook-opt-125m-simulated-kserve Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1 55m Normal Started pod/e2e-trlp-test-simulated-kserve-69b588897d-dwclk Container started 55m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping 55m Normal Pulled pod/e2e-trlp-test-simulated-kserve-69b588897d-dwclk Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.111s (1.111s including waiting). Image size: 98346788 bytes. 55m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs 55m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve 55m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc 55m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route 55m Normal Started pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8xtnm2 Container started 55m Normal Created pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8xtnm2 Container created 55m Normal Pulled pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8xtnm2 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 216ms (216ms including waiting). Image size: 98346788 bytes. 54m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc 54m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route 54m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc 54m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine 54m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default 54m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Deployment llm/facebook-opt-125m-simulated-kserve 54m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs 54m Normal ScalingReplicaSet deployment/facebook-opt-125m-simulated-kserve Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1 54m Normal SuccessfulCreate replicaset/facebook-opt-125m-simulated-kserve-84b4ff656c Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-r2w9j 54m Normal Started pod/facebook-opt-125m-simulated-kserve-84b4ff656c-r2w9j Container started 54m Normal Created pod/facebook-opt-125m-simulated-kserve-84b4ff656c-r2w9j Container created 54m Normal Pulled pod/facebook-opt-125m-simulated-kserve-84b4ff656c-r2w9j Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 205ms (205ms including waiting). Image size: 98346788 bytes. 54m Normal Pulling pod/facebook-opt-125m-simulated-kserve-84b4ff656c-r2w9j Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 54m Normal AddedInterface pod/facebook-opt-125m-simulated-kserve-84b4ff656c-r2w9j Add eth0 [10.134.0.37/23] from ovn-kubernetes 54m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping 54m Normal ScalingReplicaSet deployment/premium-simulated-simulated-premium-kserve Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1 54m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs 54m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Deployment llm/premium-simulated-simulated-premium-kserve 54m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc 54m Normal SuccessfulCreate replicaset/premium-simulated-simulated-premium-kserve-5f5c4b459f Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-2cbqb 54m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine 54m Normal AddedInterface pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-2cbqb Add eth0 [10.133.0.40/23] from ovn-kubernetes 54m Normal Pulling pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-2cbqb Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 54m Normal Pulled pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-2cbqb Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 207ms (207ms including waiting). Image size: 98346788 bytes. 54m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping 54m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc 54m Normal Started pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-2cbqb Container started 54m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default 54m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route 54m Normal Created pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-2cbqb Container created 54m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine 54m Normal Pulling pod/e2e-distinct-2-simulated-kserve-cbd4f5586-bx292 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 54m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc 54m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default 54m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc 54m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Deployment llm/e2e-distinct-2-simulated-kserve 54m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs 54m Normal ScalingReplicaSet deployment/e2e-distinct-2-simulated-kserve Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1 54m Normal SuccessfulCreate replicaset/e2e-distinct-2-simulated-kserve-cbd4f5586 Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-bx292 54m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping 54m Normal AddedInterface pod/e2e-distinct-2-simulated-kserve-cbd4f5586-bx292 Add eth0 [10.133.0.41/23] from ovn-kubernetes 54m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route 54m Normal Created pod/e2e-distinct-2-simulated-kserve-cbd4f5586-bx292 Container created 54m Normal Pulled pod/e2e-distinct-2-simulated-kserve-cbd4f5586-bx292 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 183ms (183ms including waiting). Image size: 98346788 bytes. 54m Normal Started pod/e2e-distinct-2-simulated-kserve-cbd4f5586-bx292 Container started 54m Normal Updated llminferenceservice/e2e-distinct-simulated Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs 54m Normal LLMInferenceServiceReady llminferenceservice/e2e-distinct-simulated LLMInferenceService [e2e-distinct-simulated] is Ready 54m Normal Updated llminferenceservice/e2e-embedding-simulated Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs 54m Normal LLMInferenceServiceReady llminferenceservice/e2e-embedding-simulated LLMInferenceService [e2e-embedding-simulated] is Ready 54m Normal Updated llminferenceservice/e2e-trlp-test-simulated Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs 54m Normal LLMInferenceServiceReady llminferenceservice/e2e-trlp-test-simulated LLMInferenceService [e2e-trlp-test-simulated] is Ready 54m Normal Updated llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs 54m Normal LLMInferenceServiceReady llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready 54m Normal Updated llminferenceservice/facebook-opt-125m-simulated Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs 54m Normal LLMInferenceServiceReady llminferenceservice/facebook-opt-125m-simulated LLMInferenceService [facebook-opt-125m-simulated] is Ready 54m Normal Updated llminferenceservice/premium-simulated-simulated-premium Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs 54m Normal Updated llminferenceservice/e2e-distinct-2-simulated Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs 54m Normal LLMInferenceServiceReady llminferenceservice/e2e-distinct-2-simulated LLMInferenceService [e2e-distinct-2-simulated] is Ready 48m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-2cbqb Liveness probe failed: Get "https://10.133.0.40:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 47m Warning Unhealthy pod/e2e-embedding-simulated-kserve-67bf594cd6-zzjpn Readiness probe failed: Get "https://10.133.0.39:8000/ready": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 47m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-2cbqb Readiness probe failed: Get "https://10.133.0.40:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 46m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-2cbqb Liveness probe failed: Get "https://10.133.0.40:8000/health": context deadline exceeded 46m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-dwclk Liveness probe failed: Get "https://10.134.0.35:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 46m Warning Unhealthy pod/e2e-distinct-2-simulated-kserve-cbd4f5586-bx292 Readiness probe failed: Get "https://10.133.0.41:8000/ready": context deadline exceeded 42m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-2cbqb Readiness probe failed: Get "https://10.133.0.40:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 41m Warning Unhealthy pod/facebook-opt-125m-simulated-kserve-84b4ff656c-r2w9j Readiness probe failed: Get "https://10.134.0.37:8000/ready": context deadline exceeded 37m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-2cbqb Readiness probe failed: Get "https://10.133.0.40:8000/ready": context deadline exceeded 37m Warning Unhealthy pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8xtnm2 Liveness probe failed: Get "https://10.134.0.36:8000/health": context deadline exceeded 36m Warning Unhealthy pod/facebook-opt-125m-simulated-kserve-84b4ff656c-r2w9j Readiness probe failed: Get "https://10.134.0.37:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 36m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-dwclk Readiness probe failed: Get "https://10.134.0.35:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 35m Warning LLMInferenceServiceNotReady llminferenceservice/premium-simulated-simulated-premium LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady 35m Normal LLMInferenceServiceReady llminferenceservice/premium-simulated-simulated-premium LLMInferenceService [premium-simulated-simulated-premium] is Ready 4m23s Normal Created llminferenceservice/e2e-same-id-a-e33378d4 Created v1.PodMonitor llm/e2e-same-id-a-e33378d4-kserve-llmisvc-engine 4m23s Normal Pulled pod/e2e-same-id-a-e33378d4-kserve-859d798777-czq98 Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod 4m23s Normal AddedInterface pod/e2e-same-id-a-e33378d4-kserve-859d798777-czq98 Add eth0 [10.133.1.159/23] from ovn-kubernetes 4m23s Normal Created pod/e2e-same-id-a-e33378d4-kserve-859d798777-czq98 Container created 4m23s Normal Started pod/e2e-same-id-a-e33378d4-kserve-859d798777-czq98 Container started 4m23s Normal SuccessfulCreate replicaset/e2e-same-id-a-e33378d4-kserve-859d798777 Created pod: e2e-same-id-a-e33378d4-kserve-859d798777-czq98 4m23s Normal ScalingReplicaSet deployment/e2e-same-id-a-e33378d4-kserve Scaled up replica set e2e-same-id-a-e33378d4-kserve-859d798777 from 0 to 1 4m23s Normal Created llminferenceservice/e2e-same-id-a-e33378d4 Created v1.Secret llm/e2e-same-id-a-e33378d4-kserve-self-signed-certs 4m23s Normal Created llminferenceservice/e2e-same-id-a-e33378d4 Created v1.NetworkPolicy llm/e2e-same-id-a-e33378d4-prometheus-scraping 4m23s Normal Created llminferenceservice/e2e-same-id-a-e33378d4 Created v1.Deployment llm/e2e-same-id-a-e33378d4-kserve 4m23s Normal Created llminferenceservice/e2e-same-id-a-e33378d4 Created v1.PodMonitor llm/e2e-same-id-a-e33378d4-kserve-llmisvc-engine-default 4m23s Normal Created llminferenceservice/e2e-same-id-a-e33378d4 Created v1.Service llm/e2e-same-id-a-e33378d4-kserve-workload-svc 4m23s Normal Created llminferenceservice/e2e-same-id-a-e33378d4 Created v1.HTTPRoute llm/e2e-same-id-a-e33378d4-kserve-route 4m23s Normal Created llminferenceservice/e2e-same-id-a-e33378d4 Created v1.DestinationRule llm/e2e-same-id-a-e33378d4-kserve-workload-svc 4m13s Normal Updated llminferenceservice/e2e-same-id-a-e33378d4 Updated v1.Secret llm/e2e-same-id-a-e33378d4-kserve-self-signed-certs 4m11s Normal LLMInferenceServiceReady llminferenceservice/e2e-same-id-a-e33378d4 LLMInferenceService [e2e-same-id-a-e33378d4] is Ready 4m1s Normal SuccessfulCreate replicaset/e2e-same-id-b-e33378d4-kserve-c658b6fb9 Created pod: e2e-same-id-b-e33378d4-kserve-c658b6fb9-l8d6q 4m1s Normal Created llminferenceservice/e2e-same-id-b-e33378d4 Created v1.DestinationRule llm/e2e-same-id-b-e33378d4-kserve-workload-svc 4m1s Normal Created llminferenceservice/e2e-same-id-b-e33378d4 Created v1.HTTPRoute llm/e2e-same-id-b-e33378d4-kserve-route 4m1s Normal ScalingReplicaSet deployment/e2e-same-id-b-e33378d4-kserve Scaled up replica set e2e-same-id-b-e33378d4-kserve-c658b6fb9 from 0 to 1 4m1s Normal Created llminferenceservice/e2e-same-id-b-e33378d4 Created v1.Secret llm/e2e-same-id-b-e33378d4-kserve-self-signed-certs 4m1s Normal Created llminferenceservice/e2e-same-id-b-e33378d4 Created v1.Deployment llm/e2e-same-id-b-e33378d4-kserve 4m1s Normal Created llminferenceservice/e2e-same-id-b-e33378d4 Created v1.Service llm/e2e-same-id-b-e33378d4-kserve-workload-svc 4m Normal Created pod/e2e-same-id-b-e33378d4-kserve-c658b6fb9-l8d6q Container created 4m Normal Created llminferenceservice/e2e-same-id-b-e33378d4 Created v1.PodMonitor llm/e2e-same-id-b-e33378d4-kserve-llmisvc-engine 4m Normal Created llminferenceservice/e2e-same-id-b-e33378d4 Created v1.NetworkPolicy llm/e2e-same-id-b-e33378d4-prometheus-scraping 4m Normal AddedInterface pod/e2e-same-id-b-e33378d4-kserve-c658b6fb9-l8d6q Add eth0 [10.133.1.160/23] from ovn-kubernetes 4m Normal Pulled pod/e2e-same-id-b-e33378d4-kserve-c658b6fb9-l8d6q Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod 4m Normal Started pod/e2e-same-id-b-e33378d4-kserve-c658b6fb9-l8d6q Container started 4m Normal Created llminferenceservice/e2e-same-id-b-e33378d4 Created v1.PodMonitor llm/e2e-same-id-b-e33378d4-kserve-llmisvc-engine-default 3m58s Normal Updated llminferenceservice/e2e-same-id-b-e33378d4 Updated v1.Secret llm/e2e-same-id-b-e33378d4-kserve-self-signed-certs 3m49s Normal LLMInferenceServiceReady llminferenceservice/e2e-same-id-b-e33378d4 LLMInferenceService [e2e-same-id-b-e33378d4] is Ready 3m44s Warning ModelNameCollision llminferenceservice/e2e-same-id-a-e33378d4 model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-e33378d4 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-e33378d4; safe to ignore if traffic splitting is planned 3m43s Warning ModelNameCollision llminferenceservice/e2e-same-id-b-e33378d4 model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-e33378d4 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-e33378d4; safe to ignore if traffic splitting is planned 3m34s Normal Killing pod/e2e-same-id-a-e33378d4-kserve-859d798777-czq98 Stopping container main 3m32s Normal Killing pod/e2e-same-id-b-e33378d4-kserve-c658b6fb9-l8d6q Stopping container main 3m15s Warning Unhealthy pod/e2e-same-id-b-e33378d4-kserve-c658b6fb9-l8d6q Readiness probe failed: Get "https://10.133.1.160:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)