=== events in llm (2026-10-31T00:20:47Z) === LAST SEEN TYPE REASON OBJECT MESSAGE 44m Normal Scheduled pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88l2tx Successfully assigned llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88l2tx to ip-10-0-137-81.us-east-2.compute.internal 6m10s Normal ModelNameConflictResolved maasmodelref/e2e-same-id-b-a30f2db8 Model identity is no longer shared with any other MaaSModelRef in this namespace 44m Normal Scheduled pod/e2e-trlp-test-simulated-kserve-69b588897d-6pxqs Successfully assigned llm/e2e-trlp-test-simulated-kserve-69b588897d-6pxqs to ip-10-0-137-81.us-east-2.compute.internal 44m Normal Scheduled pod/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2 Successfully assigned llm/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2 to ip-10-0-142-208.us-east-2.compute.internal 44m Normal Scheduled pod/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js Successfully assigned llm/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js to ip-10-0-142-208.us-east-2.compute.internal 44m Normal Scheduled pod/echo-simulator-kserve-64b6f8f96c-259tq Successfully assigned llm/echo-simulator-kserve-64b6f8f96c-259tq to ip-10-0-142-208.us-east-2.compute.internal 44m Normal Scheduled pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-t67k2 Successfully assigned llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t67k2 to ip-10-0-137-81.us-east-2.compute.internal 6m38s Normal Scheduled pod/e2e-same-id-b-a30f2db8-kserve-b78bbd4cc-bggsq Successfully assigned llm/e2e-same-id-b-a30f2db8-kserve-b78bbd4cc-bggsq to ip-10-0-137-81.us-east-2.compute.internal 6m22s Warning ModelNameConflict maasmodelref/e2e-same-id-a-a30f2db8 Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-b-a30f2db8 44m Normal Scheduled pod/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7 Successfully assigned llm/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7 to ip-10-0-142-208.us-east-2.compute.internal 6m54s Normal Scheduled pod/e2e-same-id-a-a30f2db8-kserve-9d79fb4bf-84pkr Successfully assigned llm/e2e-same-id-a-a30f2db8-kserve-9d79fb4bf-84pkr to ip-10-0-134-83.us-east-2.compute.internal 6m22s Warning ModelNameConflict maasmodelref/e2e-same-id-b-a30f2db8 Model identity "publishers/llm/models/test/e2e-same-model-id" is shared with 1 other MaaSModelRef in this namespace: e2e-same-id-a-a30f2db8 44m Normal Scheduled pod/e2e-distinct-simulated-kserve-7b998b79d9-c6888 Successfully assigned llm/e2e-distinct-simulated-kserve-7b998b79d9-c6888 to ip-10-0-137-81.us-east-2.compute.internal 44m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs 44m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Deployment llm/e2e-trlp-test-simulated-kserve 44m Normal ScalingReplicaSet deployment/e2e-trlp-test-simulated-kserve Scaled up replica set e2e-trlp-test-simulated-kserve-69b588897d from 0 to 1 44m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.HTTPRoute llm/e2e-trlp-test-simulated-kserve-route 44m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.NetworkPolicy llm/e2e-trlp-test-simulated-prometheus-scraping 44m Normal AddedInterface pod/e2e-trlp-test-simulated-kserve-69b588897d-6pxqs Add eth0 [10.134.0.31/23] from ovn-kubernetes 44m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine-default 44m Normal Pulling pod/e2e-trlp-test-simulated-kserve-69b588897d-6pxqs Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 44m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.Service llm/e2e-trlp-test-simulated-kserve-workload-svc 44m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.DestinationRule llm/e2e-trlp-test-simulated-kserve-workload-svc 44m Normal SuccessfulCreate replicaset/e2e-trlp-test-simulated-kserve-69b588897d Created pod: e2e-trlp-test-simulated-kserve-69b588897d-6pxqs 44m Normal Created llminferenceservice/e2e-trlp-test-simulated Created v1.PodMonitor llm/e2e-trlp-test-simulated-kserve-llmisvc-engine 44m Normal SuccessfulCreate replicaset/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc Created pod: e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88l2tx 44m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Service llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc 44m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Deployment llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve 44m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.HTTPRoute llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-route 44m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs 44m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.DestinationRule llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc 44m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.PodMonitor llm/eab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine-default 44m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.PodMonitor llm/e2e-unconab60ef4d3a239b5143b412cab04acac3-kserve-llmisvc-engine 44m Normal Created llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Created v1.NetworkPolicy llm/e2e-unconfiab60ef4d3a239b5143b412cab04acac3-prometheus-scraping 44m Normal ScalingReplicaSet deployment/e2e-unconfigured-facebook-opt-125m-simulated-kserve Scaled up replica set e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b8f4fc from 0 to 1 44m Normal Pulling pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88l2tx Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 44m Normal AddedInterface pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88l2tx Add eth0 [10.134.0.32/23] from ovn-kubernetes 44m Normal Created pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88l2tx Container created 44m Normal Created pod/e2e-trlp-test-simulated-kserve-69b588897d-6pxqs Container created 44m Normal Pulled pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88l2tx Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.153s (1.153s including waiting). Image size: 98346788 bytes. 44m Normal Started pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88l2tx Container started 44m Normal Started pod/e2e-trlp-test-simulated-kserve-69b588897d-6pxqs Container started 44m Normal Pulled pod/e2e-trlp-test-simulated-kserve-69b588897d-6pxqs Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.839s (1.839s including waiting). Image size: 98346788 bytes. 44m Normal SuccessfulCreate replicaset/echo-simulator-kserve-64b6f8f96c Created pod: echo-simulator-kserve-64b6f8f96c-259tq 44m Normal ScalingReplicaSet deployment/echo-simulator-kserve Scaled up replica set echo-simulator-kserve-64b6f8f96c from 0 to 1 44m Normal Created llminferenceservice/echo-simulator Created v1.Secret llm/echo-simulator-kserve-self-signed-certs 44m Normal Created llminferenceservice/echo-simulator Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine 44m Normal Created llminferenceservice/echo-simulator Created v1.PodMonitor llm/echo-simulator-kserve-llmisvc-engine-default 44m Normal Created llminferenceservice/echo-simulator Created v1.DestinationRule llm/echo-simulator-kserve-workload-svc 44m Normal Created llminferenceservice/echo-simulator Created v1.HTTPRoute llm/echo-simulator-kserve-route 44m Normal Created llminferenceservice/echo-simulator Created v1.Service llm/echo-simulator-kserve-workload-svc 44m Normal Created llminferenceservice/echo-simulator Created v1.Deployment llm/echo-simulator-kserve 44m Normal AddedInterface pod/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7 Add eth0 [10.132.0.45/23] from ovn-kubernetes 44m Normal SuccessfulCreate replicaset/facebook-opt-125m-simulated-kserve-84b4ff656c Created pod: facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7 44m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs 44m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Service llm/facebook-opt-125m-simulated-kserve-workload-svc 44m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.Deployment llm/facebook-opt-125m-simulated-kserve 44m Normal Pulling pod/echo-simulator-kserve-64b6f8f96c-259tq Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" 44m Normal AddedInterface pod/echo-simulator-kserve-64b6f8f96c-259tq Add eth0 [10.132.0.44/23] from ovn-kubernetes 44m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.HTTPRoute llm/facebook-opt-125m-simulated-kserve-route 44m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.DestinationRule llm/facebook-opt-125m-simulated-kserve-workload-svc 44m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine-default 44m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.PodMonitor llm/facebook-opt-125m-simulated-kserve-llmisvc-engine 44m Normal Created llminferenceservice/facebook-opt-125m-simulated Created v1.NetworkPolicy llm/facebook-opt-125m-simulated-prometheus-scraping 44m Normal Created llminferenceservice/echo-simulator Created v1.NetworkPolicy llm/echo-simulator-prometheus-scraping 44m Normal ScalingReplicaSet deployment/facebook-opt-125m-simulated-kserve Scaled up replica set facebook-opt-125m-simulated-kserve-84b4ff656c from 0 to 1 44m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.PodMonitor llm/premium-simulated-simulated-premium-kserve-llmisvc-engine 44m Normal Pulling pod/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 44m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.PodMonitor llm/p75d89895ad19b4ac62612d08bfe7f574-kserve-llmisvc-engine-default 44m Normal SuccessfulCreate replicaset/premium-simulated-simulated-premium-kserve-5f5c4b459f Created pod: premium-simulated-simulated-premium-kserve-5f5c4b459f-t67k2 44m Normal ScalingReplicaSet deployment/premium-simulated-simulated-premium-kserve Scaled up replica set premium-simulated-simulated-premium-kserve-5f5c4b459f from 0 to 1 44m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.NetworkPolicy llm/premium-simulated-simulated-premium-prometheus-scraping 44m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs 44m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.DestinationRule llm/premium-simulated-simulated-premium-kserve-workload-svc 44m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Deployment llm/premium-simulated-simulated-premium-kserve 44m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.Service llm/premium-simulated-simulated-premium-kserve-workload-svc 44m Normal Created llminferenceservice/premium-simulated-simulated-premium Created v1.HTTPRoute llm/premium-simulated-simulated-premium-kserve-route 44m Normal Pulled pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-t67k2 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 366ms (366ms including waiting). Image size: 98346788 bytes. 44m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine 44m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.PodMonitor llm/e2e-distinct-2-simulated-kserve-llmisvc-engine-default 44m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.DestinationRule llm/e2e-distinct-2-simulated-kserve-workload-svc 44m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.HTTPRoute llm/e2e-distinct-2-simulated-kserve-route 44m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Service llm/e2e-distinct-2-simulated-kserve-workload-svc 44m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Deployment llm/e2e-distinct-2-simulated-kserve 44m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs 44m Normal ScalingReplicaSet deployment/e2e-distinct-2-simulated-kserve Scaled up replica set e2e-distinct-2-simulated-kserve-cbd4f5586 from 0 to 1 44m Normal SuccessfulCreate replicaset/e2e-distinct-2-simulated-kserve-cbd4f5586 Created pod: e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js 44m Normal Created llminferenceservice/e2e-distinct-2-simulated Created v1.NetworkPolicy llm/e2e-distinct-2-simulated-prometheus-scraping 44m Normal Started pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-t67k2 Container started 44m Normal Created pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-t67k2 Container created 44m Normal Pulling pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-t67k2 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 44m Normal AddedInterface pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-t67k2 Add eth0 [10.134.0.33/23] from ovn-kubernetes 44m Normal Pulled pod/echo-simulator-kserve-64b6f8f96c-259tq Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.9.0" in 3.425s (3.425s including waiting). Image size: 78208878 bytes. 44m Normal Pulled pod/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 2.98s (2.98s including waiting). Image size: 98346788 bytes. 44m Normal Pulling pod/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 44m Normal AddedInterface pod/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js Add eth0 [10.132.0.46/23] from ovn-kubernetes 44m Normal Created pod/echo-simulator-kserve-64b6f8f96c-259tq Container created 44m Normal Started pod/echo-simulator-kserve-64b6f8f96c-259tq Container started 44m Normal Started pod/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7 Container started 44m Normal Created pod/facebook-opt-125m-simulated-kserve-84b4ff656c-9jgc7 Container created 44m Normal Pulled pod/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 1.253s (1.253s including waiting). Image size: 98346788 bytes. 44m Normal Created pod/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js Container created 44m Normal Started pod/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js Container started 44m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine 44m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.NetworkPolicy llm/e2e-distinct-simulated-prometheus-scraping 44m Normal ScalingReplicaSet deployment/e2e-distinct-simulated-kserve Scaled up replica set e2e-distinct-simulated-kserve-7b998b79d9 from 0 to 1 44m Normal AddedInterface pod/e2e-distinct-simulated-kserve-7b998b79d9-c6888 Add eth0 [10.134.0.34/23] from ovn-kubernetes 44m Normal Pulling pod/e2e-distinct-simulated-kserve-7b998b79d9-c6888 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 44m Normal SuccessfulCreate replicaset/e2e-distinct-simulated-kserve-7b998b79d9 Created pod: e2e-distinct-simulated-kserve-7b998b79d9-c6888 44m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Deployment llm/e2e-distinct-simulated-kserve 44m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Service llm/e2e-distinct-simulated-kserve-workload-svc 44m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.HTTPRoute llm/e2e-distinct-simulated-kserve-route 44m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.DestinationRule llm/e2e-distinct-simulated-kserve-workload-svc 44m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.PodMonitor llm/e2e-distinct-simulated-kserve-llmisvc-engine-default 44m Normal Created llminferenceservice/e2e-distinct-simulated Created v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs 44m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine 44m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.DestinationRule llm/e2e-embedding-simulated-kserve-workload-svc 44m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.PodMonitor llm/e2e-embedding-simulated-kserve-llmisvc-engine-default 44m Normal ScalingReplicaSet deployment/e2e-embedding-simulated-kserve Scaled up replica set e2e-embedding-simulated-kserve-67bf594cd6 from 0 to 1 44m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs 44m Normal Pulled pod/e2e-distinct-simulated-kserve-7b998b79d9-c6888 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 315ms (315ms including waiting). Image size: 98346788 bytes. 44m Normal Created pod/e2e-distinct-simulated-kserve-7b998b79d9-c6888 Container created 44m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Deployment llm/e2e-embedding-simulated-kserve 44m Normal Started pod/e2e-distinct-simulated-kserve-7b998b79d9-c6888 Container started 44m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.Service llm/e2e-embedding-simulated-kserve-workload-svc 44m Normal SuccessfulCreate replicaset/e2e-embedding-simulated-kserve-67bf594cd6 Created pod: e2e-embedding-simulated-kserve-67bf594cd6-fgrs2 44m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.HTTPRoute llm/e2e-embedding-simulated-kserve-route 44m Normal AddedInterface pod/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2 Add eth0 [10.132.0.47/23] from ovn-kubernetes 44m Normal Started pod/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2 Container started 44m Normal Pulled pod/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2 Successfully pulled image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" in 281ms (281ms including waiting). Image size: 98346788 bytes. 44m Normal Pulling pod/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2 Pulling image "ghcr.io/llm-d/llm-d-inference-sim:v0.8.2" 44m Normal Created pod/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2 Container created 44m Normal Created llminferenceservice/e2e-embedding-simulated Created v1.NetworkPolicy llm/e2e-embedding-simulated-prometheus-scraping 44m Normal Updated llminferenceservice/e2e-trlp-test-simulated Updated v1.Secret llm/e2e-trlp-test-simulated-kserve-self-signed-certs 44m Normal Updated llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Updated v1.Secret llm/e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs 44m Normal LLMInferenceServiceReady llminferenceservice/echo-simulator LLMInferenceService [echo-simulator] is Ready 44m Normal Updated llminferenceservice/echo-simulator Updated v1.Secret llm/echo-simulator-kserve-self-signed-certs 44m Normal Updated llminferenceservice/facebook-opt-125m-simulated Updated v1.Secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs 44m Normal LLMInferenceServiceReady llminferenceservice/facebook-opt-125m-simulated LLMInferenceService [facebook-opt-125m-simulated] is Ready 44m Normal Updated llminferenceservice/premium-simulated-simulated-premium Updated v1.Secret llm/premium-simulated-simulated-premium-kserve-self-signed-certs 44m Normal Updated llminferenceservice/e2e-distinct-2-simulated Updated v1.Secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs 44m Normal LLMInferenceServiceReady llminferenceservice/e2e-distinct-2-simulated LLMInferenceService [e2e-distinct-2-simulated] is Ready 44m Normal Updated llminferenceservice/e2e-distinct-simulated Updated v1.Secret llm/e2e-distinct-simulated-kserve-self-signed-certs 44m Normal Updated llminferenceservice/e2e-embedding-simulated Updated v1.Secret llm/e2e-embedding-simulated-kserve-self-signed-certs 44m Normal LLMInferenceServiceReady llminferenceservice/e2e-embedding-simulated LLMInferenceService [e2e-embedding-simulated] is Ready 38m Warning Unhealthy pod/e2e-distinct-2-simulated-kserve-cbd4f5586-rv7js Readiness probe failed: Get "https://10.132.0.46:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 38m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-6pxqs Liveness probe failed: Get "https://10.134.0.31:8000/health": net/http: request canceled (Client.Timeout exceeded while awaiting headers) 38m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-t67k2 Liveness probe failed: Get "https://10.134.0.33:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 38m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-t67k2 Readiness probe failed: Get "https://10.134.0.33:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 37m Warning Unhealthy pod/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2 Liveness probe failed: Get "https://10.132.0.47:8000/health": context deadline exceeded 36m Warning LLMInferenceServiceNotReady llminferenceservice/premium-simulated-simulated-premium LLMInferenceService [premium-simulated-simulated-premium] is no longer Ready because of: MainWorkloadReady, WorkloadsReady 31m Warning Unhealthy pod/e2e-embedding-simulated-kserve-67bf594cd6-fgrs2 Readiness probe failed: Get "https://10.132.0.47:8000/ready": context deadline exceeded 29m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-t67k2 Readiness probe failed: Get "https://10.134.0.33:8000/ready": context deadline exceeded 27m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-6pxqs Readiness probe failed: Get "https://10.134.0.31:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 27m Warning Unhealthy pod/e2e-distinct-simulated-kserve-7b998b79d9-c6888 Readiness probe failed: Get "https://10.134.0.34:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 27m Warning Unhealthy pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-t67k2 Readiness probe failed: Get "https://10.134.0.33:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 27m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-6pxqs Liveness probe failed: Get "https://10.134.0.31:8000/health": context deadline exceeded 27m Warning Unhealthy pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88l2tx Readiness probe failed: Get "https://10.134.0.32:8000/ready": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 26m Warning NodeNotReady pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-t67k2 Node is not ready 26m Warning NodeNotReady pod/e2e-distinct-simulated-kserve-7b998b79d9-c6888 Node is not ready 26m Warning NodeNotReady pod/e2e-trlp-test-simulated-kserve-69b588897d-6pxqs Node is not ready 26m Warning NodeNotReady pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88l2tx Node is not ready 25m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-6pxqs Liveness probe failed: Get "https://10.134.0.31:8000/health": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 25m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-6pxqs Readiness probe failed: Get "https://10.134.0.31:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 25m Warning Unhealthy pod/e2e-distinct-simulated-kserve-7b998b79d9-c6888 Liveness probe failed: Get "https://10.134.0.34:8000/health": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 25m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-6pxqs Liveness probe failed: Get "https://10.134.0.31:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 25m Warning Unhealthy pod/e2e-distinct-simulated-kserve-7b998b79d9-c6888 Readiness probe failed: Get "https://10.134.0.34:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 24m Warning Unhealthy pod/e2e-distinct-simulated-kserve-7b998b79d9-c6888 Readiness probe failed: Get "https://10.134.0.34:8000/ready": context deadline exceeded 24m Warning Unhealthy pod/e2e-trlp-test-simulated-kserve-69b588897d-6pxqs Readiness probe failed: Get "https://10.134.0.31:8000/ready": context deadline exceeded 23m Warning Unhealthy pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88l2tx Readiness probe failed: Get "https://10.134.0.32:8000/ready": context deadline exceeded 23m Warning Unhealthy pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88l2tx Liveness probe failed: Get "https://10.134.0.32:8000/health": context deadline exceeded 23m Warning Unhealthy pod/e2e-distinct-simulated-kserve-7b998b79d9-c6888 Liveness probe failed: Get "https://10.134.0.34:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 23m Warning Error llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "connection-llmisvc-v1alpha2.odh-model-controller.opendatahub.io": failed to call webhook: Post "https://odh-model-controller-webhook-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "odh-model-controller-webhook-service" 23m Warning Error llminferenceservice/premium-simulated-simulated-premium Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "connection-llmisvc-v1alpha2.odh-model-controller.opendatahub.io": failed to call webhook: Post "https://odh-model-controller-webhook-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "odh-model-controller-webhook-service" 23m Warning Error llminferenceservice/e2e-distinct-simulated Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "connection-llmisvc-v1alpha2.odh-model-controller.opendatahub.io": failed to call webhook: Post "https://odh-model-controller-webhook-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "odh-model-controller-webhook-service" 23m Warning Error llminferenceservice/e2e-trlp-test-simulated Reconciliation failed: failed to dry-run validate rendered config: Internal error occurred: failed calling webhook "connection-llmisvc-v1alpha2.odh-model-controller.opendatahub.io": failed to call webhook: Post "https://odh-model-controller-webhook-service.opendatahub.svc:443/mutate-serving-kserve-io-v1alpha2-llminferenceservice?timeout=10s": no endpoints available for service "odh-model-controller-webhook-service" 22m Warning Unhealthy pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88l2tx Liveness probe failed: Get "https://10.134.0.32:8000/health": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 22m Warning Unhealthy pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88l2tx Readiness probe failed: Get "https://10.134.0.32:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers) 22m Normal TaintManagerEviction pod/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88l2tx Cancelling deletion of Pod llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-7658b88l2tx 22m Normal TaintManagerEviction pod/e2e-trlp-test-simulated-kserve-69b588897d-6pxqs Cancelling deletion of Pod llm/e2e-trlp-test-simulated-kserve-69b588897d-6pxqs 22m Normal TaintManagerEviction pod/e2e-distinct-simulated-kserve-7b998b79d9-c6888 Cancelling deletion of Pod llm/e2e-distinct-simulated-kserve-7b998b79d9-c6888 22m Normal TaintManagerEviction pod/premium-simulated-simulated-premium-kserve-5f5c4b459f-t67k2 Cancelling deletion of Pod llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-t67k2 21m Normal LLMInferenceServiceReady llminferenceservice/e2e-unconfigured-facebook-opt-125m-simulated LLMInferenceService [e2e-unconfigured-facebook-opt-125m-simulated] is Ready 21m Normal LLMInferenceServiceReady llminferenceservice/e2e-distinct-simulated LLMInferenceService [e2e-distinct-simulated] is Ready 21m Normal LLMInferenceServiceReady llminferenceservice/premium-simulated-simulated-premium LLMInferenceService [premium-simulated-simulated-premium] is Ready 21m Normal LLMInferenceServiceReady llminferenceservice/e2e-trlp-test-simulated LLMInferenceService [e2e-trlp-test-simulated] is Ready 6m55s Normal Created llminferenceservice/e2e-same-id-a-a30f2db8 Created v1.PodMonitor llm/e2e-same-id-a-a30f2db8-kserve-llmisvc-engine 6m55s Normal Created llminferenceservice/e2e-same-id-a-a30f2db8 Created v1.PodMonitor llm/e2e-same-id-a-a30f2db8-kserve-llmisvc-engine-default 6m55s Normal Created llminferenceservice/e2e-same-id-a-a30f2db8 Created v1.Secret llm/e2e-same-id-a-a30f2db8-kserve-self-signed-certs 6m55s Normal Created llminferenceservice/e2e-same-id-a-a30f2db8 Created v1.Deployment llm/e2e-same-id-a-a30f2db8-kserve 6m55s Normal Created llminferenceservice/e2e-same-id-a-a30f2db8 Created v1.Service llm/e2e-same-id-a-a30f2db8-kserve-workload-svc 6m55s Normal SuccessfulCreate replicaset/e2e-same-id-a-a30f2db8-kserve-9d79fb4bf Created pod: e2e-same-id-a-a30f2db8-kserve-9d79fb4bf-84pkr 6m55s Normal ScalingReplicaSet deployment/e2e-same-id-a-a30f2db8-kserve Scaled up replica set e2e-same-id-a-a30f2db8-kserve-9d79fb4bf from 0 to 1 6m55s Normal Created llminferenceservice/e2e-same-id-a-a30f2db8 Created v1.NetworkPolicy llm/e2e-same-id-a-a30f2db8-prometheus-scraping 6m55s Normal Created llminferenceservice/e2e-same-id-a-a30f2db8 Created v1.HTTPRoute llm/e2e-same-id-a-a30f2db8-kserve-route 6m55s Normal Created llminferenceservice/e2e-same-id-a-a30f2db8 Created v1.DestinationRule llm/e2e-same-id-a-a30f2db8-kserve-workload-svc 6m54s Normal Started pod/e2e-same-id-a-a30f2db8-kserve-9d79fb4bf-84pkr Container started 6m54s Normal Created pod/e2e-same-id-a-a30f2db8-kserve-9d79fb4bf-84pkr Container created 6m54s Normal Pulled pod/e2e-same-id-a-a30f2db8-kserve-9d79fb4bf-84pkr Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod 6m54s Normal AddedInterface pod/e2e-same-id-a-a30f2db8-kserve-9d79fb4bf-84pkr Add eth0 [10.133.0.214/23] from ovn-kubernetes 6m52s Normal Updated llminferenceservice/e2e-same-id-a-a30f2db8 Updated v1.Secret llm/e2e-same-id-a-a30f2db8-kserve-self-signed-certs 6m44s Normal LLMInferenceServiceReady llminferenceservice/e2e-same-id-a-a30f2db8 LLMInferenceService [e2e-same-id-a-a30f2db8] is Ready 6m38s Normal Created pod/e2e-same-id-b-a30f2db8-kserve-b78bbd4cc-bggsq Container created 6m38s Normal Created llminferenceservice/e2e-same-id-b-a30f2db8 Created v1.PodMonitor llm/e2e-same-id-b-a30f2db8-kserve-llmisvc-engine-default 6m38s Normal AddedInterface pod/e2e-same-id-b-a30f2db8-kserve-b78bbd4cc-bggsq Add eth0 [10.134.0.236/23] from ovn-kubernetes 6m38s Normal Created llminferenceservice/e2e-same-id-b-a30f2db8 Created v1.HTTPRoute llm/e2e-same-id-b-a30f2db8-kserve-route 6m38s Normal Started pod/e2e-same-id-b-a30f2db8-kserve-b78bbd4cc-bggsq Container started 6m38s Normal Created llminferenceservice/e2e-same-id-b-a30f2db8 Created v1.DestinationRule llm/e2e-same-id-b-a30f2db8-kserve-workload-svc 6m38s Normal Pulled pod/e2e-same-id-b-a30f2db8-kserve-b78bbd4cc-bggsq Container image "ghcr.io/llm-d/llm-d-inference-sim@sha256:c3ba435081a4d032676b218ea34eb3a1c54507da0fade2f6297f9c37894fe0d1" already present on machine and can be accessed by the pod 6m38s Normal SuccessfulCreate replicaset/e2e-same-id-b-a30f2db8-kserve-b78bbd4cc Created pod: e2e-same-id-b-a30f2db8-kserve-b78bbd4cc-bggsq 6m38s Normal ScalingReplicaSet deployment/e2e-same-id-b-a30f2db8-kserve Scaled up replica set e2e-same-id-b-a30f2db8-kserve-b78bbd4cc from 0 to 1 6m38s Normal Created llminferenceservice/e2e-same-id-b-a30f2db8 Created v1.Secret llm/e2e-same-id-b-a30f2db8-kserve-self-signed-certs 6m38s Normal Created llminferenceservice/e2e-same-id-b-a30f2db8 Created v1.Deployment llm/e2e-same-id-b-a30f2db8-kserve 6m38s Normal Created llminferenceservice/e2e-same-id-b-a30f2db8 Created v1.Service llm/e2e-same-id-b-a30f2db8-kserve-workload-svc 6m38s Normal Created llminferenceservice/e2e-same-id-b-a30f2db8 Created v1.PodMonitor llm/e2e-same-id-b-a30f2db8-kserve-llmisvc-engine 6m38s Normal Created llminferenceservice/e2e-same-id-b-a30f2db8 Created v1.NetworkPolicy llm/e2e-same-id-b-a30f2db8-prometheus-scraping 6m32s Normal Updated llminferenceservice/e2e-same-id-b-a30f2db8 Updated v1.Secret llm/e2e-same-id-b-a30f2db8-kserve-self-signed-certs 6m27s Normal LLMInferenceServiceReady llminferenceservice/e2e-same-id-b-a30f2db8 LLMInferenceService [e2e-same-id-b-a30f2db8] is Ready 6m20s Warning ModelNameCollision llminferenceservice/e2e-same-id-b-a30f2db8 model name "test/e2e-same-model-id" overlaps with e2e-same-id-a-a30f2db8 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-b-a30f2db8; safe to ignore if traffic splitting is planned 6m20s Warning ModelNameCollision llminferenceservice/e2e-same-id-a-a30f2db8 model name "test/e2e-same-model-id" overlaps with e2e-same-id-b-a30f2db8 in namespace llm; shared publisher paths and model-routing headers cause the gateway to shadow one service. Reachable at its own address llm/e2e-same-id-a-a30f2db8; safe to ignore if traffic splitting is planned 6m10s Normal Killing pod/e2e-same-id-a-a30f2db8-kserve-9d79fb4bf-84pkr Stopping container main 6m9s Normal Killing pod/e2e-same-id-b-a30f2db8-kserve-b78bbd4cc-bggsq Stopping container main 5m54s Warning Unhealthy pod/e2e-same-id-a-a30f2db8-kserve-9d79fb4bf-84pkr Readiness probe failed: Get "https://10.133.0.214:8000/ready": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)