2026-11-02T13:16:27.472914Z info FLAG: --concurrency="0" 2026-11-02T13:16:27.472934Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T13:16:27.472938Z info FLAG: --help="false" 2026-11-02T13:16:27.472940Z info FLAG: --log_as_json="false" 2026-11-02T13:16:27.472942Z info FLAG: --log_caller="" 2026-11-02T13:16:27.472944Z info FLAG: --log_output_level="default:info" 2026-11-02T13:16:27.472946Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T13:16:27.472951Z info FLAG: --log_target="[stdout]" 2026-11-02T13:16:27.472953Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T13:16:27.472956Z info FLAG: --outlierLogPath="" 2026-11-02T13:16:27.472958Z info FLAG: --profiling="true" 2026-11-02T13:16:27.472960Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T13:16:27.472962Z info FLAG: --proxyLogLevel="warning" 2026-11-02T13:16:27.472964Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T13:16:27.472966Z info FLAG: --stsPort="0" 2026-11-02T13:16:27.472968Z info FLAG: --templateFile="" 2026-11-02T13:16:27.472970Z info FLAG: --tokenManagerPlugin="" 2026-11-02T13:16:27.472988Z info FLAG: --vklog="0" 2026-11-02T13:16:27.472992Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T13:16:27.473136Z info Proxy role ips=[10.133.1.20] type=router id=maas-default-gateway-openshift-default-6dcf757899-gt29z.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T13:16:27.473180Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T13:16:27.474252Z info cpu limit detected as 2, setting concurrency 2026-11-02T13:16:27.474451Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T13:16:27.474461Z info JWT policy is third-party-jwt 2026-11-02T13:16:27.474464Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T13:16:27.476215Z info Starting default Istio SDS Server 2026-11-02T13:16:27.476239Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T13:16:27.476263Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T13:16:27.476556Z info Opening status port 15020 2026-11-02T13:16:27.477496Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T13:16:27.478010Z info sds Starting SDS grpc server 2026-11-02T13:16:27.478030Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T13:16:27.478818Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T13:16:27.479632Z info Starting proxy agent 2026-11-02T13:16:27.479661Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T13:16:27.543238Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T13:16:27.642335Z info cache generated new workload certificate resourceName=default latency=164.106348ms ttl=23h59m59.357670047s 2026-11-02T13:16:27.642379Z info cache Root cert has changed, start rotating root cert 2026-11-02T13:16:27.642421Z info cache returned workload trust anchor from cache ttl=23h59m59.357580242s 2026-11-02T13:16:27.695307Z info ads ADS: new connection for node:1 2026-11-02T13:16:27.695378Z info cache returned workload certificate from cache ttl=23h59m59.304625235s 2026-11-02T13:16:27.695719Z info ads ADS: new connection for node:2 2026-11-02T13:16:27.695807Z info cache returned workload trust anchor from cache ttl=23h59m59.304194364s 2026-11-02T13:16:27.777450Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:16:34.498438Z error failed scraping envoy metrics: error scraping http://localhost:15090/stats/prometheus: Get "http://localhost:15090/stats/prometheus": dial tcp [::1]:15090: connect: connection refused 2026-11-02T13:16:36.671869Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:16:37.598214Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-02T13:16:37.932616Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-02T13:16:38.933584Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-02T13:16:40.077049Z info Readiness succeeded in 12.606743092s 2026-11-02T13:16:40.077498Z info Envoy proxy is ready 2026-11-02T13:16:40.604000Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:16:50.911777Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:17:04.900815Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:17:14.152507Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:17:32.375570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:17:44.014392Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:17:46.625262Z info ads ADS: new connection for node:3 2026-11-02T13:17:46.625409Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T13:17:46.625432Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-02T13:17:51.053121Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:18:30.158930Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T13:18:37.199Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 336 113 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "6ce4d55f-51a5-4a7f-9955-b005fbbec806" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.133.1.24:8000" outbound|54321||e2e-prio-pool-b2fa3bcb-inference-pool-ip-41ac9ab6.llm.svc.cluster.local 10.133.1.20:47046 10.133.1.20:443 10.132.0.12:52748 - v1-model-routing 2026-11-02T13:18:55.443716Z info ads ADS: "" 3 terminated 2026-11-02T13:18:55.711415Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:19:00.525010Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:19:17.906055Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:22:15.683264Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:22:43.237529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:23:09.488012Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:23:25.330446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:23:43.984672Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:23:56.284027Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:24:01.305914Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T13:24:08.208Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 62 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "0fd0a974-f6e9-4b71-824d-b82a7cb7c6db" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.20:443 10.132.0.12:47878 - v1-completions-path 2026-11-02T13:24:22.180902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:29:29.281404Z info ads ADS: new connection for node:4 2026-11-02T13:29:29.285731Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-02T13:29:29.285826Z info cache read certificate from file resource=file-root:system 2026-11-02T13:29:33.168455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:29:34.383996Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:30:01.871778Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T13:30:01.872056Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T13:29:58.712Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1725 3159 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "6da6a8ee-beb8-46fb-bb69-cab21bdac530" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.20:41760 10.133.1.20:443 10.132.0.12:59110 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T13:30:04.266757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T13:30:04.267219Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T13:30:04.109Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1721 158 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "b7d249c8-a8ca-460b-9b67-88c7767ec635" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.20:41760 10.133.1.20:443 10.132.0.12:47468 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T13:30:13.628573Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T13:30:13.628805Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T13:30:13.519Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1720 109 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "cceb6e05-5728-4b3d-a0a3-7bdfe302e525" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.20:41760 10.133.1.20:443 10.132.0.12:52746 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T13:30:32.205522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T13:30:32.205870Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T13:30:32.099Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1715 106 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "16190fd7-3d86-43e0-867f-cf1776bd145e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.20:41760 10.133.1.20:443 10.132.0.12:48964 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T13:30:49.229768Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-02T13:30:49.230057Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-02T13:30:46.094Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1722 3135 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "02a12018-8a71-41e4-8fdd-3f621dcb9c9e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.20:41760 10.133.1.20:443 10.132.0.12:60338 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T13:31:05.499454Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T13:31:05.499729Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-02T13:31:05.380Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1718 119 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "df38e542-5605-4a9a-a9cb-5a5af09c8de8" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.1.20:56588 10.133.1.20:443 10.132.0.12:44896 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-02T13:31:20.824278Z info ads ADS: "" 4 terminated 2026-11-02T13:31:20.872576Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:31:25.294708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:31:34.413312Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:31:54.569471Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:31:58.604838Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T13:32:04.124Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 72 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "5b42cfa5-1097-40cb-9681-2c13394fedbb" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.20:49954 10.133.1.20:443 10.132.0.12:60702 - v1-completions-path 2026-11-02T13:32:18.538375Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:32:36.938770Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T13:32:46.117Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "932860f2-6d91-4896-93e3-20c51c615b7a" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.20:49954 10.133.1.20:443 10.132.0.12:50582 - v1-completions-path 2026-11-02T13:32:47.675113Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-02T13:32:47.619Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 62 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "3e2e8047-69e3-4243-8402-110267c26245" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.20:59174 10.133.1.20:443 10.132.0.12:50596 - v1-completions-path [2026-11-02T13:32:50.200Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "3ecda5e8-5781-4b98-a501-ad67290451d1" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.20:49954 10.133.1.20:443 10.132.0.12:40050 - v1-completions-path 2026-11-02T13:33:08.911575Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:33:21.488495Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:33:27.112695Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:33:36.747599Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-02T13:33:36.688Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 65 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "3a17399f-6888-4fb2-9fdd-6d59d8259633" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.20:49954 10.133.1.20:443 10.132.0.12:49804 - v1-completions-path [2026-11-02T13:33:37.486Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 57 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "858d6f6e-ce2b-4224-ac0c-044d15f0eea5" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.20:49954 10.133.1.20:443 10.132.0.12:49816 - v1-completions-path [2026-11-02T13:33:38.842Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 63 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "df45ca1c-b551-46c3-8535-ebfb676d67d0" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.20:59174 10.133.1.20:443 10.132.0.12:49834 - v1-completions-path [2026-11-02T13:33:40.391Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "e0ebedae-8377-482a-867f-2538c915f330" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.20:49954 10.133.1.20:443 10.132.0.12:36484 - v1-completions-path 2026-11-02T13:33:54.347699Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:33:59.018202Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:34:12.829071Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:34:22.881475Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:34:32.411587Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:34:41.548621Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:34:51.249904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:35:08.676620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:35:15.129474Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T13:35:32.778Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 36 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "d0b3d706-52b0-441a-b651-0486b928528a" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.20:443 10.132.0.12:51096 - v1-completions-path 2026-11-02T13:35:37.096642Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:35:42.687549Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:35:54.108900Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:36:06.145550Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-02T13:36:06.027Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 309 118 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "da94d4f2-c078-4306-89fd-691c44f8504b" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.1.20:50548 10.133.1.20:443 10.132.0.12:50976 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T13:36:06.926Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 62 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "87faa312-105e-485a-8470-a79a637fdd01" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.20:49954 10.133.1.20:443 10.132.0.12:50988 - v1-completions-path 2026-11-02T13:36:20.723192Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:36:31.730249Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:36:52.251555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:36:58.516939Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:39:57.147902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:40:03.472048Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:41:27.383023Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:41:45.200855Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:41:49.811399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:42:02.146343Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:42:18.200035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:42:26.336893Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:45:58.650065Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-02T13:49:40.484672Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:49:45.131757Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:51:32.749971Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:55:37.692522Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:55:42.876932Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T13:55:48.227Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 69 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "97008a84-83a6-4cb1-811f-48a9998e45e7" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.20:49954 10.133.1.20:443 10.132.0.12:46904 - v1-completions-path [2026-11-02T13:55:49.341Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 58 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "87f7a217-d94c-4750-b697-b67894aa5de0" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.1.20:443 10.132.0.12:46920 - v1-completions-path 2026-11-02T13:56:03.956538Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:56:14.808431Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:56:21.471733Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:56:50.292875Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:56:56.865396Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:57:03.017573Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T13:57:13.020Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 66 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "4664f270-6c14-43a2-81e4-483f058200a3" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.20:49954 10.133.1.20:443 10.132.0.12:48014 - v1-completions-path [2026-11-02T13:57:14.017Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 62 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "9a76be66-c20b-44d8-8552-6694c85ea0b1" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.20:59174 10.133.1.20:443 10.132.0.12:48016 - v1-completions-path [2026-11-02T13:57:16.197Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 66 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "0b26a5e0-fddf-4090-8002-e6f4ebb2b3cd" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.50:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.1.20:59174 10.133.1.20:443 10.132.0.12:48020 - v1-completions-path 2026-11-02T13:57:35.002828Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:57:45.482902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:57:52.444124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:57:58.755280Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:58:10.209741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:58:33.593405Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:58:44.272223Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:58:47.701533Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:59:07.303666Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:59:13.724397Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:59:37.159854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T13:59:58.947139Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:00:19.016164Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:00:31.564516Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:00:51.490441Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:01:02.269378Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:01:12.893359Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:01:23.822163Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T14:01:34.418939Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T14:01:41.933Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 88 - "44.212.242.249,10.132.0.12" "python-requests/2.33.0" "8e92c6de-10b1-4bf9-abf9-c5a3ee5265cd" "maas.apps.c3fc8fc6c3e71a50c7c4.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.1.20:60974 10.133.1.20:443 10.132.0.12:34816 - v1-completions-path