2026-11-03T20:06:32.559880Z info FLAG: --concurrency="0" 2026-11-03T20:06:32.559900Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T20:06:32.559905Z info FLAG: --help="false" 2026-11-03T20:06:32.559907Z info FLAG: --log_as_json="false" 2026-11-03T20:06:32.559910Z info FLAG: --log_caller="" 2026-11-03T20:06:32.559912Z info FLAG: --log_output_level="default:info" 2026-11-03T20:06:32.559914Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T20:06:32.559918Z info FLAG: --log_target="[stdout]" 2026-11-03T20:06:32.559921Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T20:06:32.559923Z info FLAG: --outlierLogPath="" 2026-11-03T20:06:32.559926Z info FLAG: --profiling="true" 2026-11-03T20:06:32.559928Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T20:06:32.559930Z info FLAG: --proxyLogLevel="warning" 2026-11-03T20:06:32.559932Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T20:06:32.559934Z info FLAG: --stsPort="0" 2026-11-03T20:06:32.559936Z info FLAG: --templateFile="" 2026-11-03T20:06:32.559938Z info FLAG: --tokenManagerPlugin="" 2026-11-03T20:06:32.559941Z info FLAG: --vklog="0" 2026-11-03T20:06:32.559943Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T20:06:32.560143Z info Proxy role ips=[10.133.0.23] type=router id=maas-default-gateway-openshift-default-77f556d647-p7lrd.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T20:06:32.560617Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T20:06:32.561803Z info cpu limit detected as 2, setting concurrency 2026-11-03T20:06:32.562062Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T20:06:32.562073Z info JWT policy is third-party-jwt 2026-11-03T20:06:32.562075Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T20:06:32.564451Z info Starting default Istio SDS Server 2026-11-03T20:06:32.564481Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T20:06:32.564507Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T20:06:32.564875Z info Opening status port 15020 2026-11-03T20:06:32.565894Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T20:06:32.566540Z info sds Starting SDS grpc server 2026-11-03T20:06:32.566570Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T20:06:32.567315Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T20:06:32.568175Z info Starting proxy agent 2026-11-03T20:06:32.568215Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T20:06:32.632299Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T20:06:32.665895Z info cache generated new workload certificate resourceName=default latency=99.190293ms ttl=23h59m59.334109335s 2026-11-03T20:06:32.665929Z info cache Root cert has changed, start rotating root cert 2026-11-03T20:06:32.665970Z info cache returned workload trust anchor from cache ttl=23h59m59.334030745s 2026-11-03T20:06:32.725235Z info ads ADS: new connection for node:1 2026-11-03T20:06:32.725309Z info cache returned workload certificate from cache ttl=23h59m59.274693527s 2026-11-03T20:06:32.726054Z info ads ADS: new connection for node:2 2026-11-03T20:06:32.726292Z info cache returned workload trust anchor from cache ttl=23h59m59.273710304s 2026-11-03T20:06:32.769653Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:06:38.814417Z info Readiness succeeded in 6.257712198s 2026-11-03T20:06:38.814720Z info Envoy proxy is ready 2026-11-03T20:07:49.570809Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:07:50.873213Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:07:52.207533Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:07:53.721431Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:07:55.475579Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:07:57.390702Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:07:59.252096Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:08:03.214552Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:08:40.109564Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:08:47.626117Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:08:48.211556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:09:43.284504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:09:43.284539Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:09:43.284552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:09:43.284557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T20:09:43.209Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 75 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "da8cabd0-ee7f-4334-8ee6-401a577bd92d" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.23:60550 10.133.0.23:443 10.132.0.14:44558 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:09:43.453469Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:09:43.453503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:09:43.453517Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:09:43.453522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T20:09:43.381Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 72 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "640a64e9-13e2-4f5c-b3ec-3757281f85f6" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.23:60550 10.133.0.23:443 10.132.0.14:44562 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T20:09:44.714Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 59 - "52.71.36.72,10.132.0.14" "curl/7.76.1" "62267ce1-0d4c-4f83-87cf-7084420a51be" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.23:443 10.132.0.14:40768 - v1-model-routing 2026-11-03T20:12:13.096808Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:12:13.096847Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:12:13.096865Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:12:13.096873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T20:12:13.013Z] "DELETE /v1/api-keys/c124ac2b-fbf9-447b-a769-34e6ed7ddc15 HTTP/1.1" 200 - via_upstream - "-" 0 321 83 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "d2334ad4-4456-4120-9d45-e3bda5bbb23f" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.23:51622 10.133.0.23:443 10.132.0.14:43260 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T20:12:16.237Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 17 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "39dac671-d190-4b5e-bfe1-08f4ac06ece3" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "-" - - 10.133.0.23:443 10.132.0.14:51358 - - 2026-11-03T20:12:29.107542Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:12:44.437625Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:15:20.890Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 88 27 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "0730a3f3-371f-4f51-a951-1154cc7e88ce" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.23:443 10.132.0.14:32884 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:16:30.506761Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:17:00.828724Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:18:38.641711Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:19:02.492022Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:19:42.459714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:20:59.450787Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:24:32.427108Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:27:07.746704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:33:59.618039Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T20:36:43.157914Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:37:05.451212Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:37:17.382716Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:37:17.382754Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:37:17.382766Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T20:37:17.382772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T20:37:17.293Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 89 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "465fa70e-ae1f-4274-9162-09ddd0828ca8" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.23:50422 10.133.0.23:443 10.132.0.14:56040 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:37:50.557323Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T20:37:50.557351Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T20:37:50.557354Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T20:37:50.557358Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T20:37:50.514Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 43 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "26cf9e93-90e8-4c09-a6bc-9ac99cd6318c" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.23:443 10.132.0.14:53368 - v1-completions-path 2026-11-03T20:37:53.417615Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:38:11.703579Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:38:13.670356Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:38:23.262040Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 [2026-11-03T20:38:29.844Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 81 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "24cf7231-e776-4265-9f2f-393bec91c562" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.23:48174 10.133.0.23:443 10.132.0.14:49974 - v1-completions-path 2026-11-03T20:38:30.508598Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:38:32.442648Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:38:34.976476Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:38:43.372941Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:39:01.142324Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T20:39:01.067Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 75 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "0e06dc7b-0de4-42b3-a39b-0dc73380ba3e" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.23:36246 10.133.0.23:443 10.132.0.14:41168 - v1-completions-path [2026-11-03T20:39:01.213Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "29a34ff8-4c67-48c9-a7da-1434985bc004" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.23:36246 10.133.0.23:443 10.132.0.14:41178 - v1-completions-path [2026-11-03T20:39:01.928Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 62 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "b0d901ae-74be-477f-8ec0-a28c692ff2ff" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.23:51946 10.133.0.23:443 10.132.0.14:41188 - v1-completions-path 2026-11-03T20:39:17.904154Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:39:28.189041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:39:29.821832Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:39:49.011496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:40:02.018091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:40:16.735811Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:40:18.818256Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:40:34.406Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 279 68 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "0fe8fdd7-8594-4712-9f6f-39e642646b5b" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.23:55340 10.133.0.23:443 10.132.0.14:51384 - v1-completions-path 2026-11-03T20:40:35.667805Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:40:37.352547Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:40:53.298773Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=4 2026-11-03T20:40:54.153444Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:41:04.833877Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:41:07.732503Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:41:24.156372Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:41:25.802094Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:41:30.495092Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T20:41:30.487Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 37 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "153ae0f8-eabf-42a1-86b8-d8ab34afdce6" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.23:443 10.132.0.14:43114 - v1-completions-path 2026-11-03T20:41:34.757352Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:41:41.121Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 309 64 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "38ec29c4-1b4d-45d1-ae7e-926b77e1a363" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.23:36246 10.133.0.23:443 10.132.0.14:33836 - v1-completions-path 2026-11-03T20:41:53.090987Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:42:03.236153Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:47:22.166831Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:47:24.441824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:49:02.843724Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:49:06.047304Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:50:31.941966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:50:55.820664Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:50:57.529677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:51:14.851577Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:53:00.461643Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:53:17.562170Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:53:33.487080Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:53:45.039975Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:53:47.456041Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:53:56.614718Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:53:58.411251Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:54:18.181079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:57:17.680264Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:57:23.118892Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:57:25.907809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:57:25.907863Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:57:25.907882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T20:57:25.907889Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T20:57:25.813Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 94 - "52.71.36.72,10.132.0.14" "python-requests/2.34.2" "114bb5a8-d386-464e-8d18-d8f1d20407e4" "maas.apps.bf3fd94558116684ec73.prod.konflux-ocp-ci.dev" "10.133.1.10:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.23:55956 10.133.0.23:443 10.132.0.14:52960 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:57:38.322950Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:57:39.894682Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:57:54.011107Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:58:05.060078Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8