2026-11-01T15:45:45.949119Z info FLAG: --concurrency="0" 2026-11-01T15:45:45.949139Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-01T15:45:45.949143Z info FLAG: --help="false" 2026-11-01T15:45:45.949145Z info FLAG: --log_as_json="false" 2026-11-01T15:45:45.949147Z info FLAG: --log_caller="" 2026-11-01T15:45:45.949150Z info FLAG: --log_output_level="default:info" 2026-11-01T15:45:45.949152Z info FLAG: --log_stacktrace_level="default:none" 2026-11-01T15:45:45.949156Z info FLAG: --log_target="[stdout]" 2026-11-01T15:45:45.949158Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-01T15:45:45.949160Z info FLAG: --outlierLogPath="" 2026-11-01T15:45:45.949163Z info FLAG: --profiling="true" 2026-11-01T15:45:45.949165Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-01T15:45:45.949167Z info FLAG: --proxyLogLevel="warning" 2026-11-01T15:45:45.949169Z info FLAG: --serviceCluster="istio-proxy" 2026-11-01T15:45:45.949171Z info FLAG: --stsPort="0" 2026-11-01T15:45:45.949173Z info FLAG: --templateFile="" 2026-11-01T15:45:45.949175Z info FLAG: --tokenManagerPlugin="" 2026-11-01T15:45:45.949178Z info FLAG: --vklog="0" 2026-11-01T15:45:45.949180Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-01T15:45:45.949352Z info Proxy role ips=[10.134.1.108] type=router id=maas-default-gateway-openshift-default-7f5667f86c-p8scg.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-01T15:45:45.949401Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-01T15:45:45.950414Z info cpu limit detected as 2, setting concurrency 2026-11-01T15:45:45.950603Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-01T15:45:45.950613Z info JWT policy is third-party-jwt 2026-11-01T15:45:45.950616Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-01T15:45:45.952685Z info Starting default Istio SDS Server 2026-11-01T15:45:45.952720Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-01T15:45:45.952746Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-01T15:45:45.952806Z info Opening status port 15020 2026-11-01T15:45:45.953820Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-01T15:45:45.955813Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-01T15:45:45.956937Z info Starting proxy agent 2026-11-01T15:45:45.956970Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-01T15:45:45.974739Z info sds Starting SDS grpc server 2026-11-01T15:45:45.974780Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-01T15:45:46.024475Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-01T15:45:46.044189Z info cache generated new workload certificate resourceName=default latency=89.292862ms ttl=23h59m59.95581515s 2026-11-01T15:45:46.044270Z info cache Root cert has changed, start rotating root cert 2026-11-01T15:45:46.044303Z info cache returned workload trust anchor from cache ttl=23h59m59.955698333s 2026-11-01T15:45:46.173342Z info ads ADS: new connection for node:1 2026-11-01T15:45:46.173468Z info cache returned workload certificate from cache ttl=23h59m59.826533601s 2026-11-01T15:45:46.173612Z info ads ADS: new connection for node:2 2026-11-01T15:45:46.173691Z info cache returned workload trust anchor from cache ttl=23h59m59.826310375s 2026-11-01T15:45:46.256137Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:45:54.250652Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:45:55.179354Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-01T15:45:55.455055Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-11-01T15:45:56.509679Z info Readiness succeeded in 10.563818608s 2026-11-01T15:45:56.510112Z info Envoy proxy is ready 2026-11-01T15:46:25.482679Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T15:46:28.866Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 108118 108394 374 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "d531af24-ee73-479d-9f0c-0acd885732cd" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.134.0.38:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.134.1.108:55028 10.134.1.108:443 10.132.0.15:39376 - v1-chat-completions-path 2026-11-01T15:46:43.127887Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-01T15:46:43.127913Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-01T15:46:43.127917Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-01T15:46:43.127920Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 [2026-11-01T15:46:42.983Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 144 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "0d848b5e-273e-4511-9887-b433a2cc9aa4" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.108:443 10.132.0.15:46238 - v1-catch-all-path 2026-11-01T15:46:44.327650Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:46:48.921704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:46:57.638599Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:47:10.325129Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:47:18.858718Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:47:35.732782Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:47:47.365251Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:47:50.725018Z info ads ADS: new connection for node:3 2026-11-01T15:47:50.725182Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T15:47:50.725230Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T15:47:53.812245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:48:33.032955Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:48:58.807663Z info ads ADS: "" 3 terminated 2026-11-01T15:48:59.099851Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:49:03.687860Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:49:17.481982Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:51:50.770090Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:52:20.375569Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:52:39.766713Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:52:54.915707Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:53:01.128087Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:53:12.438995Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:53:16.986628Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:53:35.993013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:57:04.097169Z info ads ADS: new connection for node:4 2026-11-01T15:57:04.100714Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-01T15:57:04.100751Z info cache read certificate from file resource=file-root:system 2026-11-01T15:57:07.523397Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:57:08.797777Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:58:01.523078Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T15:58:01.523113Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T15:58:01.523122Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T15:58:01.523127Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T15:58:01.523298Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T15:58:01.318Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1723 204 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "2e298118-367a-4edb-a5dc-b30a5a537d94" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.108:42390 10.134.1.108:443 10.132.0.15:59034 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T15:58:21.043949Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T15:58:21.043983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T15:58:21.043994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T15:58:21.043999Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T15:58:21.044196Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-11-01T15:58:17.828Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1716 3216 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "8fb02cdc-2198-4cee-8236-ba9f9fe52353" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.1.108:53178 10.134.1.108:443 10.132.0.15:58952 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T15:58:50.109926Z info ads ADS: "" 4 terminated with stream closed 2026-11-01T15:58:50.165622Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:58:52.521091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:59:02.277522Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:59:20.284414Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T15:59:26.295615Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T15:59:29.836Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 75 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "d9f0bea1-fbdb-4d71-aa8c-f971fba2e554" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.108:38424 10.134.1.108:443 10.132.0.15:47368 - v1-completions-path [2026-11-01T15:59:31.665Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 53 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "b323bda4-8668-4f88-b975-415e204bb7aa" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.108:38424 10.134.1.108:443 10.132.0.15:47384 - v1-completions-path 2026-11-01T15:59:49.392286Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:00:02.517327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:00:13.092074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-11-01T16:00:13.030Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 61 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "745420a1-f0da-4a37-8150-01c86a7449ba" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.108:53922 10.134.1.108:443 10.132.0.15:37010 - v1-completions-path 2026-11-01T16:00:14.326291Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-01T16:00:14.273Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 58 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "2538d8ef-10dd-4234-9c5d-3d676607b724" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.108:38424 10.134.1.108:443 10.132.0.15:37012 - v1-completions-path 2026-11-01T16:00:32.788830Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:00:43.422189Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:00:49.445260Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:01:00.536651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T16:01:00.536701Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T16:01:00.536726Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T16:01:00.536736Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-01T16:01:00.417Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 118 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "11c57699-d6ae-4999-93f6-ea3668a5778a" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.108:46590 10.134.1.108:443 10.132.0.15:50390 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T16:01:01.779Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 53 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "413ba004-e372-4499-a7c1-769faced56f3" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.108:53922 10.134.1.108:443 10.132.0.15:50396 - v1-completions-path 2026-11-01T16:01:18.143137Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:01:22.542810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:01:35.151270Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:01:43.483099Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:01:50.783944Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:01:59.460452Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:02:08.173769Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:02:27.515606Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:02:56.599957Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:03:17.962746Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:03:28.638414Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:03:31.699132Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T16:03:31.699174Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-01T16:03:31.699190Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-01T16:03:31.699195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-01T16:03:31.582Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 116 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "47762a59-bf3e-41a6-bb80-c693320fd62d" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.1.108:51144 10.134.1.108:443 10.132.0.15:60144 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T16:03:42.826Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 35 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "0fe4a7aa-7e4b-4470-8f4f-e2b97dfa8c7e" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.108:443 10.132.0.15:49344 - v1-completions-path 2026-11-01T16:07:50.358775Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:08:07.223244Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:08:11.395106Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:08:23.730411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:08:40.721970Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:08:47.127532Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:09:06.501124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:09:17.083532Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:09:23.130104Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T16:09:35.274Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 58 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "b9369b5c-5aec-4d8d-9227-c2fcf575a44e" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.108:38424 10.134.1.108:443 10.132.0.15:47936 - v1-completions-path 2026-11-01T16:09:50.251764Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:09:56.121861Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:10:01.750045Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T16:10:10.647Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 65 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "f6e5b954-b92a-429b-8f21-656b9396e641" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.108:38424 10.134.1.108:443 10.132.0.15:38892 - v1-completions-path [2026-11-01T16:10:11.617Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 66 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "c258fde7-1940-46a7-8582-f95595de65bc" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.108:53922 10.134.1.108:443 10.132.0.15:38906 - v1-completions-path [2026-11-01T16:10:13.436Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 61 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "c80ff518-e82f-46ed-be11-649b7c52a724" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.108:38424 10.134.1.108:443 10.132.0.15:38918 - v1-completions-path [2026-11-01T16:10:16.991Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "e34cec52-5ae1-4f0a-92c6-90d628caeaad" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.108:38424 10.134.1.108:443 10.132.0.15:38922 - v1-completions-path 2026-11-01T16:10:32.420024Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:10:43.134363Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:10:49.248008Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:10:54.988772Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T16:11:01.947Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 66 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "378b7b18-b6b6-42cd-b432-a303a8387531" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.108:53922 10.134.1.108:443 10.132.0.15:35640 - v1-completions-path 2026-11-01T16:11:05.287365Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-01T16:11:13.391Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "fb6c7ae3-e8de-43cf-a01d-ac0aba2e4756" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "10.133.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.1.108:53922 10.134.1.108:443 10.132.0.15:52264 - v1-completions-path 2026-11-01T16:11:28.627697Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:11:39.339935Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:11:44.074323Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:12:01.895851Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:12:07.820282Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:12:17.759703Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:12:39.327136Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:12:59.301368Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:13:10.279286Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:13:20.998556Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:13:32.021252Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:13:42.752902Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:13:53.501330Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:14:04.363414Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:14:14.983065Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:14:25.670720Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-01T16:14:33.235923Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-01T16:14:33.235951Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-01T16:14:33.235954Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-01T16:14:33.235957Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 [2026-11-01T16:14:32.972Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 37 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "30b235fb-ef3c-4f45-bf8e-3595e9d40f7b" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.108:443 10.132.0.15:52026 - v1-completions-path [2026-11-01T16:14:33.210Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 25 - "44.212.242.249,10.132.0.15" "python-requests/2.34.2" "469b25d8-cce4-4d13-b571-4a7c1830b58a" "maas.apps.84379a77fbadf0220580.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.1.108:443 10.132.0.15:52034 - v1-completions-path 2026-11-01T16:14:59.295639Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2