2026-11-03T15:16:14.945878Z info FLAG: --concurrency="0" 2026-11-03T15:16:14.945896Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T15:16:14.945900Z info FLAG: --help="false" 2026-11-03T15:16:14.945903Z info FLAG: --log_as_json="false" 2026-11-03T15:16:14.945905Z info FLAG: --log_caller="" 2026-11-03T15:16:14.945907Z info FLAG: --log_output_level="default:info" 2026-11-03T15:16:14.945909Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T15:16:14.945913Z info FLAG: --log_target="[stdout]" 2026-11-03T15:16:14.945915Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T15:16:14.945917Z info FLAG: --outlierLogPath="" 2026-11-03T15:16:14.945921Z info FLAG: --profiling="true" 2026-11-03T15:16:14.945923Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T15:16:14.945925Z info FLAG: --proxyLogLevel="warning" 2026-11-03T15:16:14.945927Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T15:16:14.945929Z info FLAG: --stsPort="0" 2026-11-03T15:16:14.945935Z info FLAG: --templateFile="" 2026-11-03T15:16:14.945937Z info FLAG: --tokenManagerPlugin="" 2026-11-03T15:16:14.945943Z info FLAG: --vklog="0" 2026-11-03T15:16:14.945946Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T15:16:14.946084Z info Proxy role ips=[10.134.0.31] type=router id=maas-default-gateway-openshift-default-596dc9545f-2sbg2.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T15:16:14.946134Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T15:16:14.947157Z info cpu limit detected as 2, setting concurrency 2026-11-03T15:16:14.947400Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T15:16:14.947412Z info JWT policy is third-party-jwt 2026-11-03T15:16:14.947415Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T15:16:14.949189Z info Starting default Istio SDS Server 2026-11-03T15:16:14.949210Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T15:16:14.949233Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T15:16:14.949220Z info Opening status port 15020 2026-11-03T15:16:14.949933Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T15:16:14.951747Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T15:16:14.953160Z info Starting proxy agent 2026-11-03T15:16:14.953727Z info sds Starting SDS grpc server 2026-11-03T15:16:14.953742Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T15:16:14.953908Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T15:16:15.020443Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T15:16:15.174892Z info ads ADS: new connection for node:1 2026-11-03T15:16:15.175093Z info ads ADS: new connection for node:2 2026-11-03T15:16:15.257447Z info cache generated new workload certificate resourceName=default latency=307.105878ms ttl=23h59m59.742556468s 2026-11-03T15:16:15.257483Z info cache Root cert has changed, start rotating root cert 2026-11-03T15:16:15.257525Z info cache returned workload certificate from cache ttl=23h59m59.742490983s 2026-11-03T15:16:15.257533Z info cache returned workload trust anchor from cache ttl=23h59m59.742467662s 2026-11-03T15:16:15.257631Z info cache returned workload trust anchor from cache ttl=23h59m59.742370286s 2026-11-03T15:16:15.258268Z info cache returned workload trust anchor from cache ttl=23h59m59.741733592s 2026-11-03T15:16:15.300894Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:16:21.948587Z info Readiness succeeded in 7.005472772s 2026-11-03T15:16:21.948904Z info Envoy proxy is ready 2026-11-03T15:17:19.848476Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:17:24.379104Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:17:28.880524Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:17:33.223746Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:17:43.213359Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:17:50.908762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:17:59.359619Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:18:30.511338Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:18:33.864157Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:19:07.446Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 414 89 - "52.71.36.72,10.132.0.19" "curl/7.76.1" "fb485620-7bcc-4c73-a79e-f8d51168c6d7" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.31:51082 10.134.0.31:443 10.132.0.19:37990 - v1-model-routing 2026-11-03T15:19:10.302577Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T15:19:10.302605Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T15:19:10.302608Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T15:19:10.302612Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T15:19:09.733Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 57 - "52.71.36.72,10.132.0.19" "curl/7.76.1" "f8d2edc8-9aae-4697-905d-6a3af98f6451" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.31:443 10.132.0.19:38006 - v1-model-routing [2026-11-03T15:19:10.284Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 88 17 - "52.71.36.72,10.132.0.19" "curl/7.76.1" "a85a4f9c-f920-417e-83c4-98a11ae1fc67" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.31:443 10.132.0.19:38434 - v1-model-routing 2026-11-03T15:24:05.155361Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:24:05.155396Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:24:05.155410Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:24:05.155415Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T15:24:05.010Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 144 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "341a1f4e-5e47-46d2-a992-6f770fdbcccd" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.31:48802 10.134.0.31:443 10.132.0.19:36170 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T15:24:06.365312Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:24:06.365346Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:24:06.365359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T15:24:06.365364Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T15:24:06.250Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 114 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "74735fac-f337-46ea-a39e-4e6846a1c219" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.31:48802 10.134.0.31:443 10.132.0.19:36174 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T15:24:06.706772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:24:06.706815Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:24:06.706836Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T15:24:06.706842Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:24:07.317581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-03T15:24:07.321138Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:24:07.321169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:24:07.321183Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T15:24:07.321188Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T15:24:06.561Z] "DELETE /v1/api-keys/88d38b2e-880a-41ec-9fd5-7111a82f2c4e HTTP/1.1" 200 - via_upstream - "-" 0 321 145 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "3743dc14-222a-44ca-b258-a2ca725b76b0" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.31:48802 10.134.0.31:443 10.132.0.19:36186 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T15:24:06.909Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 86 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "f6027964-1619-471e-859c-29ff56188f3d" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.31:443 10.132.0.19:36202 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T15:24:07.190Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 130 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "b1861cce-f04b-4e4c-a642-96a16670459c" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.31:48802 10.134.0.31:443 10.132.0.19:36204 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T15:24:07.664502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:24:07.664537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:24:07.664551Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:24:07.664556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T15:24:07.532Z] "DELETE /v1/api-keys/83af5da6-7c55-4f9e-88d7-e96a7e4179bb HTTP/1.1" 200 - via_upstream - "-" 0 321 131 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "c54623dd-c9f7-4e73-949b-e05e7125eec6" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.31:48818 10.134.0.31:443 10.132.0.19:36208 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T15:24:10.698394Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:24:10.698434Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:24:10.698454Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:24:10.698461Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T15:24:10.583Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 114 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "ad8efe8b-a14a-4831-b565-4b576f67aa27" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.31:48818 10.134.0.31:443 10.132.0.19:48874 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T15:24:20.131Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 69 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "0502a340-9733-42fc-b217-321f65a5de94" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.31:37380 10.134.0.31:443 10.132.0.19:48900 - v1-completions-path [2026-11-03T15:24:20.402Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 295 70 - "52.71.36.72,10.132.0.19" "-" "28fa7878-cedc-4720-8b29-059e552aeda5" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.31:51082 10.134.0.31:443 10.132.0.19:53180 - v1-completions-path [2026-11-03T15:24:21.056Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 71 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "fbbb3fa7-eef7-4b8e-bfea-a2fc52d66495" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "10.132.0.36:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.31:51082 10.134.0.31:443 10.132.0.19:53186 - v1-completions-path [2026-11-03T15:24:22.565Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 6 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "99bc3c18-620e-43ce-bf35-19066b29e83b" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.31:443 10.132.0.19:53202 - - 2026-11-03T15:24:34.678415Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:24:56.389621Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:29:58.019Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 88 30 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "9e48bf94-e15d-416d-8bf2-daf26835ed4f" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.31:443 10.132.0.19:33668 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T15:30:40.827Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 32 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "e1a0ff22-aee2-4969-8677-be3894bdf53a" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.31:443 10.132.0.19:58426 - - 2026-11-03T15:31:13.491245Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:31:56.971418Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:33:04.868448Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:33:46.277146Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:37:14.291347Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:41:19.230327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:41:49.838323Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:43:08.172030Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:47:07.859475Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T15:47:33.124016Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:48:23.832636Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:49:15.829855Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:49:41.836569Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:50:38.605010Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:50:44.252123Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:50:44.252160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T15:50:44.252175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T15:50:44.252179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T15:50:44.134Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 117 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "1f347e76-fa0c-4c10-b070-78d9d0cef2dd" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.31:60692 10.134.0.31:443 10.132.0.19:40792 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T15:51:00.366575Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:51:05.162529Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:51:29.170761Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-03T15:51:35.554329Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:51:48.984337Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:51:57.909489Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T15:51:57.838Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 72 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "31bb2e35-fd03-4620-bbc1-8abbfc867746" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "10.134.0.56:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.31:48642 10.134.0.31:443 10.132.0.19:58642 - v1-completions-path 2026-11-03T15:52:19.720367Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:52:30.468383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:52:37.165102Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:52:53.779Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "8c05536e-b69d-4936-84d6-6a3def1d2632" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "10.134.0.56:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.31:48576 10.134.0.31:443 10.132.0.19:36664 - v1-completions-path 2026-11-03T15:53:08.506538Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:53:13.258315Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:53:36.666298Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:53:43.310314Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:54:09.365405Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:54:31.319387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:54:44.435870Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:54:50.532256Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:55:18.406097Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:55:24.064482Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T15:55:33.656Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 33 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "69cafd02-5084-441a-ba26-448089720751" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.31:443 10.132.0.19:56422 - v1-completions-path 2026-11-03T15:55:42.486513Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:56:04.349610Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:56:15.085761Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:56:18.569006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:56:18.569048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:56:18.569068Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T15:56:18.569075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T15:56:18.455Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 113 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "2777008e-d476-4064-aec1-40baf9a5e3a7" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "10.132.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.31:35484 10.134.0.31:443 10.132.0.19:43456 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T15:56:34.165796Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:56:40.047040Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:59:07.262264Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T15:59:13.230225Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T16:00:53.264814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T16:01:10.422014Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T16:01:15.053949Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T16:01:39.642651Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T16:03:55.811335Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T16:04:19.787897Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T16:04:47.643544Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T16:05:03.106548Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T16:05:11.617900Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T16:05:18.365227Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T16:05:26.340303Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T16:05:31.887362Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T16:05:43.510Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 60 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "9758dbeb-c8d3-42cc-884f-a286fe52e843" "maas.apps.7b3e00bb5f4e17a82fbd.prod.konflux-ocp-ci.dev" "10.134.0.56:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.31:48642 10.134.0.31:443 10.132.0.19:41524 - v1-completions-path 2026-11-03T16:05:57.877614Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T16:09:31.191153Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T16:09:42.631103Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T16:10:03.721846Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T16:10:08.711103Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T16:10:25.027179Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T16:10:36.892363Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8