2026-10-29T23:22:10.743845Z info FLAG: --concurrency="0" 2026-10-29T23:22:10.743883Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-29T23:22:10.743889Z info FLAG: --help="false" 2026-10-29T23:22:10.743893Z info FLAG: --log_as_json="false" 2026-10-29T23:22:10.743896Z info FLAG: --log_caller="" 2026-10-29T23:22:10.743899Z info FLAG: --log_output_level="default:info" 2026-10-29T23:22:10.743903Z info FLAG: --log_stacktrace_level="default:none" 2026-10-29T23:22:10.743910Z info FLAG: --log_target="[stdout]" 2026-10-29T23:22:10.743913Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-29T23:22:10.743916Z info FLAG: --outlierLogPath="" 2026-10-29T23:22:10.743919Z info FLAG: --profiling="true" 2026-10-29T23:22:10.743923Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-29T23:22:10.743926Z info FLAG: --proxyLogLevel="warning" 2026-10-29T23:22:10.743930Z info FLAG: --serviceCluster="istio-proxy" 2026-10-29T23:22:10.743938Z info FLAG: --stsPort="0" 2026-10-29T23:22:10.743942Z info FLAG: --templateFile="" 2026-10-29T23:22:10.743944Z info FLAG: --tokenManagerPlugin="" 2026-10-29T23:22:10.743949Z info FLAG: --vklog="0" 2026-10-29T23:22:10.743953Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-29T23:22:10.744156Z info Proxy role ips=[10.133.0.24] type=router id=maas-default-gateway-openshift-default-746ff8f49f-bsqhf.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-29T23:22:10.744239Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-29T23:22:10.745967Z info cpu limit detected as 2, setting concurrency 2026-10-29T23:22:10.746271Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-29T23:22:10.746289Z info JWT policy is third-party-jwt 2026-10-29T23:22:10.746293Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-29T23:22:10.749097Z info Starting default Istio SDS Server 2026-10-29T23:22:10.749124Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-29T23:22:10.749150Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-29T23:22:10.749751Z info Opening status port 15020 2026-10-29T23:22:10.750179Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-29T23:22:10.751029Z info sds Starting SDS grpc server 2026-10-29T23:22:10.751116Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-29T23:22:10.751994Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-29T23:22:10.753112Z info Starting proxy agent 2026-10-29T23:22:10.753144Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-29T23:22:10.816771Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-29T23:22:10.885246Z info cache generated new workload certificate resourceName=default latency=133.993836ms ttl=23h59m59.114758961s 2026-10-29T23:22:10.885303Z info cache Root cert has changed, start rotating root cert 2026-10-29T23:22:10.885344Z info cache returned workload trust anchor from cache ttl=23h59m59.11465726s 2026-10-29T23:22:10.916681Z info ads ADS: new connection for node:1 2026-10-29T23:22:10.916760Z info cache returned workload certificate from cache ttl=23h59m59.083241827s 2026-10-29T23:22:10.917162Z info ads ADS: new connection for node:2 2026-10-29T23:22:10.917240Z info cache returned workload trust anchor from cache ttl=23h59m59.08276156s 2026-10-29T23:22:10.959517Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:22:16.722023Z info Readiness succeeded in 5.981753682s 2026-10-29T23:22:16.722468Z info Envoy proxy is ready 2026-10-29T23:22:24.424415Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:23:01.295628Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:23:03.353161Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:23:06.078390Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:23:08.806623Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:23:12.174809Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:23:14.840846Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:23:30.171570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:24:05.772505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:24:05.772541Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:24:05.772555Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T23:24:05.772560Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-29T23:24:05.667Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 105 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "72dfa3c4-93b4-42d6-a473-f0a3d42f438f" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.24:46540 10.133.0.24:443 10.132.0.9:48302 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-29T23:24:06.627Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 56 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "9039954f-779d-426d-90bd-8f3502283a1d" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.24:443 10.132.0.9:48318 - v1-model-routing 2026-10-29T23:24:07.165493Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:24:07.165535Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:24:07.165554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:24:07.165561Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-29T23:24:07.210735Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:24:07.210771Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:24:07.210788Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T23:24:07.210795Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:24:07.298173Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:24:07.298208Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:24:07.298223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T23:24:07.298228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-29T23:24:06.728Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 50 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "9ce5fd4b-c160-46ef-bfb5-09c98b11941a" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.24:443 10.132.0.9:48332 - v1-model-routing [2026-10-29T23:24:07.095Z] "DELETE /v1/api-keys/d528c938-4df9-4eb9-bf48-4755a691675c HTTP/1.1" 200 - via_upstream - "-" 0 365 70 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "96e166c5-c882-4667-bf73-e23ee8622e9e" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.24:46542 10.133.0.24:443 10.132.0.9:48334 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-29T23:24:07.203Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 7 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "e2868ba0-15dc-49c8-aa84-db2b11eb8e8a" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.24:46540 10.133.0.24:443 10.132.0.9:48348 - odh-ai-gateway-infra.maas-api-route.4 [2026-10-29T23:24:07.235Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 63 - "34.228.250.194,10.132.0.9" "curl/7.76.1" "2c58b7a7-9027-42cb-b6fe-206285d4318e" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.24:46540 10.133.0.24:443 10.132.0.9:48350 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:26:20.043900Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:26:20.043936Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:26:20.043950Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:26:20.043955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T23:26:20.748537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:26:20.748571Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:26:20.748585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T23:26:20.748590Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-29T23:26:19.955Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 88 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "a5ce2cd5-8159-49b8-bffb-7c9a01e642c9" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.24:52310 10.133.0.24:443 10.132.0.9:35218 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-29T23:26:20.674Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 73 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "153c03d4-224b-4ccd-ac6f-4fcc2dc759a5" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.24:52310 10.133.0.24:443 10.132.0.9:35228 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:26:21.565910Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:26:21.565945Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:26:21.565960Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-29T23:26:21.565964Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-29T23:26:21.485Z] "DELETE /v1/api-keys/06c864f1-921e-4070-ac2a-2637ddb29192 HTTP/1.1" 200 - via_upstream - "-" 0 321 80 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "09babe36-5a84-4154-b9b5-029423740278" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.24:52324 10.133.0.24:443 10.132.0.9:35246 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:26:22.431741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-29T23:26:22.436227Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:26:22.436263Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:26:22.436283Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T23:26:22.436289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-29T23:26:22.331Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 105 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "9fbc78e9-c778-4b55-a7a0-8b8ba0be873d" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.24:52310 10.133.0.24:443 10.132.0.9:35250 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-29T23:26:31.109Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 279 78 - "34.228.250.194,10.132.0.9" "-" "51150c2e-ec25-4d66-9b09-3e94550c5ff8" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.24:47168 10.133.0.24:443 10.132.0.9:55144 - v1-completions-path 2026-10-29T23:26:37.138376Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:26:40.329303Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:26:40.329353Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:26:40.329377Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-29T23:26:40.329384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-29T23:26:40.233Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 95 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "684f596e-c42e-486c-be71-c203feb2114f" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.24:52324 10.133.0.24:443 10.132.0.9:39940 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:26:53.635443Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:32:15.752011Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:32:40.384095Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:33:21.914431Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:33:26.136956Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:33:26.136992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:33:26.137007Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-29T23:33:26.137012Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-29T23:33:26.053Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 330 83 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "1d497c93-bf8b-4a89-a47b-ace9fce4417a" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.24:35734 10.133.0.24:443 10.132.0.9:39638 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:33:39.151864Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:33:43.292065Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:34:00.162446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:34:15.700552Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:34:21.539295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-29T23:34:21.488Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 68 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "1dca4c1b-13a5-4dd3-9bbc-f4edfd2dfdaa" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.133.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.24:33536 10.133.0.24:443 10.132.0.9:57502 - v1-completions-path 2026-10-29T23:34:39.212570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:34:49.586889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:34:53.453605Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-29T23:34:57.984Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 63 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "383ad485-172b-48f2-a7db-4954e18d9e1b" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.133.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.24:51478 10.133.0.24:443 10.132.0.9:41610 - v1-completions-path [2026-10-29T23:34:58.544Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 56 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "c96b3b1f-9d7c-4dc2-a44f-6c612cd7a857" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.133.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.24:51478 10.133.0.24:443 10.132.0.9:41622 - v1-completions-path [2026-10-29T23:34:58.708Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 53 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "4d935d57-78a9-4e31-b9fc-c0acfdbd7d04" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.133.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.24:33536 10.133.0.24:443 10.132.0.9:41626 - v1-completions-path [2026-10-29T23:34:59.176Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 54 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "97d03005-7ae0-4e6d-bdb5-b34d15ce77b7" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.133.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.24:33536 10.133.0.24:443 10.132.0.9:41628 - v1-completions-path 2026-10-29T23:35:11.080633Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:35:13.304156Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:35:20.660728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:35:20.660772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-29T23:35:20.660794Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-29T23:35:20.660800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-29T23:35:20.585Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 75 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "b204568d-e7ed-4933-a529-b0b4fb41dcbf" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.24:57580 10.133.0.24:443 10.132.0.9:40322 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:35:32.662738Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:35:37.173146Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:35:52.856447Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:35:54.849294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:36:12.918685Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:36:23.764195Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:36:26.677561Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-29T23:36:33.182Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 64 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "ea9ee937-abe1-4293-a825-2ae6fc45577c" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.51:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.24:47168 10.133.0.24:443 10.132.0.9:51424 - v1-completions-path [2026-10-29T23:37:01.376Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 36 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "3cf82b0a-b343-4d2b-b219-8275e2e9566d" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.24:443 10.132.0.9:49132 - v1-completions-path 2026-10-29T23:39:44.116043Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:39:44.116082Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:39:44.116096Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:39:44.116102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-29T23:39:44.038Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 77 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "977390e4-928b-440e-abae-11ea7bc95673" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.24:59272 10.133.0.24:443 10.132.0.9:40564 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:40:04.406399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:40:19.696106Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:40:21.734980Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:40:36.498691Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:41:58.023799Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:42:19.949734Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:42:35.572094Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:42:49.741150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:42:53.267251Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:43:05.332413Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:43:09.163184Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-29T23:43:13.745Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 61 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "3af0e5a8-7d72-44f9-a180-d1299f36f4c4" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.24:443 10.132.0.9:45836 - v1-completions-path 2026-10-29T23:43:25.669139Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:43:35.593581Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:43:43.698904Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:43:59.066279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:44:01.100269Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:44:03.899647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:44:03.899682Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:44:03.899698Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-29T23:44:03.899704Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-29T23:44:03.817Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 82 - "34.228.250.194,10.132.0.9" "python-requests/2.34.2" "22439f02-3261-4ebd-b2cd-bc62766c4f31" "maas.apps.de146273d7d6b269924d.prod.konflux-ocp-ci.dev" "10.133.0.154:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.24:45806 10.133.0.24:443 10.132.0.9:60556 - odh-ai-gateway-infra.maas-api-route.3 2026-10-29T23:44:15.841376Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-29T23:44:26.776643Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8