2026-10-30T17:24:30.290180Z info FLAG: --concurrency="0" 2026-10-30T17:24:30.290198Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T17:24:30.290202Z info FLAG: --help="false" 2026-10-30T17:24:30.290204Z info FLAG: --log_as_json="false" 2026-10-30T17:24:30.290206Z info FLAG: --log_caller="" 2026-10-30T17:24:30.290208Z info FLAG: --log_output_level="default:info" 2026-10-30T17:24:30.290210Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T17:24:30.290214Z info FLAG: --log_target="[stdout]" 2026-10-30T17:24:30.290217Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T17:24:30.290219Z info FLAG: --outlierLogPath="" 2026-10-30T17:24:30.290221Z info FLAG: --profiling="true" 2026-10-30T17:24:30.290222Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T17:24:30.290224Z info FLAG: --proxyLogLevel="warning" 2026-10-30T17:24:30.290227Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T17:24:30.290229Z info FLAG: --stsPort="0" 2026-10-30T17:24:30.290231Z info FLAG: --templateFile="" 2026-10-30T17:24:30.290233Z info FLAG: --tokenManagerPlugin="" 2026-10-30T17:24:30.290235Z info FLAG: --vklog="0" 2026-10-30T17:24:30.290237Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T17:24:30.290436Z info Proxy role ips=[10.133.0.29] type=router id=maas-default-gateway-openshift-default-7df854bf67-lmw9v.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T17:24:30.290480Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T17:24:30.291564Z info cpu limit detected as 2, setting concurrency 2026-10-30T17:24:30.291774Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T17:24:30.291784Z info JWT policy is third-party-jwt 2026-10-30T17:24:30.291787Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T17:24:30.293101Z info Starting default Istio SDS Server 2026-10-30T17:24:30.293122Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T17:24:30.293147Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T17:24:30.293517Z info Opening status port 15020 2026-10-30T17:24:30.294940Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T17:24:30.296248Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T17:24:30.297027Z info Starting proxy agent 2026-10-30T17:24:30.297057Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T17:24:30.306135Z info sds Starting SDS grpc server 2026-10-30T17:24:30.306154Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T17:24:30.360543Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T17:24:30.476447Z info ads ADS: new connection for node:1 2026-10-30T17:24:30.476962Z info ads ADS: new connection for node:2 2026-10-30T17:24:30.525214Z info cache generated new workload certificate resourceName=default latency=230.00347ms ttl=23h59m59.474789977s 2026-10-30T17:24:30.525252Z info cache Root cert has changed, start rotating root cert 2026-10-30T17:24:30.525294Z info cache returned workload trust anchor from cache ttl=23h59m59.474706676s 2026-10-30T17:24:30.525317Z info cache returned workload certificate from cache ttl=23h59m59.474683454s 2026-10-30T17:24:30.525402Z info cache returned workload trust anchor from cache ttl=23h59m59.474601433s 2026-10-30T17:24:30.525712Z info cache returned workload trust anchor from cache ttl=23h59m59.47428858s 2026-10-30T17:24:30.609420Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:24:39.240948Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:24:40.186237Z warn Envoy proxy is NOT ready: Get "http://127.0.0.1:15000/stats?usedonly&filter=^(cluster_manager\\.cds|listener_manager\\.lds)\\.(update_success|update_rejected)$": context deadline exceeded (Client.Timeout exceeded while awaiting headers) 2026-10-30T17:24:41.918524Z info Readiness succeeded in 11.631254569s 2026-10-30T17:24:41.918977Z info Envoy proxy is ready 2026-10-30T17:24:41.920140Z info Readiness succeeded in 11.632879046s [2026-10-30T17:26:07.318Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 99 - "52.71.36.72,10.132.0.21" "curl/7.76.1" "e36586f7-9143-43f2-b66f-173058b6e00f" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.29:443 10.132.0.21:56820 - v1-model-routing 2026-10-30T17:28:35.913267Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T17:28:35.913308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T17:28:35.913322Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T17:28:35.913327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T17:28:35.735Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 56 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "852073a2-d10c-4def-8177-1f72f5c7f430" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.29:443 10.132.0.21:48838 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T17:28:35.828Z] "DELETE /v1/api-keys/76e848a7-9c9b-4db3-9009-aa1efbd55ad8 HTTP/1.1" 200 - via_upstream - "-" 0 370 84 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "476a4660-1100-4f93-8de8-db1f955f813f" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.132.0.44:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:49934 10.133.0.29:443 10.132.0.21:48854 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T17:28:36.714323Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T17:28:36.714357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T17:28:36.714370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T17:28:36.714375Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T17:28:36.618Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 95 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "ad312b33-67e9-4c69-a40a-d94b803a5320" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.132.0.44:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:49934 10.133.0.29:443 10.132.0.21:48858 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T17:28:37.372557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T17:28:37.372594Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T17:28:37.372608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T17:28:37.372612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T17:28:37.296Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 76 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "3194bf2e-130d-47b3-bb31-fa5dd643046d" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.132.0.44:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:49946 10.133.0.29:443 10.132.0.21:48866 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T17:28:37.869Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 58 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "affb7d9c-af91-4293-b128-82c91556b763" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.29:443 10.132.0.21:48876 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T17:28:38.490039Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T17:28:38.490071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T17:28:38.490084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T17:28:38.490089Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T17:28:38.664997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T17:28:38.665032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T17:28:38.665048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T17:28:38.665053Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T17:28:39.135580Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T17:28:39.135614Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T17:28:39.135627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T17:28:39.135632Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T17:28:38.409Z] "DELETE /v1/api-keys/c68d0c7c-0287-4369-b1ec-0df60119f8a1 HTTP/1.1" 200 - via_upstream - "-" 0 321 80 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "59c76594-32a6-4137-90ba-609fca235d2c" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.132.0.44:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:49946 10.133.0.29:443 10.132.0.21:48886 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T17:28:38.589Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 75 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "ae714de4-9f21-4d01-8545-6e31931d061f" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.132.0.44:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:49946 10.133.0.29:443 10.132.0.21:48898 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T17:28:39.048Z] "DELETE /v1/api-keys/6e2fc3c2-531e-415f-8b19-3f089cb3bd25 HTTP/1.1" 200 - via_upstream - "-" 0 321 87 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "d1fe3685-c89b-4aa8-9139-541c6601f7f4" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.132.0.44:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:49946 10.133.0.29:443 10.132.0.21:40898 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T17:28:42.347430Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T17:28:42.347455Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T17:28:42.347458Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T17:28:42.347461Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T17:28:42.313Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 77 33 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "aa106b7e-331a-4275-b2eb-71161026b3f9" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.29:443 10.132.0.21:40906 - v1-completions-path 2026-10-30T17:28:53.200342Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:29:06.756383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:33:47.304331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:34:20.922973Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:36:19.771588Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:36:52.119885Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:38:25.768520Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:39:00.821048Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:39:34.276274Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:41:21.425365Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T17:53:46.676841Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T18:11:32.789361Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:11:32.789402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:11:32.789421Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:11:32.789428Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T18:11:32.693Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 95 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "a1829e13-c897-47cf-aed1-aeefaa8da84c" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.132.0.44:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:54632 10.133.0.29:443 10.132.0.21:56718 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:11:35.340422Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:11:37.461286Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:11:37.461321Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:11:37.461334Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:11:37.461339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T18:11:37.385Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 76 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "131d6442-5dc4-4fa0-a9e5-410cb5bfe4b6" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.132.0.44:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:54640 10.133.0.29:443 10.132.0.21:56738 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:12:00.099543Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:12:45.705167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T18:12:45.714988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:12:45.715031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:12:45.715051Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T18:12:45.715056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:12:45.782026Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T18:12:45.782050Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T18:12:45.782053Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T18:12:45.782057Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T18:12:45.635Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 79 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "6bb34407-44de-48ab-bdcd-97d5174fb487" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.132.0.44:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:40212 10.133.0.29:443 10.132.0.21:54202 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T18:12:45.736Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 45 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "979b46e4-c3a2-42a1-b1ca-8048823d9402" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.29:443 10.132.0.21:54204 - v1-completions-path 2026-10-30T18:12:53.369064Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:13:11.028065Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:13:24.037257Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:13:29.615729Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:13:29.615763Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:13:29.615777Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T18:13:29.615782Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T18:13:29.543Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 72 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "97a22ad7-7d1a-4b64-a163-bda8327e9b34" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.133.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.29:32994 10.133.0.29:443 10.132.0.21:58316 - v1-catch-all-path 2026-10-30T18:13:41.521122Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:13:44.052365Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:13:47.396006Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:13:56.976068Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T18:14:13.464Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 52 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "f16f453f-d97e-44bd-af2a-0609e02c6d45" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.29:443 10.132.0.21:41502 - v1-completions-path 2026-10-30T18:14:30.670924Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:14:41.098433Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:15:05.113815Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T18:15:09.840Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 69 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "c70b7a39-2b29-457e-a350-a9008e7a35ef" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.133.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.29:32994 10.133.0.29:443 10.132.0.21:33494 - v1-completions-path 2026-10-30T18:15:22.712349Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:15:25.065166Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:15:44.310991Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:15:56.417414Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:16:14.010636Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:16:31.195989Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:16:41.933384Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:16:45.017676Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:17:04.308353Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:17:07.053327Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:17:12.395031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T18:17:12.319Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 76 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "20b52d49-7461-462b-ae70-f9b36e8a56aa" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.132.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.29:38574 10.133.0.29:443 10.132.0.21:43462 - v1-completions-path 2026-10-30T18:17:28.001182Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:17:30.757711Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:19:10.283122Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:19:13.726715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:20:43.621159Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:20:59.206953Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:21:01.389465Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:21:26.120325Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:23:23.944253Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:23:45.236287Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:23:58.129132Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-30T18:24:09.500502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:24:09.500538Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:24:09.500552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:24:09.500557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T18:24:09.413Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 86 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "bebfc2ad-3ba0-4624-8632-cc566bb6b9f6" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.132.0.44:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:52066 10.133.0.29:443 10.132.0.21:44744 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:24:11.594841Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:24:23.501796Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:24:27.719179Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:24:39.383816Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:24:52.852857Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:25:18.167511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:25:18.167550Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:25:18.167569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:25:18.167574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T18:25:17.894Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 65 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "af220081-c22d-47af-94e1-d9d29d1b5462" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.29:443 10.132.0.21:43464 - v1-completions-path [2026-10-30T18:25:18.113Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 525 54 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "c6b0719f-b119-4d18-a681-d08c32ba62a9" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.132.0.44:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:39100 10.133.0.29:443 10.132.0.21:43468 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:25:29.980495Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:25:39.948074Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:25:45.497728Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:25:45.497768Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:25:45.497787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T18:25:45.497794Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T18:25:45.413Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 84 - "52.71.36.72,10.132.0.21" "python-requests/2.34.2" "e765f598-21d8-4467-b1c6-d8631b12c80a" "maas.apps.43d793594a117fff08c9.prod.konflux-ocp-ci.dev" "10.132.0.232:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.29:43764 10.133.0.29:443 10.132.0.21:43000 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T18:25:48.307762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:26:01.608462Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:26:03.916704Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:26:24.427071Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T18:26:35.341511Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8