2026-11-03T20:40:18.811713Z info FLAG: --concurrency="0" 2026-11-03T20:40:18.811735Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T20:40:18.811739Z info FLAG: --help="false" 2026-11-03T20:40:18.811742Z info FLAG: --log_as_json="false" 2026-11-03T20:40:18.811744Z info FLAG: --log_caller="" 2026-11-03T20:40:18.811745Z info FLAG: --log_output_level="default:info" 2026-11-03T20:40:18.811747Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T20:40:18.811752Z info FLAG: --log_target="[stdout]" 2026-11-03T20:40:18.811754Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T20:40:18.811756Z info FLAG: --outlierLogPath="" 2026-11-03T20:40:18.811759Z info FLAG: --profiling="true" 2026-11-03T20:40:18.811761Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T20:40:18.811762Z info FLAG: --proxyLogLevel="warning" 2026-11-03T20:40:18.811764Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T20:40:18.811766Z info FLAG: --stsPort="0" 2026-11-03T20:40:18.811768Z info FLAG: --templateFile="" 2026-11-03T20:40:18.811770Z info FLAG: --tokenManagerPlugin="" 2026-11-03T20:40:18.811772Z info FLAG: --vklog="0" 2026-11-03T20:40:18.811775Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T20:40:18.811922Z info Proxy role ips=[10.132.0.64] type=router id=maas-default-gateway-openshift-default-696f47c6c-fm4zc.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T20:40:18.811968Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T20:40:18.813150Z info cpu limit detected as 2, setting concurrency 2026-11-03T20:40:18.813366Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T20:40:18.813378Z info JWT policy is third-party-jwt 2026-11-03T20:40:18.813381Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T20:40:18.815314Z info Starting default Istio SDS Server 2026-11-03T20:40:18.815338Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T20:40:18.815356Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T20:40:18.815566Z info Opening status port 15020 2026-11-03T20:40:18.816470Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T20:40:18.817841Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T20:40:18.818922Z info Starting proxy agent 2026-11-03T20:40:18.818956Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T20:40:18.827365Z info sds Starting SDS grpc server 2026-11-03T20:40:18.827386Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T20:40:18.887052Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T20:40:18.929211Z info cache generated new workload certificate resourceName=default latency=112.265115ms ttl=23h59m59.070793682s 2026-11-03T20:40:18.929254Z info cache Root cert has changed, start rotating root cert 2026-11-03T20:40:18.929291Z info cache returned workload trust anchor from cache ttl=23h59m59.070709498s 2026-11-03T20:40:19.025658Z info ads ADS: new connection for node:1 2026-11-03T20:40:19.025721Z info cache returned workload certificate from cache ttl=23h59m58.974280289s 2026-11-03T20:40:19.026065Z info ads ADS: new connection for node:2 2026-11-03T20:40:19.026154Z info cache returned workload trust anchor from cache ttl=23h59m58.973846999s 2026-11-03T20:40:19.104755Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:40:27.009015Z info Readiness succeeded in 8.200125322s 2026-11-03T20:40:27.009334Z info Envoy proxy is ready 2026-11-03T20:40:48.398528Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:40:51.613172Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:41:47.713601Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:41:47.713644Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:41:47.713660Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:41:47.713667Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T20:41:47.545Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 167 - "44.212.242.249,10.132.0.18" "curl/7.76.1" "af3eff7a-4da1-4790-a5eb-0d04289f5225" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.64:60552 10.132.0.64:443 10.132.0.18:53606 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:41:48.036032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:41:48.036074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:41:48.036121Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T20:41:48.036127Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T20:41:47.952Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 83 - "44.212.242.249,10.132.0.18" "curl/7.76.1" "5bcca892-d6ad-49ac-9cc6-6a367fb5c736" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.64:60558 10.132.0.64:443 10.132.0.18:53608 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T20:41:50.627Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 61 - "44.212.242.249,10.132.0.18" "curl/7.76.1" "feccf43a-7ca8-43a5-8d46-76a64cc6af9a" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.64:443 10.132.0.18:51768 - v1-model-routing 2026-11-03T20:41:51.777118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:41:51.777151Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:41:51.777163Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:41:51.777168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T20:41:51.672Z] "DELETE /v1/api-keys/71b2729c-4a5e-4243-98c5-4b2a1704aa8e HTTP/1.1" 200 - via_upstream - "-" 0 365 104 - "44.212.242.249,10.132.0.18" "curl/7.76.1" "979502ca-141c-45d5-aa1a-2f8cb237981b" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.64:60552 10.132.0.64:443 10.132.0.18:51776 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:46:13.181023Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:46:13.181059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:46:13.181071Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:46:13.181076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T20:46:13.072Z] "DELETE /v1/api-keys/11df9b93-d33d-4392-b898-e19ab2ac0903 HTTP/1.1" 200 - via_upstream - "-" 0 321 108 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "430ae914-7c6f-4af6-b1f2-931021d3fa0b" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.64:40844 10.132.0.64:443 10.132.0.18:50488 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:46:14.612119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:46:14.612161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:46:14.612178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:46:14.612185Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T20:46:14.511Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 100 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "e905ef82-fb5f-48b7-a954-85e14250c29e" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.64:40844 10.132.0.64:443 10.132.0.18:50500 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:46:17.284756Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:46:17.284789Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:46:17.284801Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:46:17.284806Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T20:46:17.180Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 104 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "ebabb323-ffc0-494a-b182-a364027db45c" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.64:40844 10.132.0.64:443 10.132.0.18:50522 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:46:17.595781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:46:17.595816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:46:17.595828Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:46:17.595833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T20:46:18.079505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:46:18.079540Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:46:18.079552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T20:46:18.079557Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T20:46:17.489Z] "DELETE /v1/api-keys/f618810b-787c-4fcd-a96b-70e55ff8b922 HTTP/1.1" 200 - via_upstream - "-" 0 321 106 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "7a2b601c-7242-43c7-bf03-164f974ed8f4" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.64:40860 10.132.0.64:443 10.132.0.18:50534 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T20:46:17.977Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 102 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "8f75decb-7626-4338-bf94-c6c3af9ea8e8" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.64:40844 10.132.0.64:443 10.132.0.18:50550 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T20:46:29.629607Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:46:29.629642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:46:29.629654Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T20:46:29.629658Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T20:46:30.483850Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T20:46:29.526Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 103 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "3c75b160-3d8a-4091-82d6-27ecea7b93e9" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.64:40860 10.132.0.64:443 10.132.0.18:39850 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T20:46:30.425Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 76 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "d79ba08a-3e9c-40e3-968d-0e6c566f8ab1" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "10.132.0.62:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.64:58360 10.132.0.64:443 10.132.0.18:39866 - v1-completions-path [2026-11-03T20:46:36.266Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 47 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "bcc8c6fe-724b-45db-9f34-a745fbe928a2" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.64:443 10.132.0.18:39874 - v1-completions-path 2026-11-03T20:46:38.073844Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:47:06.770530Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T20:53:16.483Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 60 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "82dfb273-3239-43e7-8091-2c33cd74f72c" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "-" - - 10.132.0.64:443 10.132.0.18:46788 - - 2026-11-03T20:54:07.324508Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:55:55.596756Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:56:35.957886Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T20:59:51.119960Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:05:52.037728Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:06:35.187944Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:08:09.749174Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:09:06.518229Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T21:10:56.377462Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:12:26.978440Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:18:17.088595Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:18:41.328701Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:19:37.884349Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:19:58.823614Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:20:13.167341Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:20:35.191940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:20:55.487968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:21:11.934629Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:21:21.102065Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T21:21:21.095Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 62 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "f7f3d3b2-4a4f-481a-974b-b64816684a7f" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.64:443 10.132.0.18:54454 - v1-completions-path [2026-11-03T21:21:21.917Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 77 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "b24dc867-352d-4e44-8804-7d8bc105eec7" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "10.132.0.61:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.64:52002 10.132.0.64:443 10.132.0.18:54460 - v1-completions-path [2026-11-03T21:21:23.864Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "ef933166-6259-46b1-af8f-0fe00c86bcd8" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "10.132.0.61:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.64:52002 10.132.0.64:443 10.132.0.18:54464 - v1-completions-path 2026-11-03T21:21:43.107688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:21:53.761756Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:21:59.819768Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:22:28.656730Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:22:33.074540Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:22:56.352764Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:23:02.310677Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:23:28.609887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T21:23:45.284Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 66 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "e41d8816-dd09-457c-a74a-44fcb444ad30" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "10.132.0.62:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.64:58360 10.132.0.64:443 10.132.0.18:53746 - v1-completions-path 2026-11-03T21:23:47.564002Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:24:00.427385Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:24:06.100424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:24:06.100461Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:24:06.100474Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T21:24:06.100479Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T21:24:05.985Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 114 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "2e82e0a6-253e-4503-9718-21696ba7acd1" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.64:32808 10.132.0.64:443 10.132.0.18:40300 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T21:24:34.558771Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:24:54.981502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:24:54.981540Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T21:24:54.981554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T21:24:54.981559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T21:24:54.870Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 67 308 110 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "6d7cc491-cc15-4781-a908-e90c0b9a5477" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.64:46624 10.132.0.64:443 10.132.0.18:49146 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T21:25:09.450207Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:25:19.974692Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:29:05.185914Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T21:29:05.185942Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T21:29:05.185945Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-11-03T21:29:05.185949Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-11-03T21:29:05.137Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 48 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "027c6055-6c01-493e-b7a1-5e1f65b72c71" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.64:443 10.132.0.18:35218 - v1-completions-path 2026-11-03T21:29:28.922079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:29:46.007324Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:29:58.626294Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:30:18.394356Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:32:11.445244Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:32:11.445289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T21:32:11.445306Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T21:32:11.445310Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T21:32:11.335Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 109 - "44.212.242.249,10.132.0.18" "python-requests/2.34.2" "a1a2873d-e999-4d54-9ea7-5a26ef2d5b5a" "maas.apps.2cc86969c691a66e5e58.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.64:52040 10.132.0.64:443 10.132.0.18:40896 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T21:32:21.776424Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:33:02.610315Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:33:29.579190Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:33:45.446049Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:34:04.331046Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:34:16.916954Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:34:21.550082Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:34:47.530794Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:38:29.513144Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:38:40.966447Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:38:57.690908Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-03T21:39:01.852619Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:39:06.419768Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:39:22.676944Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T21:39:34.479067Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8