2026-10-30T19:26:36.951910Z info FLAG: --concurrency="0" 2026-10-30T19:26:36.951928Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T19:26:36.951933Z info FLAG: --help="false" 2026-10-30T19:26:36.951935Z info FLAG: --log_as_json="false" 2026-10-30T19:26:36.951937Z info FLAG: --log_caller="" 2026-10-30T19:26:36.951939Z info FLAG: --log_output_level="default:info" 2026-10-30T19:26:36.951941Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T19:26:36.951946Z info FLAG: --log_target="[stdout]" 2026-10-30T19:26:36.951948Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T19:26:36.951950Z info FLAG: --outlierLogPath="" 2026-10-30T19:26:36.951952Z info FLAG: --profiling="true" 2026-10-30T19:26:36.951954Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T19:26:36.951956Z info FLAG: --proxyLogLevel="warning" 2026-10-30T19:26:36.951958Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T19:26:36.951960Z info FLAG: --stsPort="0" 2026-10-30T19:26:36.951962Z info FLAG: --templateFile="" 2026-10-30T19:26:36.951963Z info FLAG: --tokenManagerPlugin="" 2026-10-30T19:26:36.951966Z info FLAG: --vklog="0" 2026-10-30T19:26:36.951969Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T19:26:36.952106Z info Proxy role ips=[10.134.0.42] type=router id=maas-default-gateway-openshift-default-75bf867b6c-vzsw7.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T19:26:36.952179Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T19:26:36.953213Z info cpu limit detected as 2, setting concurrency 2026-10-30T19:26:36.953418Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T19:26:36.953429Z info JWT policy is third-party-jwt 2026-10-30T19:26:36.953432Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T19:26:36.955107Z info Starting default Istio SDS Server 2026-10-30T19:26:36.955363Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T19:26:36.955402Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T19:26:36.955402Z info Opening status port 15020 2026-10-30T19:26:36.956246Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T19:26:36.958121Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T19:26:36.958931Z info Starting proxy agent 2026-10-30T19:26:36.958961Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T19:26:36.967963Z info sds Starting SDS grpc server 2026-10-30T19:26:36.967990Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T19:26:37.024976Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T19:26:37.130793Z info cache generated new workload certificate resourceName=default latency=173.76508ms ttl=23h59m59.869213668s 2026-10-30T19:26:37.130843Z info cache Root cert has changed, start rotating root cert 2026-10-30T19:26:37.130887Z info cache returned workload trust anchor from cache ttl=23h59m59.869114047s 2026-10-30T19:26:37.159743Z info ads ADS: new connection for node:1 2026-10-30T19:26:37.159829Z info cache returned workload certificate from cache ttl=23h59m59.840173744s 2026-10-30T19:26:37.160635Z info ads ADS: new connection for node:2 2026-10-30T19:26:37.160870Z info cache returned workload trust anchor from cache ttl=23h59m59.839132381s 2026-10-30T19:26:37.250891Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:26:45.591074Z info Readiness succeeded in 8.641758381s 2026-10-30T19:26:45.591398Z info Envoy proxy is ready 2026-10-30T19:26:55.571717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:26:55.571772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:26:55.571797Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T19:26:55.571805Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T19:26:55.465Z] "DELETE /v1/api-keys/187946ec-84ba-482d-8bab-7346d14e2f11 HTTP/1.1" 200 - via_upstream - "-" 0 365 105 - "52.71.36.72,10.132.0.13" "curl/7.76.1" "c85dd013-fd6f-43de-acca-47a981074dcb" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:36138 10.134.0.42:443 10.132.0.13:33404 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:26:55.662114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:26:55.662152Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:26:55.662164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T19:26:55.662169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T19:26:55.638Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 23 - "52.71.36.72,10.132.0.13" "curl/7.76.1" "b81f1acc-d74c-4deb-87d2-0d4b7ecc88fc" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:36154 10.134.0.42:443 10.132.0.13:33412 - odh-ai-gateway-infra.maas-api-route.4 2026-10-30T19:29:35.573937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:29:35.573981Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:29:35.574002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:29:35.574008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T19:29:35.505Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 68 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "df148f65-2383-4267-893e-79d60ff76391" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:54056 10.134.0.42:443 10.132.0.13:43598 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T19:29:37.216Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 76 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "72c6ddab-5526-452a-8d07-291f5cf8302a" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.33:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:43178 10.134.0.42:443 10.132.0.13:43612 - v1-completions-path [2026-10-30T19:29:37.876Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 7 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "4cd53902-a7a5-42c7-b5da-06b6aed0bd12" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.42:443 10.132.0.13:43618 - - 2026-10-30T19:29:40.108367Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:29:40.108404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:29:40.108417Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:29:40.108422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T19:29:40.041Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 315 66 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "dab7d9cb-eb67-44c5-a2c7-e4af6cd78e2a" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:54056 10.134.0.42:443 10.132.0.13:43630 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:29:58.343134Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:30:13.629892Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:33:50.799815Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:33:50.799856Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:33:50.799871Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:33:50.799876Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T19:33:51.186756Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T19:33:50.736Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 63 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "086af45e-bb1e-4550-88f5-de8116a02f63" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:43558 10.134.0.42:443 10.132.0.13:54530 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:34:15.563863Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:35:00.355385Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T19:35:00.355417Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T19:35:00.355420Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T19:35:00.355424Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T19:35:00.305Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 50 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "da67be40-ab20-4384-86e4-3dbd80d260b6" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.132.0.13:39558 - v1-completions-path 2026-10-30T19:35:03.202081Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T19:35:06.001Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 72 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "6fa50677-c4fe-4dab-a8a1-463a7f5453d9" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:42088 10.134.0.42:443 10.132.0.13:57644 - v1-completions-path [2026-10-30T19:35:06.689Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 57 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "015c2d5b-7e62-4761-b9f4-592fd4d49849" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:42088 10.134.0.42:443 10.132.0.13:57654 - v1-completions-path 2026-10-30T19:35:18.923463Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:35:20.591693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:35:37.671156Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:35:39.401500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:35:42.264399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:35:50.965699Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T19:35:54.813Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 72 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "e3b092e8-0731-40e6-913b-0dd728e651e6" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:46136 10.134.0.42:443 10.132.0.13:50322 - v1-completions-path 2026-10-30T19:35:56.791679Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T19:35:56.735Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 57 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "564ee77d-1a5e-4936-b890-befc20844d2e" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:42088 10.134.0.42:443 10.132.0.13:50332 - v1-completions-path 2026-10-30T19:36:12.354640Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:36:22.522321Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:36:24.754062Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T19:36:30.862Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 67 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "c5e7653d-f443-46d7-b683-dac294c42d2d" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:46136 10.134.0.42:443 10.132.0.13:58030 - v1-completions-path [2026-10-30T19:36:31.350Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 61 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "696961f5-25b1-4c0c-adb1-e060ac054961" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:42088 10.134.0.42:443 10.132.0.13:58040 - v1-completions-path [2026-10-30T19:36:31.818Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 62 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "e7a6af78-e9c3-4116-b9d4-4613498c3a0c" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:42088 10.134.0.42:443 10.132.0.13:58044 - v1-completions-path 2026-10-30T19:36:43.312942Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:36:44.951827Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:37:01.783697Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:37:03.867946Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:37:20.337493Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:37:22.121469Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:37:38.197599Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:37:48.877649Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:37:51.794169Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T19:38:05.802Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 36 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "be5ba3b8-8c61-45b3-a3bd-5c7c2284bcd7" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.132.0.13:54828 - v1-completions-path 2026-10-30T19:38:13.988824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T19:38:17.297Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 65 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "32b6dcce-c465-453d-813e-415c7e22b0f8" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:42088 10.134.0.42:443 10.132.0.13:57858 - v1-completions-path 2026-10-30T19:38:28.971536Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:38:39.227525Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:40:26.725594Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:40:28.986649Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:41:53.313383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:42:07.408014Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:42:09.261453Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:42:14.560016Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-10-30T19:42:14.560096Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:42:14.560118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T19:42:14.560140Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T19:42:14.560147Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T19:42:14.493Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 307 66 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "aad9041c-d962-4111-9982-532111212ada" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:46434 10.134.0.42:443 10.132.0.13:46282 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:42:26.450078Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:43:49.837831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:43:49.837873Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:43:49.837893Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T19:43:49.837897Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T19:43:49.777Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 60 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "83bdbbfe-0647-4581-8dec-4a147e8d5602" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:53058 10.134.0.42:443 10.132.0.13:60864 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:43:51.482047Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:43:51.482087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:43:51.482101Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T19:43:51.482105Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T19:43:51.434Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 47 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "702178b8-3a59-4717-93a8-1011e18c5217" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:53058 10.134.0.42:443 10.132.0.13:60872 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:43:54.725249Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:44:14.036926Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:44:27.972948Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:44:39.259987Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:44:42.716302Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:44:53.765282Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:44:56.205024Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:45:02.044250Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:45:02.044290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:45:02.044306Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:45:02.044311Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T19:45:01.980Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 64 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "d66b4820-af9e-460b-ab13-017dae98e4ec" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.26:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:35820 10.134.0.42:443 10.132.0.13:34154 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:45:14.270688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:48:05.160938Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:48:08.262951Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-30T19:48:08.188Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 74 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "97b4d4e1-5b58-4d39-9db0-910052c28fea" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.29:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:54262 10.134.0.42:443 10.132.0.13:43428 - v1-catch-all-path 2026-10-30T19:48:10.376046Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:48:25.592676Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:48:27.250074Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:48:30.118693Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:48:30.118741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:48:30.118762Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T19:48:30.118769Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T19:48:30.042Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 76 - "52.71.36.72,10.132.0.13" "python-requests/2.34.2" "6a9fba9a-1cd6-426a-a706-5fbbda24a249" "maas.apps.6b9e089effcfb5925cc1.prod.konflux-ocp-ci.dev" "10.133.0.80:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:51354 10.134.0.42:443 10.132.0.13:38218 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T19:48:41.826329Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T19:48:52.736977Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8