2026-10-30T22:02:27.072567Z info FLAG: --concurrency="0" 2026-10-30T22:02:27.072582Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T22:02:27.072586Z info FLAG: --help="false" 2026-10-30T22:02:27.072588Z info FLAG: --log_as_json="false" 2026-10-30T22:02:27.072590Z info FLAG: --log_caller="" 2026-10-30T22:02:27.072592Z info FLAG: --log_output_level="default:info" 2026-10-30T22:02:27.072595Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T22:02:27.072599Z info FLAG: --log_target="[stdout]" 2026-10-30T22:02:27.072601Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T22:02:27.072603Z info FLAG: --outlierLogPath="" 2026-10-30T22:02:27.072605Z info FLAG: --profiling="true" 2026-10-30T22:02:27.072607Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T22:02:27.072609Z info FLAG: --proxyLogLevel="warning" 2026-10-30T22:02:27.072611Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T22:02:27.072613Z info FLAG: --stsPort="0" 2026-10-30T22:02:27.072615Z info FLAG: --templateFile="" 2026-10-30T22:02:27.072617Z info FLAG: --tokenManagerPlugin="" 2026-10-30T22:02:27.072620Z info FLAG: --vklog="0" 2026-10-30T22:02:27.072624Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T22:02:27.072752Z info Proxy role ips=[10.134.0.38] type=router id=maas-default-gateway-openshift-default-85544d4cd7-8mdvr.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T22:02:27.072790Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T22:02:27.073937Z info cpu limit detected as 2, setting concurrency 2026-10-30T22:02:27.074126Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T22:02:27.074138Z info JWT policy is third-party-jwt 2026-10-30T22:02:27.074141Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T22:02:27.076336Z info Starting default Istio SDS Server 2026-10-30T22:02:27.076355Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T22:02:27.076377Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T22:02:27.076526Z info Opening status port 15020 2026-10-30T22:02:27.077927Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T22:02:27.078663Z info sds Starting SDS grpc server 2026-10-30T22:02:27.078746Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T22:02:27.079299Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T22:02:27.080155Z info Starting proxy agent 2026-10-30T22:02:27.080183Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T22:02:27.143458Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T22:02:27.183853Z info cache generated new workload certificate resourceName=default latency=105.015645ms ttl=23h59m59.81615813s 2026-10-30T22:02:27.183885Z info cache Root cert has changed, start rotating root cert 2026-10-30T22:02:27.183916Z info cache returned workload trust anchor from cache ttl=23h59m59.81608477s 2026-10-30T22:02:27.311740Z info ads ADS: new connection for node:1 2026-10-30T22:02:27.311792Z info cache returned workload certificate from cache ttl=23h59m59.688209206s 2026-10-30T22:02:27.312004Z info ads ADS: new connection for node:2 2026-10-30T22:02:27.312069Z info cache returned workload trust anchor from cache ttl=23h59m59.687932186s 2026-10-30T22:02:27.391389Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:02:35.296423Z info Readiness succeeded in 8.226543287s 2026-10-30T22:02:35.296737Z info Envoy proxy is ready 2026-10-30T22:02:48.704304Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:02:51.883331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:03:23.505179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:03:23.505218Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:03:23.505232Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:03:23.505237Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T22:03:23.297Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 208 - "52.71.36.72,10.132.0.19" "curl/7.76.1" "27ab3ab7-3700-4ef1-96c9-1f8062caa2e8" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:40232 10.134.0.38:443 10.132.0.19:46402 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T22:03:26.646Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 112 - "52.71.36.72,10.132.0.19" "curl/7.76.1" "b9c6b6ef-31d1-4e5e-adfd-32ef613c3406" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.38:443 10.132.0.19:46410 - v1-model-routing 2026-10-30T22:03:27.553083Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T22:03:27.553109Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T22:03:27.553112Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-10-30T22:03:27.553116Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-10-30T22:03:26.952Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 90 - "52.71.36.72,10.132.0.19" "curl/7.76.1" "6718cc44-9ce3-4e92-895f-0b31c1a01e69" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.38:443 10.132.0.19:46416 - v1-model-routing [2026-10-30T22:03:27.529Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 88 23 - "52.71.36.72,10.132.0.19" "curl/7.76.1" "ad1200a1-af7c-4a13-b345-0b3e4b8a30e3" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.38:443 10.132.0.19:46422 - v1-model-routing 2026-10-30T22:03:28.112385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:03:28.112444Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:03:28.112457Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:03:28.112462Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T22:03:28.103Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 8 - "52.71.36.72,10.132.0.19" "curl/7.76.1" "c95f369a-f4c9-40d5-b2a6-1ae2aba68b68" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:40232 10.134.0.38:443 10.132.0.19:46436 - odh-ai-gateway-infra.maas-api-route.4 2026-10-30T22:08:03.210113Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:08:03.210150Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:08:03.210164Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:08:03.210169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T22:08:03.059Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 150 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "889c81f9-a38f-4772-89d5-8c7088808632" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:46440 10.134.0.38:443 10.132.0.19:53430 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:08:04.433845Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:08:04.433889Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:08:04.433907Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:08:04.433914Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T22:08:04.327Z] "DELETE /v1/api-keys/e3dbf188-f9b1-482f-b3d5-8256544d44e9 HTTP/1.1" 200 - via_upstream - "-" 0 321 106 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "b8c980d4-4ca7-4c35-bee4-567e01a7212b" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:46440 10.134.0.38:443 10.132.0.19:53446 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:08:06.184847Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:08:06.184882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:08:06.184896Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:08:06.184901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T22:08:06.069Z] "DELETE /v1/api-keys/f19dcc20-acb7-4696-99ca-8ee42c20fa7e HTTP/1.1" 200 - via_upstream - "-" 0 321 115 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "187151ed-3064-48d0-a056-761fd8917664" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:46452 10.134.0.38:443 10.132.0.19:53462 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:08:08.541213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:08:08.541248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:08:08.541262Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:08:08.541267Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T22:08:08.433Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 107 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "3781418f-6cfd-48dc-b7a4-ffa60f5b25dd" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:46452 10.134.0.38:443 10.132.0.19:53480 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:08:23.945673Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:08:23.945800Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:08:23.945851Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T22:08:23.945881Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:08:24.633585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:08:24.633621Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:08:24.633635Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T22:08:24.633639Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T22:08:23.837Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 108 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "07811671-4bb2-4746-99de-d9041c70f2b4" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:46452 10.134.0.38:443 10.132.0.19:52704 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T22:08:24.525Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 108 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "37bb2842-76d5-4076-a6dd-b1c5cca6a06e" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:46440 10.134.0.38:443 10.132.0.19:52708 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T22:08:26.906Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 8 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "f44bdb7d-0b59-4737-8ec7-ae8a377d1eb2" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "-" - - 10.134.0.38:443 10.132.0.19:52724 - - 2026-10-30T22:08:31.667131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:08:54.656317Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:14:40.511655Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:14:40.511699Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:14:40.511722Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:14:40.511729Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T22:14:40.386Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 125 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "577ffade-ccd6-4b0c-bf50-5c9da8c55ca1" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:47610 10.134.0.38:443 10.132.0.19:49720 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:14:41.156432Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T22:14:41.061Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 135 4637 96 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "016b030f-9414-4428-93f5-ee1860849fb7" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.31:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:36784 10.134.0.38:443 10.132.0.19:49730 - v1-chat-completions-path 2026-10-30T22:16:02.584100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-30T22:16:02.591642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:16:02.591683Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:16:02.591708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:16:02.591715Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T22:16:02.472Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 119 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "85e42f6d-f417-4798-b5f8-9ee063f32182" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:52116 10.134.0.38:443 10.132.0.19:48552 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:16:27.299385Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:17:16.870135Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:18:50.254016Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:21:30.027388Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:22:34.745741Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:24:32.674836Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:34:39.020765Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T22:41:06.098041Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:41:06.098075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:41:06.098090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T22:41:06.098094Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T22:41:05.932Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 165 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "16518f13-7cbd-43bb-b546-d65898cf6ed7" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:51250 10.134.0.38:443 10.132.0.19:36886 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:41:11.269169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:41:11.269204Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:41:11.269220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:41:11.269225Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T22:41:11.156Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 112 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "370d939c-2a38-4bbd-bebb-45b622e43ece" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:49932 10.134.0.38:443 10.132.0.19:36894 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:41:13.903275Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:41:36.847431Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:41:46.770018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:41:46.770052Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:41:46.770064Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:41:46.770069Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T22:41:46.571Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 198 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "2855f3f2-91fc-4e6b-819c-c6672c585309" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:49932 10.134.0.38:443 10.132.0.19:53516 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:42:23.139313Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T22:42:23.139336Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T22:42:23.139340Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T22:42:23.139344Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T22:42:23.093Z] "POST /llm/premium-simulated-simulated-premium/v1/completions HTTP/1.1" 403 - - "-" 74 77 46 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "cf727768-61b2-47e7-bf0d-2e08b9b03b8d" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "-" outbound|8000||premium-simulated-simulated-premium-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.38:443 10.132.0.19:35354 - v1-completions-path 2026-10-30T22:42:33.034755Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T22:42:39.706Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 74 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "deb82bd1-58e8-4497-bdd9-437bbd799764" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:57894 10.134.0.38:443 10.132.0.19:36094 - v1-completions-path [2026-10-30T22:42:40.089Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 59 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "b443c86d-a37b-4488-89be-108f3f5f6172" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:57894 10.134.0.38:443 10.132.0.19:36102 - v1-completions-path [2026-10-30T22:42:40.827Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 54 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "66978d5b-11ff-4f20-8194-227fcbd9ba26" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.38:443 10.132.0.19:36116 - v1-completions-path 2026-10-30T22:42:54.370271Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:43:00.830049Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:43:25.816232Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:43:42.769515Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T22:43:50.768Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 65 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "b626ab2c-5bbe-4356-8011-bca5f925f986" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:57894 10.134.0.38:443 10.132.0.19:53688 - v1-completions-path 2026-10-30T22:44:13.595122Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:44:24.155832Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:44:28.758420Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T22:44:43.256Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 61 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "a3acb84f-d4f6-46bb-8f01-49b0339cde5e" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.38:57894 10.134.0.38:443 10.132.0.19:41490 - v1-completions-path 2026-10-30T22:44:59.120979Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:45:03.764958Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:45:27.403707Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:45:33.585037Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:45:59.863810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:46:22.081593Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:46:34.981443Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:46:40.939709Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:47:05.720989Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:47:11.050600Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:47:31.266799Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:47:54.525755Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:48:05.168784Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:48:27.469153Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:48:33.288666Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:50:50.818239Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:50:56.847105Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:52:41.819449Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:52:59.081098Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:53:03.507435Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:53:28.249762Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:55:33.204022Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:56:15.206826Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:56:46.238993Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:57:00.473079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:57:14.076745Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:57:26.301313Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:57:31.328801Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:57:43.819556Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:57:43.819594Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:57:43.819609Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:57:43.819615Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T22:57:43.760Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 59 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "b24d6bd9-47d5-402c-a173-afbc0f1ef39d" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.30:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:47064 10.134.0.38:443 10.132.0.19:36574 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:57:58.651441Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:01:46.084995Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:01:57.827421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:02:18.896136Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:02:23.435912Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:02:24.172431Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T23:02:24.172481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T23:02:24.172507Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T23:02:24.172515Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T23:02:24.019Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 153 - "52.71.36.72,10.132.0.19" "python-requests/2.34.2" "c9fc1a7a-c645-488f-b923-c41cb180ef60" "maas.apps.0a13e7100aacd389351d.prod.konflux-ocp-ci.dev" "10.133.0.166:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.38:59084 10.134.0.38:443 10.132.0.19:35322 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T23:02:39.800377Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T23:02:51.403223Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8