2026-11-03T08:01:56.087665Z info FLAG: --concurrency="0" 2026-11-03T08:01:56.087683Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-03T08:01:56.087687Z info FLAG: --help="false" 2026-11-03T08:01:56.087690Z info FLAG: --log_as_json="false" 2026-11-03T08:01:56.087692Z info FLAG: --log_caller="" 2026-11-03T08:01:56.087694Z info FLAG: --log_output_level="default:info" 2026-11-03T08:01:56.087696Z info FLAG: --log_stacktrace_level="default:none" 2026-11-03T08:01:56.087701Z info FLAG: --log_target="[stdout]" 2026-11-03T08:01:56.087703Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-03T08:01:56.087705Z info FLAG: --outlierLogPath="" 2026-11-03T08:01:56.087707Z info FLAG: --profiling="true" 2026-11-03T08:01:56.087709Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-03T08:01:56.087711Z info FLAG: --proxyLogLevel="warning" 2026-11-03T08:01:56.087712Z info FLAG: --serviceCluster="istio-proxy" 2026-11-03T08:01:56.087714Z info FLAG: --stsPort="0" 2026-11-03T08:01:56.087716Z info FLAG: --templateFile="" 2026-11-03T08:01:56.087718Z info FLAG: --tokenManagerPlugin="" 2026-11-03T08:01:56.087721Z info FLAG: --vklog="0" 2026-11-03T08:01:56.087723Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-03T08:01:56.087917Z info Proxy role ips=[10.132.0.57] type=router id=maas-default-gateway-openshift-default-76f4876667-ln9hl.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-03T08:01:56.087965Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-03T08:01:56.088958Z info cpu limit detected as 2, setting concurrency 2026-11-03T08:01:56.089153Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-03T08:01:56.089163Z info JWT policy is third-party-jwt 2026-11-03T08:01:56.089166Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-03T08:01:56.090439Z info Starting default Istio SDS Server 2026-11-03T08:01:56.090463Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-03T08:01:56.090479Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-03T08:01:56.090857Z info Opening status port 15020 2026-11-03T08:01:56.091696Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-03T08:01:56.092252Z info sds Starting SDS grpc server 2026-11-03T08:01:56.092283Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-03T08:01:56.092971Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-03T08:01:56.093823Z info Starting proxy agent 2026-11-03T08:01:56.093863Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-03T08:01:56.154530Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-03T08:01:56.198880Z info cache generated new workload certificate resourceName=default latency=106.530893ms ttl=23h59m59.80112301s 2026-11-03T08:01:56.198912Z info cache Root cert has changed, start rotating root cert 2026-11-03T08:01:56.198945Z info cache returned workload trust anchor from cache ttl=23h59m59.801055752s 2026-11-03T08:01:56.252651Z info ads ADS: new connection for node:1 2026-11-03T08:01:56.252708Z info cache returned workload certificate from cache ttl=23h59m59.747293585s 2026-11-03T08:01:56.253056Z info ads ADS: new connection for node:2 2026-11-03T08:01:56.253119Z info cache returned workload trust anchor from cache ttl=23h59m59.746881916s 2026-11-03T08:01:56.330209Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:01:56.383224Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:01:56.383241Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:341 createWasm: failed to load (in progress) from http://kuadrant-operator-wasm.kuadrant-system.svc.cluster.local:8082/plugin.wasm thread=8 2026-11-03T08:01:56.383245Z critical envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:615 Plugin kuadrant-wasm-shim failed to load thread=8 2026-11-03T08:01:56.383249Z critical envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:465 Plugin configured to fail closed failed to load thread=8 2026-11-03T08:01:56.383252Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:350 createWasm: failed to load (cached) from http://kuadrant-operator-wasm.kuadrant-system.svc.cluster.local:8082/plugin.wasm thread=8 2026-11-03T08:01:56.383253Z critical envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:615 Plugin kuadrant-wasm-shim failed to load thread=8 2026-11-03T08:01:56.383256Z critical envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:465 Plugin configured to fail closed failed to load thread=8 2026-11-03T08:02:04.208850Z info Readiness succeeded in 8.124127246s 2026-11-03T08:02:04.209274Z info Envoy proxy is ready [2026-11-03T08:02:29.963Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 355 82 - "44.212.242.249,10.132.0.13" "curl/7.76.1" "ade86dca-908f-455b-a85f-8224172f0f88" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.57:45412 10.132.0.57:443 10.132.0.13:35154 - v1-model-routing [2026-11-03T08:02:30.610Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 60 - "44.212.242.249,10.132.0.13" "curl/7.76.1" "e545754e-3f4b-4e39-b656-30c18ad0bd63" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.57:443 10.132.0.13:35168 - v1-model-routing 2026-11-03T08:04:38.931950Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T08:04:38.931987Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T08:04:38.932001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T08:04:38.932006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T08:04:38.864Z] "DELETE /v1/api-keys/85c6606c-9cac-4864-a1f6-7153fa50b94a HTTP/1.1" 200 - via_upstream - "-" 0 321 67 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "cc39e332-b825-4b52-a0dd-a5751bf0c322" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.57:35286 10.132.0.57:443 10.132.0.13:56238 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T08:04:39.561314Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:04:39.561365Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:04:39.561384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:04:39.561392Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T08:04:39.907721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T08:04:39.907772Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T08:04:39.907788Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T08:04:39.907793Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T08:04:39.458Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 102 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "206d07fe-2533-474c-bde8-7754b6f7623e" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.57:39642 10.132.0.57:443 10.132.0.13:34962 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T08:04:39.821Z] "DELETE /v1/api-keys/c515ec00-bf2f-4313-a021-08f66fe31ccd HTTP/1.1" 200 - via_upstream - "-" 0 321 86 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "aad5a567-2e33-4b27-9ff6-bb699e3eeff1" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.57:35286 10.132.0.57:443 10.132.0.13:34970 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T08:04:40.551161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:04:40.551195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:04:40.551208Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:04:40.551213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T08:04:40.617298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:04:40.617343Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:04:40.617365Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T08:04:40.617372Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:04:40.948080Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:04:40.948114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:04:40.948127Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T08:04:40.948132Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-03T08:04:40.492Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 58 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "0df206fb-8c05-4f66-850f-ce0254fe090b" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.57:39642 10.132.0.57:443 10.132.0.13:34972 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T08:04:40.558Z] "DELETE /v1/api-keys/3bb74525-8f65-4dca-91c7-0bcf1555fd5d HTTP/1.1" 200 - via_upstream - "-" 0 321 59 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "d59fd01d-726d-48c5-b832-4e4065a4027c" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.57:39642 10.132.0.57:443 10.132.0.13:34978 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-03T08:04:40.885Z] "DELETE /v1/api-keys/e1583b7c-0dc1-43d8-9346-7bc2ff953a00 HTTP/1.1" 200 - via_upstream - "-" 0 321 63 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "3b610152-8cdd-435b-9af5-54d087bea971" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.57:39642 10.132.0.57:443 10.132.0.13:34986 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T08:05:01.051390Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:05:15.332278Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:07:55.406711Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:07:55.406750Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:07:55.406806Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-03T08:07:55.406814Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:07:55.407020Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-11-03T08:07:55.407076Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T08:07:55.407084Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T08:07:55.407086Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T08:07:55.407090Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T08:07:55.214Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 192 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "b206aabf-7ca8-4079-9b7c-c02eedeaeea4" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.57:45412 10.132.0.57:443 10.132.0.13:38612 - v1-completions-path 2026-11-03T08:08:05.331412Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:08:05.331461Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:08:05.331482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:08:05.331490Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T08:08:05.195Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 135 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "deacaf86-0f1c-4921-a33b-18e94f65315f" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.57:41456 10.132.0.57:443 10.132.0.13:45538 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T08:08:09.361934Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:08:09.361970Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:08:09.361983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:08:09.361990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T08:08:09.344Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 17 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "bade75aa-a1d9-4ec3-b2b9-528e094c8d77" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.57:41456 10.132.0.57:443 10.132.0.13:35568 - odh-ai-gateway-infra.maas-api-route.4 2026-11-03T08:08:48.643879Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:09:28.659450Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:10:54.703066Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:11:57.611018Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:13:41.754331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:29:07.804915Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:29:29.747569Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:29:32.914274Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-03T08:30:13.297030Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T08:30:13.297067Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T08:30:13.297081Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-03T08:30:13.297086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-03T08:30:13.228Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 68 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "1eeed84b-d532-421f-8c06-c74989910742" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.57:40150 10.132.0.57:443 10.132.0.13:60842 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T08:30:16.002673Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T08:30:22.026Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 76 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "ce70ffe9-2b97-4e43-bcff-bf273f5e8a7c" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.57:33406 10.132.0.57:443 10.132.0.13:50668 - v1-completions-path 2026-11-03T08:30:34.265546Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:30:35.958967Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:30:52.833959Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:30:54.490671Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:30:57.323718Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:31:05.551023Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-03T08:31:11.708Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 59 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "d27e9f3d-99f0-4230-9b9e-8c6b3090c33e" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.57:33406 10.132.0.57:443 10.132.0.13:44964 - v1-completions-path [2026-11-03T08:31:11.918Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 62 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "6826e487-038a-4e94-8f59-580267a527cb" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.57:35042 10.132.0.57:443 10.132.0.13:44968 - v1-completions-path 2026-11-03T08:31:29.922036Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:31:40.100995Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:31:41.950279Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:31:48.302996Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-03T08:31:48.249Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "add5a222-04b1-489c-b96f-1cf0eff708fb" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.132.0.51:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.57:35042 10.132.0.57:443 10.132.0.13:60248 - v1-completions-path 2026-11-03T08:32:00.492462Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:32:02.362224Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:32:18.541528Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:32:20.697013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:32:37.121643Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:32:38.716583Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:32:53.900355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-11-03T08:32:53.839Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 68 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "ee6d3bf5-e9fb-4038-b93b-dac0061b7e9c" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.57:48806 10.132.0.57:443 10.132.0.13:50346 - v1-completions-path 2026-11-03T08:32:54.768104Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:33:05.396681Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:33:08.065840Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:33:14.799710Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T08:33:14.799746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T08:33:14.799786Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-03T08:33:14.799792Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-03T08:33:14.735Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 64 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "f42dbd0c-18c0-4873-9c98-edde9d4b8103" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.57:35088 10.132.0.57:443 10.132.0.13:40820 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T08:33:26.946730Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:33:29.092227Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:33:32.821178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:33:32.821217Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:33:32.821233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-03T08:33:32.821238Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-03T08:33:32.757Z] "DELETE /v1/api-keys/586bd652-7817-4dc0-b919-d8b2fb64524e HTTP/1.1" 200 - via_upstream - "-" 0 375 63 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "b887d161-3352-4fe5-ba79-b1b5e4dbccf6" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.57:56162 10.132.0.57:443 10.132.0.13:51746 - odh-ai-gateway-infra.maas-api-route.3 2026-11-03T08:33:36.139864Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:33:38.798577Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:33:57.875291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:34:08.155163Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:34:23.835219Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:34:26.871500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:36:07.047456Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:36:10.132333Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:37:36.891522Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:37:51.681064Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:37:53.250771Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:38:12.452973Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:39:38.024916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:39:54.115841Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:40:09.503524Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:40:21.183331Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:40:25.133963Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:40:33.446440Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:40:36.125656Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:40:53.738649Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:43:39.072342Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T08:43:39.072365Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T08:43:39.072368Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-03T08:43:39.072372Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-03T08:43:39.016Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 103 55 - "44.212.242.249,10.132.0.13" "python-requests/2.34.2" "6a1aa801-5242-44a7-88eb-b90d6274920e" "maas.apps.ceb0d7c3dcf58bcad059.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.57:443 10.132.0.13:46552 - v1-catch-all-path 2026-11-03T08:43:40.927612Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:43:46.065481Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:44:01.725569Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:44:03.265276Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:44:17.436014Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-03T08:44:28.169924Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8