2026-11-01T20:04:19.113159Z info FLAG: --concurrency="0" 2026-11-01T20:04:19.113176Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-01T20:04:19.113181Z info FLAG: --help="false" 2026-11-01T20:04:19.113183Z info FLAG: --log_as_json="false" 2026-11-01T20:04:19.113185Z info FLAG: --log_caller="" 2026-11-01T20:04:19.113187Z info FLAG: --log_output_level="default:info" 2026-11-01T20:04:19.113189Z info FLAG: --log_stacktrace_level="default:none" 2026-11-01T20:04:19.113194Z info FLAG: --log_target="[stdout]" 2026-11-01T20:04:19.113196Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-01T20:04:19.113198Z info FLAG: --outlierLogPath="" 2026-11-01T20:04:19.113200Z info FLAG: --profiling="true" 2026-11-01T20:04:19.113202Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-01T20:04:19.113206Z info FLAG: --proxyLogLevel="warning" 2026-11-01T20:04:19.113208Z info FLAG: --serviceCluster="istio-proxy" 2026-11-01T20:04:19.113210Z info FLAG: --stsPort="0" 2026-11-01T20:04:19.113212Z info FLAG: --templateFile="" 2026-11-01T20:04:19.113214Z info FLAG: --tokenManagerPlugin="" 2026-11-01T20:04:19.113216Z info FLAG: --vklog="0" 2026-11-01T20:04:19.113219Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-01T20:04:19.113375Z info Proxy role ips=[10.133.0.22] type=router id=maas-default-gateway-openshift-default-fd4b99879-ljtcq.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-01T20:04:19.113425Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-01T20:04:19.114473Z info cpu limit detected as 2, setting concurrency 2026-11-01T20:04:19.114656Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-01T20:04:19.114666Z info JWT policy is third-party-jwt 2026-11-01T20:04:19.114669Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-01T20:04:19.116056Z info Starting default Istio SDS Server 2026-11-01T20:04:19.116081Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-01T20:04:19.116105Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-01T20:04:19.116595Z info Opening status port 15020 2026-11-01T20:04:19.117881Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-01T20:04:19.118085Z info sds Starting SDS grpc server 2026-11-01T20:04:19.118118Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-01T20:04:19.119335Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-01T20:04:19.120078Z info Starting proxy agent 2026-11-01T20:04:19.120106Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-01T20:04:19.182519Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-01T20:04:19.210526Z info cache generated new workload certificate resourceName=default latency=92.332835ms ttl=23h59m59.789476723s 2026-11-01T20:04:19.210559Z info cache Root cert has changed, start rotating root cert 2026-11-01T20:04:19.210588Z info cache returned workload trust anchor from cache ttl=23h59m59.78941265s 2026-11-01T20:04:19.267888Z info ads ADS: new connection for node:1 2026-11-01T20:04:19.267942Z info cache returned workload certificate from cache ttl=23h59m59.732060065s 2026-11-01T20:04:19.268264Z info ads ADS: new connection for node:2 2026-11-01T20:04:19.268343Z info cache returned workload trust anchor from cache ttl=23h59m59.731658259s 2026-11-01T20:04:19.309541Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:04:25.661376Z info Readiness succeeded in 6.550865493s 2026-11-01T20:04:25.661665Z info Envoy proxy is ready 2026-11-01T20:05:03.425337Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:05:03.898557Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:05:33.174736Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:05:35.839627Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:05:37.367838Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:05:39.325694Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:05:40.698966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:05:42.676412Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:05:45.484030Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:06:05.678195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:05.678249Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:05.678271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:05.678279Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T20:06:05.597Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 321 81 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "e0c40e5a-35ae-473a-a972-a4bd08ecc524" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.22:46772 10.133.0.22:443 10.132.0.21:37446 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T20:06:05.829769Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:05.829814Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:05.829832Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T20:06:05.829836Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T20:06:05.756Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 73 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "1b7dee8b-60aa-4179-a46f-f9fc3114456a" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.22:46772 10.133.0.22:443 10.132.0.21:37454 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T20:06:05.932Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 335 73 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "e8d47177-c0c1-45ad-9bc5-a59e8211727e" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.22:42998 10.133.0.22:443 10.132.0.21:37462 - v1-model-routing [2026-11-01T20:06:06.099Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 409 56 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "19841630-3592-4ee6-bc19-32413d9c0481" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.22:42998 10.133.0.22:443 10.132.0.21:37470 - v1-model-routing [2026-11-01T20:06:06.228Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 369 62 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "6036dcd6-3241-4ee9-9c19-cb3c181f55ed" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.22:43006 10.133.0.22:443 10.132.0.21:37474 - v1-model-routing [2026-11-01T20:06:06.361Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 382 55 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "98c0a06d-dc6d-4ef4-b1fc-224e28148895" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.22:43006 10.133.0.22:443 10.132.0.21:37478 - v1-model-routing 2026-11-01T20:06:06.704038Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-11-01T20:06:06.943493Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-11-01T20:06:07.378335Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T20:06:07.378354Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T20:06:07.378357Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-01T20:06:07.378361Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-01T20:06:06.477Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 377 107 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "2acf1189-e19d-43e0-a4c9-807997e9e31d" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.22:43006 10.133.0.22:443 10.132.0.21:37494 - v1-model-routing [2026-11-01T20:06:06.644Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 59 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "c717c202-4f34-4e0f-a83c-8d7a1bca757b" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.22:443 10.132.0.21:37508 - v1-model-routing [2026-11-01T20:06:06.776Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 54 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "79c81443-1fd7-4d3e-a29c-7cadfae8ce0e" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.22:443 10.132.0.21:37512 - v1-model-routing [2026-11-01T20:06:06.891Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 53 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "297ea155-8fb0-4a50-a47d-39b659e03d9b" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.22:443 10.132.0.21:37528 - v1-model-routing [2026-11-01T20:06:07.001Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 51 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "43edba26-cd1d-44fb-8a88-51e212355645" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.22:443 10.132.0.21:37544 - v1-model-routing [2026-11-01T20:06:07.128Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 53 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "1ad84f5a-9d50-4c95-ab09-6903b47e453f" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.22:443 10.132.0.21:37552 - v1-model-routing [2026-11-01T20:06:07.248Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 53 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "078c9bc1-1b9b-4780-aed6-482ebb3ed7e8" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.22:443 10.132.0.21:37554 - v1-model-routing [2026-11-01T20:06:07.361Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 88 16 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "7aec9dd3-8e7b-4a32-a462-33594d279b0c" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.22:443 10.132.0.21:37566 - v1-model-routing 2026-11-01T20:06:07.488257Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:07.488305Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:07.488321Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T20:06:07.488326Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:07.862140Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:07.862171Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:07.862184Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:07.862189Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T20:06:07.982623Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:06:07.982660Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:06:07.982676Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:06:07.982681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-11-01T20:06:07.432Z] "DELETE /v1/api-keys/2473b16a-ded0-41fb-9648-2138fabae2c4 HTTP/1.1" 200 - via_upstream - "-" 0 365 56 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "b7cf56c6-e052-496a-9c35-1bcd74ddb0dd" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.22:46772 10.133.0.22:443 10.132.0.21:37580 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T20:06:07.854Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 7 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "92594a34-c341-46c8-bf75-fd986d8729c1" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.22:46772 10.133.0.22:443 10.132.0.21:37590 - odh-ai-gateway-infra.maas-api-route.4 [2026-11-01T20:06:07.923Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 59 - "44.212.242.249,10.132.0.21" "curl/7.76.1" "49b7b922-031e-46cd-a10c-cf2d1bc1ebae" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.22:46786 10.133.0.22:443 10.132.0.21:37596 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T20:06:26.405559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:26.405592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:26.405608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:26.405613Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T20:06:26.294Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 110 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "149f904e-ab3e-4cc7-8de4-30f289de809a" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.22:46772 10.133.0.22:443 10.132.0.21:37784 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T20:06:26.538736Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:26.538771Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:26.538785Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:26.538790Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T20:06:26.840025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:06:26.840060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:06:26.840074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T20:06:26.840079Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-01T20:06:26.470Z] "DELETE /v1/api-keys/890c6b29-28d6-494d-944d-4fc33e28079b HTTP/1.1" 200 - via_upstream - "-" 0 321 68 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "7abf975b-0ee5-4fd9-86ba-077456675fae" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.22:46772 10.133.0.22:443 10.132.0.21:37798 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T20:06:26.758Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 81 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "b2e85f38-14fb-4d36-97f4-bf99763bb8ee" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.22:46786 10.133.0.22:443 10.132.0.21:37814 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T20:06:28.078816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:28.078856Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:28.078872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T20:06:28.078876Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:28.228429Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:28.228462Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:28.228475Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:06:28.228480Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T20:06:27.895Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 40 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "d337f870-bdad-44f0-aedd-4c7964661c4b" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.22:443 10.132.0.21:37824 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T20:06:27.994Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 84 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "177af6c2-7f7e-47f3-87a0-37c5e922d872" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.22:46772 10.133.0.22:443 10.132.0.21:37826 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T20:06:28.128Z] "DELETE /v1/api-keys/95dd88ec-214c-428d-ad3d-b1ab10c77e59 HTTP/1.1" 200 - via_upstream - "-" 0 321 99 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "68bf96cf-22e2-4829-996a-1e5598d76f64" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.22:46772 10.133.0.22:443 10.132.0.21:37842 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T20:06:29.884116Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:06:29.884148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:06:29.884165Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T20:06:29.884169Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-01T20:06:29.801Z] "DELETE /v1/api-keys/26918f87-73ae-4a6f-bc79-f247aa4cf308 HTTP/1.1" 200 - via_upstream - "-" 0 321 82 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "f91a4258-0cf2-44d1-bc9a-32165305305e" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.22:46786 10.133.0.22:443 10.132.0.21:39664 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T20:06:38.795Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 113 - "44.212.242.249,10.132.0.21" "-" "03a4c308-7228-49e2-b97a-fd5d24d30632" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.22:42998 10.133.0.22:443 10.132.0.21:39696 - v1-completions-path 2026-11-01T20:06:48.096679Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:06:54.639791Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:07:09.254443Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:07:09.254478Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:07:09.254493Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T20:07:09.254497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T20:07:09.193Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 61 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "6f5f54f2-ca4d-490a-9d6d-b068cbd11377" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.22:46772 10.133.0.22:443 10.132.0.21:46956 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T20:07:09.466Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 74 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "d6a96bf8-737f-4659-a972-79f4ec70185c" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.22:42998 10.133.0.22:443 10.132.0.21:56594 - v1-completions-path 2026-11-01T20:07:10.962612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:07:10.962649Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:07:10.962665Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T20:07:10.962670Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-01T20:07:10.902Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 59 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "d2134e16-10d9-406d-ba8e-5ceb1090569f" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.22:46786 10.133.0.22:443 10.132.0.21:56602 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T20:09:42.419536Z info ads ADS: new connection for node:3 2026-11-01T20:09:42.425028Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-11-01T20:09:42.425090Z info cache read certificate from file resource=file-root:system 2026-11-01T20:11:52.462599Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:14:35.891368Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:14:53.438688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:11.301066Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:27.052567Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:30.732466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:15:30.732503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:15:30.732518Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:15:30.732523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T20:15:30.495Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 66 309 236 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "1577561e-89b0-43f7-950f-af8e15bfc9b7" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.22:49780 10.133.0.22:443 10.132.0.21:50774 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-01T20:15:36.786Z] "POST /llm/e2e-dft-75f85b/anything/e2e-dft-75f85b-37e4d3 HTTP/1.1" 401 - - "-" 109 88 39 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "a3f9fe13-40d1-4c66-95c6-05044581502c" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "-" outbound|443||provider-selection-required-e2e-dft-75f85b.llm.svc.cluster.local - 10.133.0.22:443 10.132.0.21:50778 - llm.external-model-e2e-dft-75f85b-80959e40cd35.2 2026-11-01T20:15:48.435453Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:50.837448Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:51.402219Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:52.602439Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:53.701457Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:55.839189Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:56.471320Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:15:59.514022Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:16:13.361689Z info ads ADS: new connection for node:4 2026-11-01T20:16:13.361930Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T20:16:13.362002Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T20:17:48.964236Z info ads ADS: "" 4 terminated with stream closed 2026-11-01T20:18:09.923073Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:18:19.821974Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:18:39.618955Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:18:54.443916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:19:17.544869Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:19:39.560753Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T20:19:40.411Z] "POST /anything/e2e-rt-eq-1dfd6c-client HTTP/1.1" 200 - via_upstream - "-" 124 1510 117 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "2f3671ff-9221-46f5-bdea-7f89d3a653a1" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.22:58488 10.133.0.22:443 10.132.0.21:37688 - llm.external-model-e2e-rt-eq-1dfd6c-6b43b9fb9051.2 2026-11-01T20:19:50.190826Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:19:50.190860Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:19:50.190872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T20:19:50.190876Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:19:50.191040Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T20:19:50.077Z] "POST /anything/e2e-rt-eq-1dfd6c-client HTTP/1.1" 200 - via_upstream - "-" 124 1756 113 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "4ddbdd1f-0043-4d0d-8b01-e1ad6d7c9f95" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.22:58488 10.133.0.22:443 10.132.0.21:43330 - llm.external-model-e2e-rt-eq-1dfd6c-6b43b9fb9051.2 2026-11-01T20:20:14.259307Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:20:27.457462Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:21:38.466855Z info ads ADS: "" 3 terminated with stream closed 2026-11-01T20:21:51.752785Z info ads ADS: new connection for node:5 2026-11-01T20:21:51.765453Z info cache read certificate from file resource=file-root:system 2026-11-01T20:23:15.669057Z info ads ADS: "" 5 terminated 2026-11-01T20:25:37.306025Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:25:41.316470Z info ads ADS: new connection for node:6 2026-11-01T20:25:41.321236Z info cache read certificate from file resource=file-root:system 2026-11-01T20:26:53.245838Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:27:07.014370Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:27:50.972188Z info ads ADS: "" 6 terminated with stream closed 2026-11-01T20:29:03.076068Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:33:05.217063Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-01T20:35:16.165795Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:35:39.261870Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:37:46.341410Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:38:01.582060Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:38:03.926446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:38:12.841882Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:38:17.874866Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:38:20.622378Z warn xdsproxy upstream terminated with unexpected error send error for type url type.googleapis.com/envoy.config.listener.v3.Listener: EOF id=2 2026-11-01T20:38:20.622517Z warn xdsproxy downstream terminated with unexpected error send error for type url type.googleapis.com/envoy.config.cluster.v3.Cluster: rpc error: code = Canceled desc = context canceled id=2 2026-11-01T20:38:20.631221Z warning envoy config external/envoy/source/extensions/config_subscription/grpc/grpc_stream.h:188 DeltaAggregatedResources gRPC config stream to xds-grpc closed: 2, send error for type url type.googleapis.com/envoy.config.listener.v3.Listener: EOF{via_upstream} thread=9 2026-11-01T20:38:20.696018Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-01T20:38:35.124967Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:38:54.919672Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:39:05.100401Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:39:15.483574Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:39:25.596916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:39:35.901667Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:39:46.108543Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:39:56.345059Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:40:06.519020Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:40:16.910865Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:40:26.922846Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:41:52.476920Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:42:08.166699Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:42:09.711085Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:42:13.094213Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-11-01T20:42:13.015Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 78 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "8c12306a-89e8-4657-add3-57973b4ea15e" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.25:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.22:52836 10.133.0.22:443 10.132.0.21:45178 - v1-catch-all-path 2026-11-01T20:42:15.619984Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:42:30.896058Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:42:32.327309Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:42:34.920852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:42:34.920887Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:42:34.920902Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:42:34.920907Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T20:42:34.796Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 124 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "3f88fbda-a595-4af2-bb7b-8f8776de5f63" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.22:34340 10.133.0.22:443 10.132.0.21:59786 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T20:42:46.529805Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:42:57.528263Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:42:59.375280Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:42:59.394590Z info ads ADS: new connection for node:7 2026-11-01T20:42:59.398088Z info cache read certificate from file resource=file-root:system 2026-11-01T20:43:00.342737Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:44:12.058733Z info ads ADS: "" 7 terminated with stream closed 2026-11-01T20:44:12.114580Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:44:12.595461Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:44:15.210089Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:44:16.818849Z info ads ADS: new connection for node:8 2026-11-01T20:44:16.819065Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-11-01T20:44:18.608684Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:44:59.077408Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T20:45:02.108Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 131 336 130 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "4e51cd3e-88fd-4d10-8ca8-891155c4a38b" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.132.1.22:8000" outbound|54321||e2e-prio-pool-4cb35ada-inference-pool-ip-a775089e.llm.svc.cluster.local 10.133.0.22:55842 10.133.0.22:443 10.132.0.21:39064 - v1-model-routing 2026-11-01T20:45:17.618878Z info ads ADS: "" 8 terminated 2026-11-01T20:45:17.699912Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:45:19.303114Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:45:22.303919Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:45:26.617670Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:45:38.392771Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:45:55.229395Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:46:10.831777Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:46:22.522649Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:46:26.260124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:46:36.985441Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:46:39.470311Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T20:46:42.968Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 58 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "ba7bf970-8d44-4ec6-b8a4-69ac849bd29b" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.22:443 10.132.0.21:49262 - v1-completions-path 2026-11-01T20:46:54.710184Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:50:01.451820Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy [2026-11-01T20:50:25.419Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 62 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "a70eb4d8-4579-4a00-a0c0-1ffe97d3d80f" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.22:42998 10.133.0.22:443 10.132.0.21:42250 - v1-completions-path 2026-11-01T20:50:54.440298Z info ads ADS: new connection for node:9 2026-11-01T20:50:54.446912Z info cache read certificate from file resource=file-root:system 2026-11-01T20:50:54.939842Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:50:56.365475Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:51:10.500672Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:51:10.500700Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:51:10.500708Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T20:51:10.500712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:51:10.500855Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T20:51:10.366Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1713 134 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "44e2ce48-9726-40c4-875d-cdf8b42f6a35" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.22:52262 10.133.0.22:443 10.132.0.21:58040 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T20:51:38.868258Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:51:38.868319Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:51:38.868338Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T20:51:38.868344Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:51:38.868524Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-11-01T20:51:38.737Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1710 131 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "9aae31da-a8c7-4ef5-a3c0-090485239364" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.22:36780 10.133.0.22:443 10.132.0.21:52682 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T20:51:41.046814Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:51:41.046853Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:51:41.046868Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:51:41.046874Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T20:51:41.047102Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T20:51:40.944Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1717 102 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "80f327fb-b692-45f4-8dc8-55b509d7e602" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.22:52262 10.133.0.22:443 10.132.0.21:52894 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T20:51:45.360043Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:51:45.360076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:51:45.360089Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T20:51:45.360095Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:51:45.360269Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T20:51:45.263Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1710 96 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "e087bfae-a784-440e-8bcf-1be18efe614d" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.22:52262 10.133.0.22:443 10.132.0.21:52910 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T20:52:13.633612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:52:13.633643Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:52:13.633653Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T20:52:13.633657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:52:13.633799Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-11-01T20:52:13.538Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1713 95 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "78445fe9-013a-44c5-9834-b6abe3fe7dc8" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.22:52262 10.133.0.22:443 10.132.0.21:37748 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-11-01T20:52:28.590979Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:52:28.713092Z info ads ADS: "" 9 terminated with stream closed 2026-11-01T20:52:29.113693Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:52:32.398573Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:52:34.969824Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:52:34.969859Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:52:34.969874Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-01T20:52:34.969878Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-01T20:52:34.847Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 122 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "c49249e2-1a01-48e5-a96b-245aeaf37a15" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.22:39642 10.133.0.22:443 10.132.0.21:46652 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T20:52:48.868454Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:52:52.086355Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:53:00.605079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T20:53:03.716Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 302 93 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "f6af38bd-0b85-4723-81bc-11b7fdded11b" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.22:56988 10.133.0.22:443 10.132.0.21:42280 - v1-completions-path [2026-11-01T20:53:03.864Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 58 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "551ed21d-f57c-4dce-8e2c-3bfe20358ecd" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.22:56988 10.133.0.22:443 10.132.0.21:42284 - v1-completions-path [2026-11-01T20:53:04.082Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 55 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "9d1fd5c8-0fc0-47e2-bdd9-c67201fe2374" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.22:56988 10.133.0.22:443 10.132.0.21:42286 - v1-completions-path [2026-11-01T20:53:05.461Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 60 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "9f505962-c24d-4878-894d-d98a7093af54" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.22:56996 10.133.0.22:443 10.132.0.21:42290 - v1-completions-path [2026-11-01T20:53:05.576Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 57 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "af489e11-9adb-435f-894b-d32682124626" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.22:56996 10.133.0.22:443 10.132.0.21:42296 - v1-completions-path 2026-11-01T20:53:21.911900Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:53:32.141974Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:53:33.659131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T20:53:40.254Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 58 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "5f70393c-d35a-45bb-86ec-07766edef957" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.22:56988 10.133.0.22:443 10.132.0.21:46628 - v1-completions-path 2026-11-01T20:53:52.542047Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:53:54.018057Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:53:56.786957Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:53:56.786991Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:53:56.787006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T20:53:56.787011Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-01T20:53:56.676Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 110 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "920dcd72-2a18-4df2-b8b0-09ba7f97b5ea" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.22:36860 10.133.0.22:443 10.132.0.21:36324 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T20:53:59.316480Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:54:10.218337Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T20:54:22.800Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 68 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "1eb8e200-cf3f-44c7-a228-42158008d2fa" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.132.0.60:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.22:43006 10.133.0.22:443 10.132.0.21:36546 - v1-completions-path 2026-11-01T20:54:23.873014Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:54:25.294366Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:54:30.774436Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:54:49.012685Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:54:51.589297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:55:05.512855Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:55:06.999053Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:55:12.326354Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:55:27.349532Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:55:37.566821Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:55:52.607647Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:55:55.042210Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:58:07.511007Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:58:09.982332Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:58:12.911616Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:58:27.955334Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:58:37.080830Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:58:41.073956Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:58:43.752954Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:58:43.752990Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-11-01T20:58:43.753004Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-11-01T20:58:43.753008Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-11-01T20:58:43.685Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 72 314 67 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "9be6d9e7-062d-4c3b-bae4-01f2123e75e1" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.24:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.22:56482 10.133.0.22:443 10.132.0.21:56602 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T20:58:56.719871Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:59:07.057180Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:59:09.965426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:59:26.524179Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:59:28.502686Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T20:59:31.786381Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-11-01T20:59:39.464Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 86 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "609bfce9-4886-404a-aa06-1a79c5503622" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.22:56988 10.133.0.22:443 10.132.0.21:60046 - v1-completions-path [2026-11-01T20:59:40.139Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 59 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "51994873-5d05-975e-a036-2304950197d7" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.22:56996 10.133.0.22:443 10.132.0.21:60062 - v1-completions-path [2026-11-01T20:59:41.001Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 57 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "4c927f3f-3c67-4e62-a95a-84c99acd2d07" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.26:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.22:56996 10.133.0.22:443 10.132.0.21:60068 - v1-completions-path 2026-11-01T20:59:41.832409Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:59:41.832443Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:59:41.832456Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-01T20:59:41.832461Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-01T20:59:41.770Z] "DELETE /v1/api-keys/060b5484-f52a-43ad-92bc-afc133fb440e HTTP/1.1" 200 - via_upstream - "-" 0 363 62 - "44.212.242.249,10.132.0.21" "python-requests/2.33.0" "2e8e0598-1241-4ca7-831e-7f051f2f035d" "maas.apps.4ec91afccb26205cb961.prod.konflux-ocp-ci.dev" "10.134.0.215:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.22:44382 10.133.0.22:443 10.132.0.21:60074 - odh-ai-gateway-infra.maas-api-route.3 2026-11-01T20:59:53.281495Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T21:00:03.578715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T21:00:05.507470Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T21:00:08.831706Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T21:00:14.593771Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T21:00:33.148335Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-11-01T21:00:43.385951Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9