2026-11-02T20:02:33.530187Z info FLAG: --concurrency="0" 2026-11-02T20:02:33.530215Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-11-02T20:02:33.530219Z info FLAG: --help="false" 2026-11-02T20:02:33.530221Z info FLAG: --log_as_json="false" 2026-11-02T20:02:33.530223Z info FLAG: --log_caller="" 2026-11-02T20:02:33.530225Z info FLAG: --log_output_level="default:info" 2026-11-02T20:02:33.530227Z info FLAG: --log_stacktrace_level="default:none" 2026-11-02T20:02:33.530231Z info FLAG: --log_target="[stdout]" 2026-11-02T20:02:33.530233Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-11-02T20:02:33.530235Z info FLAG: --outlierLogPath="" 2026-11-02T20:02:33.530238Z info FLAG: --profiling="true" 2026-11-02T20:02:33.530239Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-11-02T20:02:33.530241Z info FLAG: --proxyLogLevel="warning" 2026-11-02T20:02:33.530244Z info FLAG: --serviceCluster="istio-proxy" 2026-11-02T20:02:33.530246Z info FLAG: --stsPort="0" 2026-11-02T20:02:33.530248Z info FLAG: --templateFile="" 2026-11-02T20:02:33.530250Z info FLAG: --tokenManagerPlugin="" 2026-11-02T20:02:33.530252Z info FLAG: --vklog="0" 2026-11-02T20:02:33.530255Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-11-02T20:02:33.530471Z info Proxy role ips=[10.133.0.46] type=router id=maas-default-gateway-openshift-default-696f47c6c-g7smq.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-11-02T20:02:33.530520Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-11-02T20:02:33.531619Z info cpu limit detected as 2, setting concurrency 2026-11-02T20:02:33.531832Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-11-02T20:02:33.531843Z info JWT policy is third-party-jwt 2026-11-02T20:02:33.531847Z info using credential fetcher of JWT type in cluster.local trust domain 2026-11-02T20:02:33.533465Z info Starting default Istio SDS Server 2026-11-02T20:02:33.533486Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-11-02T20:02:33.533514Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-11-02T20:02:33.533803Z info Opening status port 15020 2026-11-02T20:02:33.534775Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-11-02T20:02:33.535456Z info sds Starting SDS grpc server 2026-11-02T20:02:33.535471Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-11-02T20:02:33.536224Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-11-02T20:02:33.537135Z info Starting proxy agent 2026-11-02T20:02:33.537168Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-11-02T20:02:33.600519Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-11-02T20:02:33.623936Z info cache generated new workload certificate resourceName=default latency=88.387734ms ttl=23h59m59.376067445s 2026-11-02T20:02:33.623967Z info cache Root cert has changed, start rotating root cert 2026-11-02T20:02:33.624003Z info cache returned workload trust anchor from cache ttl=23h59m59.375997019s 2026-11-02T20:02:33.742535Z info ads ADS: new connection for node:1 2026-11-02T20:02:33.742613Z info cache returned workload certificate from cache ttl=23h59m59.257389669s 2026-11-02T20:02:33.743103Z info ads ADS: new connection for node:2 2026-11-02T20:02:33.743413Z info cache returned workload trust anchor from cache ttl=23h59m59.256588687s 2026-11-02T20:02:33.821952Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:02:41.651504Z info Readiness succeeded in 8.12397097s 2026-11-02T20:02:41.651909Z info Envoy proxy is ready 2026-11-02T20:02:56.862467Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:02:59.947194Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:03:38.938788Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:03:38.938826Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:03:38.938840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T20:03:38.938845Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T20:03:38.761Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 177 - "44.212.242.249,10.132.0.19" "curl/7.76.1" "155ffe0c-5333-4577-bd97-e5fd67a1cfa5" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:39894 10.133.0.46:443 10.132.0.19:36650 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T20:03:39.306006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:03:39.306048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:03:39.306064Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:03:39.306070Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-02T20:03:39.147Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 159 - "44.212.242.249,10.132.0.19" "curl/7.76.1" "1390f984-dd00-4366-9e54-cb95c64b41ef" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:39902 10.133.0.46:443 10.132.0.19:36664 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T20:03:41.292Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 56 - "44.212.242.249,10.132.0.19" "curl/7.76.1" "82ec1440-d0e7-4c68-a680-8ab813a92fc1" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.46:443 10.132.0.19:36668 - v1-model-routing [2026-11-02T20:03:41.540Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 52 - "44.212.242.249,10.132.0.19" "curl/7.76.1" "cb7b0311-49c8-41e6-8e1f-23e5ea8cdc75" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.46:443 10.132.0.19:36678 - v1-model-routing [2026-11-02T20:03:41.787Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 51 - "44.212.242.249,10.132.0.19" "curl/7.76.1" "44c6d7fa-99e3-4560-bd52-a5268c7cddcd" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.46:443 10.132.0.19:36688 - v1-model-routing 2026-11-02T20:08:33.875145Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:08:33.875181Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:08:33.875195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:08:33.875200Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T20:08:33.765Z] "DELETE /v1/api-keys/e4fd50a1-95d7-4ba5-af5d-a99f83bb24b4 HTTP/1.1" 200 - via_upstream - "-" 0 321 109 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "6b7ecf4e-6f8a-4c18-beb4-53b6967757f3" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:58510 10.133.0.46:443 10.132.0.19:50828 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T20:08:34.463018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:08:34.463062Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:08:34.463079Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:08:34.463086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-02T20:08:34.353Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 110 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "cbf9fb5d-39df-4ffc-addc-13205dc054d9" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:58526 10.133.0.46:443 10.132.0.19:50830 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T20:08:35.045700Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:08:35.045740Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:08:35.045759Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:08:35.045765Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-02T20:08:34.857Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 188 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "796062fe-dd5b-4d83-8193-25b2cb7cf350" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:58526 10.133.0.46:443 10.132.0.19:50838 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T20:08:36.796468Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:08:36.796503Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:08:36.796517Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T20:08:36.796521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T20:08:36.694Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 102 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "c21ff6a6-640c-4829-b00a-bf9ce892d415" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:58510 10.133.0.46:443 10.132.0.19:50086 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T20:08:40.304Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 7 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "cc6fbdd5-097b-49c8-8d2e-278f86927c87" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "-" - - 10.133.0.46:443 10.132.0.19:50108 - - 2026-11-02T20:08:43.601168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-11-02T20:08:43.522Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 80 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "f93caef3-1522-4aab-badd-82e89c092f68" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:43166 10.133.0.46:443 10.132.0.19:50114 - v1-completions-path 2026-11-02T20:09:00.652466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:09:00.652599Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:09:00.652651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:09:00.652679Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T20:09:00.530Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 121 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "8559f735-c5f9-462c-b679-07dad3d74fbd" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:58510 10.133.0.46:443 10.132.0.19:45424 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T20:09:08.836Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 66 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "7aa13a04-7fc1-4645-b7b4-de6355852580" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:43166 10.133.0.46:443 10.132.0.19:48260 - v1-completions-path 2026-11-02T20:14:47.538392Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:14:47.538429Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:14:47.538455Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:14:47.538460Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-02T20:14:47.845022Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:14:47.845058Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:14:47.845080Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-02T20:14:47.845085Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-02T20:14:47.187Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 88 26 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "5895d6ad-906c-417a-a5b5-efa0b6f12125" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.46:443 10.132.0.19:41084 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T20:14:47.411Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 127 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "b8f02421-2863-4d1f-a8cb-3e795dd8d037" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:35878 10.133.0.46:443 10.132.0.19:41098 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T20:14:47.727Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 118 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "27dadf72-a8dc-43da-a865-e83178004f5c" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:35878 10.133.0.46:443 10.132.0.19:41112 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T20:14:48.122090Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-11-02T20:14:48.128926Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:14:48.128958Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:14:48.128972Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:14:48.128976Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-02T20:14:48.129142Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 2026-11-02T20:14:48.129195Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-02T20:14:48.129203Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-02T20:14:48.129205Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-11-02T20:14:48.129209Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 [2026-11-02T20:14:48.051Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 77 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "0de87161-a507-4659-8766-d4439c5e2b2e" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:50174 10.133.0.46:443 10.132.0.19:41114 - v1-completions-path 2026-11-02T20:14:50.964292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:14:50.964327Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:14:50.964341Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T20:14:50.964346Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T20:14:50.930Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 91 33 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "dff773eb-758f-46ec-ac6f-711ffd2799c6" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:35886 10.133.0.46:443 10.132.0.19:41118 - odh-ai-gateway-infra.maas-api-route.4 [2026-11-02T20:14:51.178Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 7 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "85472b7c-6133-4307-a1b0-4e58d20a1bf3" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "-" - - 10.133.0.46:443 10.132.0.19:41122 - - 2026-11-02T20:15:05.096879Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:15:05.096917Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:15:05.096934Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-02T20:15:05.096939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-11-02T20:15:04.942Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 154 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "f2ec8e3a-521f-4a62-9303-d7fe1726f664" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:35878 10.133.0.46:443 10.132.0.19:41630 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T20:15:18.542513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:15:18.542562Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:15:18.542590Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:15:18.542598Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T20:15:18.543018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:15:18.543051Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:15:18.543073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T20:15:18.543085Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:15:18.973195Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:15:18.973228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:15:18.973243Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-11-02T20:15:18.973248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:15:19.017158Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:15:19.017193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:15:19.017208Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T20:15:19.017213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T20:15:18.356Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 186 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "871b6fc9-8ac2-4916-a04b-0b84fd451675" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:35886 10.133.0.46:443 10.132.0.19:35396 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T20:15:18.261Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 281 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "5df4e5d2-d612-4c9a-b0a1-40e4ba073a88" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:35886 10.133.0.46:443 10.132.0.19:35400 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T20:15:18.765Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 207 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "d72d5bbe-4d4f-494f-82b3-9376c2179f1c" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:35878 10.133.0.46:443 10.132.0.19:35404 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T20:15:18.865Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 151 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "adac2360-6911-4686-bc78-f4f1d73c82ee" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:35886 10.133.0.46:443 10.132.0.19:35414 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T20:15:19.231Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 135 4616 99 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "b8be8df6-2763-4881-96e3-0e89b827e988" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:50174 10.133.0.46:443 10.132.0.19:35432 - v1-chat-completions-path [2026-11-02T20:15:19.230Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 136 358 155 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "1e4e104b-6933-425f-a428-f81ae2e99931" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:43166 10.133.0.46:443 10.132.0.19:35418 - v1-chat-completions-path 2026-11-02T20:15:46.705931Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:16:15.976234Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:17:37.820391Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:19:13.817475Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:22:08.148761Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:22:51.933596Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:24:08.087226Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:35:11.053148Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-11-02T20:38:51.954712Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-11-02T20:44:18.439176Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:44:18.439213Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:44:18.439228Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T20:44:18.439233Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T20:44:18.269Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 169 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "0f27c0c4-92fc-4112-b746-fe63ccd720c0" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:51898 10.133.0.46:443 10.132.0.19:44650 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T20:44:23.691205Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:44:23.691244Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:44:23.691260Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:44:23.691265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-02T20:44:23.586Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 104 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "266ad785-9004-45fc-8634-5f2a92720d06" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:57570 10.133.0.46:443 10.132.0.19:44654 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T20:44:27.448365Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:44:49.913314Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:45:00.285292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:45:00.285325Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:45:00.285337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-11-02T20:45:00.285342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-11-02T20:45:00.175Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 109 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "0a0976c1-c685-416b-80d4-a2da38744cc1" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:57570 10.133.0.46:443 10.132.0.19:32804 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T20:45:46.709951Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:45:52.735543Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:45:52.735579Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:45:52.735594Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:45:52.735598Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T20:45:52.621Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 330 113 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "e435a1a1-1f04-9fbc-b625-d8908f4cd235" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:48726 10.133.0.46:443 10.132.0.19:57120 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T20:45:53.337Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 76 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "2df04890-c06d-44bb-b26e-8a982d3038b7" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:50132 10.133.0.46:443 10.132.0.19:57122 - v1-completions-path [2026-11-02T20:45:53.766Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 60 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "199467ab-e356-4450-b723-6cf0be1106ae" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:50142 10.133.0.46:443 10.132.0.19:57142 - v1-completions-path 2026-11-02T20:46:08.545710Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:46:13.177857Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T20:46:27.461Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 297 64 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "4aec52ef-908d-4e41-bd81-1644d5c16938" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:50132 10.133.0.46:443 10.132.0.19:38790 - v1-completions-path 2026-11-02T20:46:41.940411Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:46:58.640801Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:47:05.183220Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:47:05.183256Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:47:05.183293Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-11-02T20:47:05.183298Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-11-02T20:47:05.018Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 324 165 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "d16f287f-f775-404c-9a58-ccbedd700efa" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:36892 10.133.0.46:443 10.132.0.19:55214 - odh-ai-gateway-infra.maas-api-route.3 [2026-11-02T20:47:06.501Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 85 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "5a57414a-3d1b-4a9b-9d58-ab8c2174923d" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:50142 10.133.0.46:443 10.132.0.19:42562 - v1-completions-path [2026-11-02T20:47:07.814Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 62 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "99cbeff0-d5e9-42b4-991f-fa62b5a5d85e" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:50142 10.133.0.46:443 10.132.0.19:42576 - v1-completions-path [2026-11-02T20:47:09.431Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 76 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "2e070fa7-4517-4a8b-a964-5f2558de4ef8" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:50132 10.133.0.46:443 10.132.0.19:42578 - v1-completions-path [2026-11-02T20:47:10.767Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "de71b19b-9b61-4f95-81f0-535446e3e38f" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:50132 10.133.0.46:443 10.132.0.19:42586 - v1-completions-path 2026-11-02T20:47:39.233308Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:47:50.194426Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:47:55.309983Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:48:24.753994Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:48:29.410664Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:48:52.598488Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T20:48:53.776Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 64 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "868b3825-d365-4dfc-b087-82ee5a4c647e" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.133.0.45:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:43166 10.133.0.46:443 10.132.0.19:47582 - v1-completions-path 2026-11-02T20:48:59.114787Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:49:28.147637Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:49:49.872404Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:50:12.838177Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:50:19.132758Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:50:44.921622Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:50:50.743822Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:51:21.715267Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-11-02T20:51:39.042Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 299 58 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "84c4a1c0-aed7-4cec-ba43-ba3583fe76e7" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.132.0.45:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:50142 10.133.0.46:443 10.132.0.19:56488 - v1-completions-path 2026-11-02T20:51:53.061820Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:52:03.752054Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:52:32.305813Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:52:38.322402Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:54:53.189939Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:54:53.189980Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:54:53.189995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-11-02T20:54:53.190000Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-11-02T20:54:53.068Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 121 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "94e6f4c3-5ac9-4b2b-a2d1-ed19e6824051" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.134.0.27:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.46:52234 10.133.0.46:443 10.132.0.19:44476 - odh-ai-gateway-infra.maas-api-route.3 2026-11-02T20:55:08.670250Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:55:14.726757Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:56:31.315512Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T20:56:31.315538Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T20:56:31.315541Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=25 2026-11-02T20:56:31.315544Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=25 [2026-11-02T20:56:31.270Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 45 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "f23fe237-b5e6-47cc-9937-24e6712c047c" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.46:443 10.132.0.19:33286 - v1-completions-path 2026-11-02T20:56:52.288158Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:57:09.375093Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:57:13.808175Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:57:38.200528Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T20:59:51.495184Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:00:35.218094Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:01:00.652232Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:01:15.898578Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:01:24.183339Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:01:30.723879Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:01:41.810390Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:02:08.860052Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:06:10.955322Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:06:17.963593Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=26 [2026-11-02T21:06:17.884Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 78 - "44.212.242.249,10.132.0.19" "python-requests/2.34.2" "af05e8ee-7add-4d2f-8ed3-5c877596f583" "maas.apps.7293b24ee1db6ad9a1ba.prod.konflux-ocp-ci.dev" "10.132.0.44:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.46:59220 10.133.0.46:443 10.132.0.19:32820 - v1-catch-all-model-routing 2026-11-02T21:06:21.873116Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:06:42.922051Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:06:47.244502Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:07:03.477303Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-11-02T21:07:14.982182Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8