2026-10-30T05:50:37.667971Z info FLAG: --concurrency="0" 2026-10-30T05:50:37.667990Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T05:50:37.667995Z info FLAG: --help="false" 2026-10-30T05:50:37.667997Z info FLAG: --log_as_json="false" 2026-10-30T05:50:37.667999Z info FLAG: --log_caller="" 2026-10-30T05:50:37.668001Z info FLAG: --log_output_level="default:info" 2026-10-30T05:50:37.668003Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T05:50:37.668007Z info FLAG: --log_target="[stdout]" 2026-10-30T05:50:37.668010Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T05:50:37.668012Z info FLAG: --outlierLogPath="" 2026-10-30T05:50:37.668014Z info FLAG: --profiling="true" 2026-10-30T05:50:37.668016Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T05:50:37.668018Z info FLAG: --proxyLogLevel="warning" 2026-10-30T05:50:37.668020Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T05:50:37.668021Z info FLAG: --stsPort="0" 2026-10-30T05:50:37.668023Z info FLAG: --templateFile="" 2026-10-30T05:50:37.668026Z info FLAG: --tokenManagerPlugin="" 2026-10-30T05:50:37.668028Z info FLAG: --vklog="0" 2026-10-30T05:50:37.668031Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T05:50:37.668162Z info Proxy role ips=[10.134.0.117] type=router id=maas-default-gateway-openshift-default-59f957fdd7-pklhl.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T05:50:37.668212Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T05:50:37.669253Z info cpu limit detected as 2, setting concurrency 2026-10-30T05:50:37.669854Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T05:50:37.669866Z info JWT policy is third-party-jwt 2026-10-30T05:50:37.669868Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T05:50:37.671311Z info Starting default Istio SDS Server 2026-10-30T05:50:37.671335Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T05:50:37.671351Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T05:50:37.671765Z info Opening status port 15020 2026-10-30T05:50:37.672568Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T05:50:37.673861Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T05:50:37.674712Z info Starting proxy agent 2026-10-30T05:50:37.674742Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T05:50:37.684240Z info sds Starting SDS grpc server 2026-10-30T05:50:37.684266Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T05:50:37.767739Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T05:50:37.786980Z info cache generated new workload certificate resourceName=default latency=114.571685ms ttl=23h59m59.213022635s 2026-10-30T05:50:37.787013Z info cache Root cert has changed, start rotating root cert 2026-10-30T05:50:37.787053Z info cache returned workload trust anchor from cache ttl=23h59m59.212948062s 2026-10-30T05:50:38.180362Z info ads ADS: new connection for node:1 2026-10-30T05:50:38.180535Z info cache returned workload certificate from cache ttl=23h59m58.81946813s 2026-10-30T05:50:38.184670Z info ads ADS: new connection for node:2 2026-10-30T05:50:38.187821Z info cache returned workload trust anchor from cache ttl=23h59m58.812183045s 2026-10-30T05:50:38.405161Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T05:50:40.578481Z error failed scraping envoy metrics: error scraping http://localhost:15090/stats/prometheus: Get "http://localhost:15090/stats/prometheus": dial tcp [::1]:15090: connect: connection refused 2026-10-30T05:50:47.590466Z info Readiness succeeded in 9.924814709s 2026-10-30T05:50:47.590892Z info Envoy proxy is ready 2026-10-30T05:51:35.363386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:51:35.363424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:51:35.363438Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:51:35.363443Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T05:51:35.269Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 94 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "0c02144d-0dee-4faa-8e5f-105b4bfa5ad7" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.117:36416 10.134.0.117:443 10.132.0.20:43262 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T05:51:35.737913Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T05:51:35.737950Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T05:51:35.737965Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T05:51:35.737970Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-30T05:51:35.654Z] "DELETE /v1/api-keys/3888ad26-750a-4736-aaff-c87f5cb096b4 HTTP/1.1" 200 - via_upstream - "-" 0 321 83 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "8ac56fe7-ec7e-4917-bb07-2345f296eab9" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.117:36424 10.134.0.117:443 10.132.0.20:43276 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T05:51:36.094481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T05:51:36.094552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T05:51:36.094574Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T05:51:36.094581Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-10-30T05:51:35.946Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 147 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "344d4bf1-2cef-4cc3-8c17-616faed0d45f" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.117:36424 10.134.0.117:443 10.132.0.20:43292 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T05:51:36.222Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 213 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "3c9983bf-a12c-475c-8207-485917a5f329" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.117:443 10.132.0.20:43296 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T05:51:37.923569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T05:51:37.923609Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T05:51:37.923628Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T05:51:37.923635Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T05:51:38.005334Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T05:51:38.005420Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T05:51:38.005443Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T05:51:38.005468Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 2026-10-30T05:51:38.138937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:51:38.138969Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:51:38.138983Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:51:38.138988Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T05:51:37.836Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 87 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "cd228837-33cf-47ae-87c4-3c4586ad5f32" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.117:36424 10.134.0.117:443 10.132.0.20:43322 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T05:51:37.944Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 77 61 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7f11aa82-e9a6-4752-90fc-19eec99d6651" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.117:443 10.132.0.20:43334 - v1-completions-path [2026-10-30T05:51:38.031Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 107 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "a71d6285-ab2b-48b6-b4fe-c2a28233a7e9" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.117:36416 10.134.0.117:443 10.132.0.20:43348 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T05:51:43.158Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 33 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "01fc2fb6-c69b-45f2-aa53-ea74c1731149" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.117:443 10.132.0.20:43360 - v1-completions-path 2026-10-30T05:52:02.286086Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:52:02.286125Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:52:02.286142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:52:02.286147Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T05:52:02.183Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 103 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "5ad94849-e2ff-477e-b5bf-7fd514b5193e" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.117:36416 10.134.0.117:443 10.132.0.20:53132 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T05:53:58.085039Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T05:54:14.456365Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T05:54:37.397067Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:54:37.397104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:54:37.397118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T05:54:37.397124Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T05:54:37.317Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 79 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "f9e1c4e9-854b-43e4-bb52-c1d02b1460cb" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.117:38192 10.134.0.117:443 10.132.0.20:51344 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T05:54:37.518Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 47 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "84643a3d-9b91-408b-b8ee-95a11bcc6c53" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.117:443 10.132.0.20:51348 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T05:54:39.582925Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T05:54:39.582968Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T05:54:39.582986Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T05:54:39.582992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T05:54:39.583199Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 2026-10-30T05:54:39.583268Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T05:54:39.583280Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T05:54:39.583283Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T05:54:39.583288Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 [2026-10-30T05:54:39.272Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 120 126 310 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "a3283b3e-cb9b-407b-930d-4c58b5ddb951" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.117:40080 10.134.0.117:443 10.132.0.20:51354 - v1-chat-completions-path 2026-10-30T05:55:50.750995Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T05:59:19.739Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 136 341 205 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "2325e188-ed76-4a53-959a-4818475d39a0" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.117:45912 10.134.0.117:443 10.132.0.20:35236 - v1-chat-completions-path 2026-10-30T06:10:20.101420Z info ads ADS: new connection for node:3 2026-10-30T06:10:20.148596Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T06:10:20.151743Z info cache read certificate from file resource=file-root:system 2026-10-30T06:12:21.197116Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:12:43.955909Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:13:05.231340Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:13:33.266485Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:14:09.528814Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:14:24.364128Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:15:08.015355Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:15:23.024101Z info ads ADS: new connection for node:4 2026-10-30T06:15:23.024404Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T06:15:23.024473Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T06:17:20.899590Z info ads ADS: "" 4 terminated with stream closed 2026-10-30T06:17:44.542729Z info ads ADS: "" 3 terminated 2026-10-30T06:21:03.919053Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T06:26:02.772360Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:26:41.203815Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:27:55.028060Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:35:18.371015Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:35:41.694987Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:36:13.026285Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:36:17.183152Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T06:36:16.858Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 5518 5791 77 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "84a27eb7-13ad-4b60-802f-6714f704ee68" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.134.0.117:58058 10.134.0.117:443 10.132.0.20:47642 - v1-chat-completions-path [2026-10-30T06:36:17.124Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 144 409 59 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "07a6f709-4f34-4710-afe3-b5fdd47dbeaa" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.134.0.117:58058 10.134.0.117:443 10.132.0.20:47646 - v1-chat-completions-path [2026-10-30T06:36:17.209Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 140 405 54 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "a49f1543-5177-4e29-bff3-d54d6185587d" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||echo-simulator-kserve-workload-svc.llm.svc.cluster.local 10.134.0.117:58058 10.134.0.117:443 10.132.0.20:47652 - v1-chat-completions-path 2026-10-30T06:36:29.216485Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:36:31.790629Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:36:42.559789Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:36:47.829462Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:36:47.829499Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:36:47.829513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:36:47.829537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T06:36:47.747Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 82 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "9bcdd638-597b-4321-beb9-034ac7bfd9e5" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.117:44704 10.134.0.117:443 10.132.0.20:35292 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T06:37:00.504398Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:37:02.957216Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:37:05.728559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:37:05.728597Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:37:05.728614Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T06:37:05.728619Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T06:37:05.647Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 81 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "16d11517-a6eb-4694-a49e-93a646639662" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.117:44704 10.134.0.117:443 10.132.0.20:33882 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T06:37:17.838291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:37:28.815045Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:37:31.384142Z info ads ADS: new connection for node:5 2026-10-30T06:37:31.384315Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T06:37:35.339834Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:38:13.211097Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:38:32.333393Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:38:32.463346Z info ads ADS: "" 5 terminated 2026-10-30T06:38:35.773663Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:38:43.755038Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:39:23.292418Z info cache event for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt : REMOVE, pushing to proxy 2026-10-30T06:40:01.142302Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:40:01.142340Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:40:01.142355Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:40:01.142360Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T06:40:01.089Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 52 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "d4df1445-ad02-4f18-8320-3ce9e46baf54" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.117:54880 10.134.0.117:443 10.132.0.20:58834 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T06:40:05.641685Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:40:23.709740Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:40:38.619242Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:40:50.662209Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:40:54.725335Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:41:06.467667Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:41:10.314965Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T06:41:17.890Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 72 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "7262d896-3bac-462d-9037-e72b12ed59b4" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.117:44920 10.134.0.117:443 10.132.0.20:46006 - v1-completions-path 2026-10-30T06:41:30.199575Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:42:17.068019Z info ads ADS: new connection for node:6 2026-10-30T06:42:17.074931Z info cache read certificate from file resource=file-root:system 2026-10-30T06:42:18.053830Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:42:19.792584Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:43:18.139391Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T06:43:18.139422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T06:43:18.139431Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T06:43:18.139435Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T06:43:18.139609Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-10-30T06:43:18.028Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1732 110 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "82f731fd-99e7-4e1a-b7d8-1ca77d6d57ba" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.117:60060 10.134.0.117:443 10.132.0.20:39424 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T06:43:48.389439Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:43:48.523124Z info ads ADS: "" 6 terminated with stream closed 2026-10-30T06:43:50.114889Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:43:57.043217Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:44:14.062853Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:44:18.948868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:44:39.049886Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:44:53.088668Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:44:59.247209Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-10-30T06:44:59.241Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 58 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "957b3cf9-4356-4049-a45b-0fd61906d929" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.117:44920 10.134.0.117:443 10.132.0.20:44598 - v1-completions-path [2026-10-30T06:44:59.823Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 57 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "4ef2ba67-43c9-4705-a5c5-9a162ab239ce" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.117:33984 10.134.0.117:443 10.132.0.20:44608 - v1-completions-path [2026-10-30T06:45:00.299Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 56 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "bb158415-2e69-471e-853c-77bb598e8308" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.117:33984 10.134.0.117:443 10.132.0.20:44614 - v1-completions-path [2026-10-30T06:45:00.374Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 57 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "70db967e-6d21-4f2f-b816-f84ab8918765" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.117:44920 10.134.0.117:443 10.132.0.20:44630 - v1-completions-path 2026-10-30T06:45:16.422897Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:45:26.816445Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:45:31.654688Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T06:45:35.467Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 58 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "cd2cd399-7f87-4497-bc9d-db66e51b2191" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.117:44920 10.134.0.117:443 10.132.0.20:59704 - v1-completions-path 2026-10-30T06:45:48.127208Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:45:50.540140Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:46:09.715535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:46:14.655017Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:46:30.588387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:46:46.613219Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:46:58.147692Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:47:01.610183Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:47:22.577674Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:47:25.574551Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:47:37.565013Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:47:55.536535Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:48:05.782810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:48:25.966231Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:48:29.361020Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:49:46.739095Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T06:49:46.739139Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 2026-10-30T06:49:46.739161Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-10-30T06:49:46.739167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=26 [2026-10-30T06:49:46.665Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 73 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "3dd98fb3-8197-4fba-99a1-9fc069fa611a" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.117:45526 10.134.0.117:443 10.132.0.20:38048 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T06:49:59.667452Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:50:03.375879Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:50:57.928764Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-30T06:51:13.940407Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:51:13.940444Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:51:13.940461Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T06:51:13.940466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:51:14.012717Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T06:51:14.012744Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T06:51:14.012748Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=26 2026-10-30T06:51:14.012754Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=26 [2026-10-30T06:51:13.850Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 89 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "c288a121-1799-446f-92fa-3b48dc4ebc47" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.132.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.117:34016 10.134.0.117:443 10.132.0.20:53204 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T06:51:13.966Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 113 46 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "8118cf66-9294-4805-9f6f-be6e4f57da64" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.117:443 10.132.0.20:53212 - v1-completions-path 2026-10-30T06:51:33.184806Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:51:47.896505Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:51:50.324413Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:52:09.223591Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:52:21.355563Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:52:24.422567Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:52:40.051701Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:52:50.775759Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:52:55.490486Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T06:53:00.142Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 68 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "6d6e2b27-9d41-4dda-a7ab-58980cbad04f" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.117:44920 10.134.0.117:443 10.132.0.20:35558 - v1-completions-path [2026-10-30T06:53:00.743Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 58 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "a5efdb7c-4a00-4410-a704-a13e2b6cdce9" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.117:443 10.132.0.20:35568 - v1-completions-path 2026-10-30T06:53:12.986505Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:53:17.773703Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:53:21.398568Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T06:53:30.080Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 65 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "86643957-098e-4a51-b97c-80b8481ee90a" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.117:44920 10.134.0.117:443 10.132.0.20:45236 - v1-completions-path [2026-10-30T06:53:30.266Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 64 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "ae947469-1c1f-4849-aa52-a199696054d9" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.134.0.34:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.117:44920 10.134.0.117:443 10.132.0.20:45248 - v1-completions-path 2026-10-30T06:53:31.714513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:53:31.714568Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:53:31.714586Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T06:53:31.714591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T06:53:31.637Z] "DELETE /v1/api-keys/02d0dea6-3845-4366-904e-0a350a0d60db HTTP/1.1" 200 - via_upstream - "-" 0 363 76 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "c2b8fb9d-b46e-468b-a330-db1a5adff338" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.133.0.255:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.117:41358 10.134.0.117:443 10.132.0.20:45258 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T06:53:43.872296Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:53:54.147289Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:53:58.870547Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:54:02.534050Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:54:07.298944Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:54:25.703317Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:54:36.008253Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:54:38.376480Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:54:48.266776Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:54:52.708383Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:55:08.644882Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:55:11.168430Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:55:29.469001Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:55:39.669598Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:55:50.141239Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:56:00.364008Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:56:10.720786Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:56:20.990795Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:56:31.407705Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:56:41.723486Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:56:52.070281Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 2026-10-30T06:57:02.539071Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=7 [2026-10-30T06:57:05.318Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 79 - "52.71.36.72,10.132.0.20" "python-requests/2.34.2" "1e00aa79-4521-412c-952d-6a441ac3ac06" "maas.apps.32c8459a3857cfd60680.prod.konflux-ocp-ci.dev" "10.133.0.42:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.117:42486 10.134.0.117:443 10.132.0.20:37506 - v1-completions-path