2026-10-30T07:47:36.874421Z info FLAG: --concurrency="0" 2026-10-30T07:47:36.874440Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T07:47:36.874444Z info FLAG: --help="false" 2026-10-30T07:47:36.874447Z info FLAG: --log_as_json="false" 2026-10-30T07:47:36.874449Z info FLAG: --log_caller="" 2026-10-30T07:47:36.874451Z info FLAG: --log_output_level="default:info" 2026-10-30T07:47:36.874453Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T07:47:36.874458Z info FLAG: --log_target="[stdout]" 2026-10-30T07:47:36.874460Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T07:47:36.874462Z info FLAG: --outlierLogPath="" 2026-10-30T07:47:36.874465Z info FLAG: --profiling="true" 2026-10-30T07:47:36.874467Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T07:47:36.874470Z info FLAG: --proxyLogLevel="warning" 2026-10-30T07:47:36.874471Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T07:47:36.874474Z info FLAG: --stsPort="0" 2026-10-30T07:47:36.874476Z info FLAG: --templateFile="" 2026-10-30T07:47:36.874478Z info FLAG: --tokenManagerPlugin="" 2026-10-30T07:47:36.874481Z info FLAG: --vklog="0" 2026-10-30T07:47:36.874483Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T07:47:36.874635Z info Proxy role ips=[10.132.1.145] type=router id=maas-default-gateway-openshift-default-59f957fdd7-c9cfw.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T07:47:36.874685Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T07:47:36.876048Z info cpu limit detected as 2, setting concurrency 2026-10-30T07:47:36.876242Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T07:47:36.876253Z info JWT policy is third-party-jwt 2026-10-30T07:47:36.876256Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T07:47:36.877905Z info Starting default Istio SDS Server 2026-10-30T07:47:36.877926Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T07:47:36.877944Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T07:47:36.878128Z info Opening status port 15020 2026-10-30T07:47:36.879047Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T07:47:36.879679Z info sds Starting SDS grpc server 2026-10-30T07:47:36.879717Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T07:47:36.880500Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T07:47:36.881325Z info Starting proxy agent 2026-10-30T07:47:36.881357Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T07:47:36.944748Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T07:47:37.025845Z info cache generated new workload certificate resourceName=default latency=145.971412ms ttl=23h59m59.974159306s 2026-10-30T07:47:37.025888Z info cache Root cert has changed, start rotating root cert 2026-10-30T07:47:37.025928Z info cache returned workload trust anchor from cache ttl=23h59m59.974072402s 2026-10-30T07:47:37.055147Z info ads ADS: new connection for node:1 2026-10-30T07:47:37.055292Z info cache returned workload certificate from cache ttl=23h59m59.944710427s 2026-10-30T07:47:37.056640Z info ads ADS: new connection for node:2 2026-10-30T07:47:37.056936Z info cache returned workload trust anchor from cache ttl=23h59m59.943065992s 2026-10-30T07:47:37.138246Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:47:44.954255Z info Readiness succeeded in 8.082188599s 2026-10-30T07:47:44.954598Z info Envoy proxy is ready 2026-10-30T07:47:52.645005Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:48:08.874603Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:48:11.371181Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:48:16.668123Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=25 [2026-10-30T07:48:16.575Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 91 3616 92 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "64ea24ee-f672-457d-9bb0-b049778e66e7" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.145:59718 10.132.1.145:443 10.132.0.10:52152 - v1-catch-all-model-routing 2026-10-30T07:48:19.027445Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:48:25.151Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 56 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "956e2b12-ca3e-4e18-86e5-b2c4848cef4f" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.145:443 10.132.0.10:35730 - v1-catch-all-path 2026-10-30T07:48:37.050273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:48:39.299834Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:48:42.037123Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'completion_tokens' missing from lines 1-1 key: completion_tokens thread=24 [2026-10-30T07:48:41.949Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 87 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "98b36211-05c3-4d79-9608-bb33974887e3" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.40:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.145:46738 10.132.1.145:443 10.132.0.10:42876 - v1-catch-all-path 2026-10-30T07:48:53.898719Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:49:05.108832Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:49:06.954711Z info ads ADS: new connection for node:3 2026-10-30T07:49:06.954982Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T07:49:06.955053Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-10-30T07:49:08.822202Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:49:49.529163Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:49:52.377739Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:49:52.377781Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:49:52.377802Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T07:49:52.377809Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T07:49:50.399Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 1978 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "41fa3c6d-9351-45aa-9089-3f015eff355f" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.145:43906 10.132.1.145:443 10.132.0.10:60262 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:50:08.378816Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:50:08.477613Z info ads ADS: "" 3 terminated with stream closed 2026-10-30T07:50:10.743975Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:50:12.359498Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:50:12.359626Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:50:12.359681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T07:50:12.359714Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T07:50:10.741Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 90 333 1618 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "cd55633e-b5c9-496e-90af-a8a73245f8f3" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.145:45446 10.132.1.145:443 10.132.0.10:38204 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:50:13.439226Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:50:18.364407Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:51:53.699497Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:52:10.701984Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:52:26.310714Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:52:38.200155Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:52:44.521244Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:52:56.378106Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:53:00.963234Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:53:06.696606Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:53:06.696641Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:53:06.696657Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T07:53:06.696662Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T07:53:06.641Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 524 55 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "b292e2be-11bd-4b9d-bf36-aea8882d5ca0" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.145:53744 10.132.1.145:443 10.132.0.10:32916 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:53:19.084345Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:53:36.086Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 75 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "e7719ecf-368c-460b-92a1-adfb85836b5c" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.145:55418 10.132.1.145:443 10.132.0.10:38090 - v1-completions-path 2026-10-30T07:53:49.788615Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T07:53:49.722Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 66 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "d4ce7b1a-1948-43e3-9722-80ec9de4e7e2" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.1.145:39178 10.132.1.145:443 10.132.0.10:51978 - v1-completions-path 2026-10-30T07:54:05.446389Z info ads ADS: new connection for node:4 2026-10-30T07:54:05.450478Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-10-30T07:54:05.450586Z info cache read certificate from file resource=file-root:system 2026-10-30T07:54:06.640867Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:54:07.814521Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:54:27.514032Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:54:27.514059Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:54:27.514069Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:54:27.514073Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T07:54:27.514213Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T07:54:27.399Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1731 114 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "9b8b9a3a-7ba1-4997-8609-fc4cc566b5ba" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.145:54022 10.132.1.145:443 10.132.0.10:36766 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:54:38.170908Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:54:38.170946Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:54:38.170986Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:54:38.170993Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T07:54:38.171150Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-10-30T07:54:38.075Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1725 95 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "6c0bc9a7-735e-4558-8ddc-3a6e1a2c237d" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.145:54022 10.132.1.145:443 10.132.0.10:58152 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:55:29.304060Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-10-30T07:55:29.304543Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:55:29.304567Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:55:29.304578Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T07:55:29.304584Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:55:29.304724Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-10-30T07:55:29.193Z] "POST /anything/v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 92 1731 111 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "1179be5f-a830-4810-8973-02253ca3fc76" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.1.145:47736 10.132.1.145:443 10.132.0.10:43928 - models-as-a-service.external-model-e2e-rotation-external-model.0 2026-10-30T07:55:39.498827Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:55:39.498869Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:55:39.498884Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T07:55:39.498889Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T07:55:39.418Z] "DELETE /v1/api-keys/e1ae0935-1223-419e-bd8f-ea8fec1a25d0 HTTP/1.1" 200 - via_upstream - "-" 0 359 80 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "13f50d2a-ca42-4a0b-bb51-47455b3d2219" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.145:57880 10.132.1.145:443 10.132.0.10:35538 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:55:51.167463Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:55:51.272582Z info ads ADS: "" 4 terminated with stream closed 2026-10-30T07:55:51.777256Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:55:54.746729Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:55:59.580708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:56:06.486862Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:56:06.486900Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:56:06.486917Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T07:56:06.486922Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T07:56:06.408Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 78 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "6ca856fa-7ffa-4fdb-91dc-d72b85777511" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.145:60658 10.132.1.145:443 10.132.0.10:33612 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T07:56:19.375705Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:56:23.503929Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:56:39.169716Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:56:55.042776Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:57:00.144Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 71 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "95e27674-a811-4e88-b3f8-573061bdb2f7" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.145:52674 10.132.1.145:443 10.132.0.10:52196 - v1-completions-path [2026-10-30T07:57:00.330Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 54 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "1d91908e-f7f7-4a94-9f29-68fffb96df93" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.145:52674 10.132.1.145:443 10.132.0.10:36506 - v1-completions-path [2026-10-30T07:57:00.481Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 54 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "b640bc6c-0e3a-4483-a516-f100dd717a0e" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.145:52674 10.132.1.145:443 10.132.0.10:36516 - v1-completions-path 2026-10-30T07:57:17.402627Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:57:27.680671Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:57:31.875236Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T07:57:36.308Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 61 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "49729f9f-f505-484d-9f71-405677ca0cb9" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.145:59686 10.132.1.145:443 10.132.0.10:35090 - v1-completions-path 2026-10-30T07:57:49.096296Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:57:51.365707Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:58:10.659302Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:58:15.561130Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:58:30.928729Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:58:33.101755Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:58:50.891868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:59:01.700506Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:59:04.535984Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:59:32.677502Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T07:59:50.690862Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:00:01.024284Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:03:28.709069Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:03:43.884503Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:03:46.093310Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:04:05.242401Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:04:17.323299Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:04:20.907716Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T08:04:24.414Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 57 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "2ef219d7-6dcb-4ec4-814b-1bfff616f070" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.145:52674 10.132.1.145:443 10.132.0.10:60956 - v1-completions-path 2026-10-30T08:04:37.002026Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:04:47.463740Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:04:52.308922Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:04:57.232497Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T08:04:57.232537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T08:04:57.232554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T08:04:57.232559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T08:04:57.156Z] "DELETE /v1/api-keys/e972b6d9-79ca-4264-a7ad-877b29d51576 HTTP/1.1" 200 - via_upstream - "-" 0 365 76 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "9ea86400-8e20-4d47-a31b-56f30513a1c7" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.1.45:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.1.145:44992 10.132.1.145:443 10.132.0.10:60228 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T08:05:09.322392Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:05:14.234247Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:05:17.089748Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T08:05:23.466Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 65 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "76520a5f-3790-4e3c-a2b2-0065c6ce0da5" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.145:52674 10.132.1.145:443 10.132.0.10:38994 - v1-completions-path [2026-10-30T08:05:26.426Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 57 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "f29f1933-39b9-48e9-a950-ebb7e35d4e71" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.145:59686 10.132.1.145:443 10.132.0.10:39002 - v1-completions-path 2026-10-30T08:05:40.138157Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:05:50.477172Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:05:54.888708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:05:57.600158Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:06:01.309619Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T08:06:06.291Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 60 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "cb4ac910-ce4c-427b-a240-75377cb0a349" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "10.133.0.41:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.1.145:59686 10.132.1.145:443 10.132.0.10:52866 - v1-completions-path 2026-10-30T08:06:18.602691Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:06:28.956159Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:06:31.330253Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:06:40.998643Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:06:46.164757Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:07:02.865498Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:07:22.984239Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:07:33.414312Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:07:43.850546Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:07:54.411820Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:08:04.648126Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:08:15.011358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:08:25.415205Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:08:35.779742Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:08:46.153721Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:08:56.473107Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T08:08:59.218884Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T08:08:59.218911Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T08:08:59.218915Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T08:08:59.218920Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T08:08:59.196Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 88 22 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "b3bdd39d-dcab-42f8-b64c-d5abf5b249a7" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.145:443 10.132.0.10:37062 - v1-completions-path [2026-10-30T08:09:03.570Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 36 - "44.212.242.249,10.132.0.10" "python-requests/2.34.2" "e363ec07-42c8-468c-b4b8-12881406fac4" "maas.apps.9c5562174a3f50dd1992.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.1.145:443 10.132.0.10:47254 - v1-completions-path