2026-10-30T21:49:36.656514Z info FLAG: --concurrency="0" 2026-10-30T21:49:36.656535Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-10-30T21:49:36.656539Z info FLAG: --help="false" 2026-10-30T21:49:36.656541Z info FLAG: --log_as_json="false" 2026-10-30T21:49:36.656543Z info FLAG: --log_caller="" 2026-10-30T21:49:36.656545Z info FLAG: --log_output_level="default:info" 2026-10-30T21:49:36.656548Z info FLAG: --log_stacktrace_level="default:none" 2026-10-30T21:49:36.656552Z info FLAG: --log_target="[stdout]" 2026-10-30T21:49:36.656554Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-10-30T21:49:36.656556Z info FLAG: --outlierLogPath="" 2026-10-30T21:49:36.656558Z info FLAG: --profiling="true" 2026-10-30T21:49:36.656560Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-10-30T21:49:36.656563Z info FLAG: --proxyLogLevel="warning" 2026-10-30T21:49:36.656565Z info FLAG: --serviceCluster="istio-proxy" 2026-10-30T21:49:36.656567Z info FLAG: --stsPort="0" 2026-10-30T21:49:36.656569Z info FLAG: --templateFile="" 2026-10-30T21:49:36.656571Z info FLAG: --tokenManagerPlugin="" 2026-10-30T21:49:36.656573Z info FLAG: --vklog="0" 2026-10-30T21:49:36.656576Z info Version 1.28.10-cebc47d567fd1333707199224c18129ecfe07c05-Clean 2026-10-30T21:49:36.656781Z info Proxy role ips=[10.134.0.47] type=router id=maas-default-gateway-openshift-default-694db55c87-bqvsj.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-10-30T21:49:36.656828Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-10-30T21:49:36.657918Z info cpu limit detected as 2, setting concurrency 2026-10-30T21:49:36.658145Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-10-30T21:49:36.658157Z info JWT policy is third-party-jwt 2026-10-30T21:49:36.658160Z info using credential fetcher of JWT type in cluster.local trust domain 2026-10-30T21:49:36.660149Z info Starting default Istio SDS Server 2026-10-30T21:49:36.660176Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-10-30T21:49:36.660193Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-10-30T21:49:36.660787Z info Opening status port 15020 2026-10-30T21:49:36.661316Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-10-30T21:49:36.661969Z info sds Starting SDS grpc server 2026-10-30T21:49:36.661987Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-10-30T21:49:36.662623Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-10-30T21:49:36.663464Z info Starting proxy agent 2026-10-30T21:49:36.663493Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-10-30T21:49:36.727566Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-10-30T21:49:36.813801Z info cache generated new workload certificate resourceName=default latency=151.651443ms ttl=23h59m59.186204723s 2026-10-30T21:49:36.813846Z info cache Root cert has changed, start rotating root cert 2026-10-30T21:49:36.813890Z info cache returned workload trust anchor from cache ttl=23h59m59.186111118s 2026-10-30T21:49:36.868279Z info ads ADS: new connection for node:1 2026-10-30T21:49:36.868348Z info cache returned workload certificate from cache ttl=23h59m59.131654082s 2026-10-30T21:49:36.869107Z info ads ADS: new connection for node:2 2026-10-30T21:49:36.869196Z info cache returned workload trust anchor from cache ttl=23h59m59.130805865s 2026-10-30T21:49:36.913786Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:49:43.039567Z info Readiness succeeded in 6.385307117s 2026-10-30T21:49:43.039884Z info Envoy proxy is ready 2026-10-30T21:51:00.074850Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:51:04.381513Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:51:09.846233Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:51:14.205791Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:51:18.718444Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:51:26.831138Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:51:34.987874Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:51:56.115121Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:51:59.177601Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T21:52:32.189Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 66 - "34.228.250.194,10.132.0.16" "curl/7.76.1" "b9a8abf2-58a3-45a5-a0d0-9e8d21322c13" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.47:443 10.132.0.16:54426 - v1-model-routing 2026-10-30T21:57:35.971836Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:57:35.971890Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:57:35.971913Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:57:35.971921Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T21:57:35.853Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 118 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "21f43e52-a00a-4091-a1cb-aab6ef39dc34" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:50552 10.134.0.47:443 10.132.0.16:36818 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:57:36.930617Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:57:36.930656Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:57:36.930675Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:57:36.930681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T21:57:37.134418Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:57:37.134453Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:57:37.134467Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T21:57:37.134471Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T21:57:36.826Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 104 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "8dce6fe6-2476-48f9-8600-a0dbd268913e" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:50552 10.134.0.47:443 10.132.0.16:36834 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T21:57:37.028Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 105 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "c2dba0da-1230-4a2a-8788-299513f4f4f4" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:50568 10.134.0.47:443 10.132.0.16:36844 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:57:37.704544Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:57:37.704576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T21:57:37.704591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T21:57:37.704596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T21:57:37.598Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 106 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "47f7bd6c-a262-4755-b719-721ba1b0cc2b" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:50552 10.134.0.47:443 10.132.0.16:36856 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:57:39.622262Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T21:57:39.622288Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T21:57:39.622292Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T21:57:39.622298Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T21:57:39.588Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 77 34 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "9d2a0efb-bb67-4f0f-b240-e951e7082bb8" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.47:443 10.132.0.16:36874 - v1-completions-path [2026-10-30T21:57:45.131Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 45 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "a207f1c7-0ff6-4695-af5f-f1c19fe73276" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.47:443 10.132.0.16:36870 - v1-completions-path 2026-10-30T21:57:47.079028Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:57:47.079065Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T21:57:47.079082Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T21:57:47.079087Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T21:57:46.974Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 104 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "b6cd2696-1e46-416c-ac47-90f6b4530ce8" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:50568 10.134.0.47:443 10.132.0.16:36884 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T21:58:05.369749Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T21:58:21.770559Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:04:31.906609Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:04:31.906645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:04:31.906656Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T22:04:31.906661Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:04:31.906820Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-10-30T22:04:31.906877Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T22:04:31.906885Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T22:04:31.906888Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:372 thread=24 2026-10-30T22:04:31.906894Z warning envoy filter external/envoy/source/extensions/filters/http/json_to_metadata/filter.cc:385 key 'model' missing from lines 1-1 key: model thread=24 [2026-10-30T22:04:31.818Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 88 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "2aa67d24-dcca-4c21-aefd-7eb3dd1027ff" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "10.133.0.24:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:50308 10.134.0.47:443 10.132.0.16:45364 - v1-completions-path 2026-10-30T22:04:33.123757Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:04:33.123795Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:04:33.123811Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-10-30T22:04:33.123816Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 [2026-10-30T22:04:33.018Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 567 105 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "d1cb264d-a53a-4e5a-a759-ab123a05db72" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:55880 10.134.0.47:443 10.132.0.16:45370 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:06:03.128630Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:07:55.100218Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:08:46.047792Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:19:30.577291Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:20:11.132882Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:20:48.141583Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-10-30T22:20:53.377615Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=3 2026-10-30T22:21:36.071955Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:23:23.655871Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:24:59.270756Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:32:13.370544Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:32:50.972094Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:33:47.014057Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:33:52.633185Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:33:52.633223Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:33:52.633241Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:33:52.633248Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T22:33:53.201671Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 [2026-10-30T22:33:52.523Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 109 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "5dff9650-9ea3-4c96-bf79-959478f24871" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:46496 10.134.0.47:443 10.132.0.16:55658 - odh-ai-gateway-infra.maas-api-route.3 [2026-10-30T22:33:53.196Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 72 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "ed19c932-0523-992f-ae77-ec93906beb1c" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "10.133.0.25:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:36944 10.134.0.47:443 10.132.0.16:55672 - v1-completions-path [2026-10-30T22:33:53.943Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 64 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "66f48eec-5e61-464f-9d92-0c07bfceff56" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "10.133.0.25:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:36956 10.134.0.47:443 10.132.0.16:55682 - v1-completions-path 2026-10-30T22:34:08.282805Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:34:13.173346Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:34:25.420803Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 [2026-10-30T22:34:25.166Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 63 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "8cc0a6ef-92ce-4c96-acc9-5b2638096ad1" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "10.133.0.25:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:36944 10.134.0.47:443 10.132.0.16:44352 - v1-completions-path [2026-10-30T22:34:25.416Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 57 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "02df5c87-0c17-425a-a96f-b685ca9b8d0b" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.47:443 10.132.0.16:44358 - v1-completions-path 2026-10-30T22:34:43.408555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:34:56.512674Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T22:35:06.472Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 66 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "53132a3d-4dc2-4571-b7ad-3c52d9132afa" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "10.133.0.25:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:36956 10.134.0.47:443 10.132.0.16:57620 - v1-completions-path [2026-10-30T22:35:07.715Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 61 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "fc54775d-31e6-4850-9d73-6c7d2acd877b" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "10.133.0.25:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:36956 10.134.0.47:443 10.132.0.16:57626 - v1-completions-path 2026-10-30T22:35:27.556548Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:35:38.085060Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:35:44.613216Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T22:35:59.386Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 60 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "7b704f1e-ef30-4190-a1f9-e9d4b8f7ba86" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "10.133.0.25:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:36956 10.134.0.47:443 10.132.0.16:52574 - v1-completions-path 2026-10-30T22:36:13.559894Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:36:25.585764Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:36:45.283522Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:36:51.535967Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:37:17.655636Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:37:39.611133Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:37:50.977675Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:38:02.191797Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T22:38:19.790Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 38 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "d6aa8888-f278-4aaa-97e0-c87d0074b3dc" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.47:443 10.132.0.16:50406 - v1-completions-path [2026-10-30T22:38:45.660Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 0 36 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "029dbd77-bee0-4b85-a68f-f1fa32babc0f" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.47:443 10.132.0.16:50778 - v1-completions-path 2026-10-30T22:39:02.308139Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:39:44.076464Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:39:54.638778Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:44:39.994190Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:44:53.303537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:44:53.303569Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:44:53.303580Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-10-30T22:44:53.303585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 [2026-10-30T22:44:53.194Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 109 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "af5c8959-19f4-4518-a51e-81efd046fdce" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:52632 10.134.0.47:443 10.132.0.16:56804 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:45:06.765265Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:45:11.270968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:45:21.571645Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:45:21.571681Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:45:21.571695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=25 2026-10-30T22:45:21.571700Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-10-30T22:45:21.456Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 65 308 115 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "889b70d0-fe28-46f5-a16a-3fc8b6c34925" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:52632 10.134.0.47:443 10.132.0.16:51832 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:45:35.766019Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:47:40.833871Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:48:23.663124Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:48:53.777580Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:49:09.241803Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:49:17.669238Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:49:29.172346Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:49:34.037818Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-10-30T22:49:40.755Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 65 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "3bbbf5c4-beec-4bb2-883d-535e2b7bfd66" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "10.133.0.25:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.47:36956 10.134.0.47:443 10.132.0.16:56448 - v1-completions-path [2026-10-30T22:49:41.293Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 55 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "5d061bfd-102f-477a-aba8-137d8fb79893" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.47:443 10.132.0.16:56452 - v1-completions-path 2026-10-30T22:49:55.243663Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:51:29.353216Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=4 2026-10-30T22:53:30.958893Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:53:37.345628Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:53:37.345662Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:53:37.345676Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /model thread=24 2026-10-30T22:53:37.345680Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-10-30T22:53:37.228Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 117 - "34.228.250.194,10.132.0.16" "python-requests/2.34.2" "87fcb633-5475-4bb0-bd22-ccd477f77e11" "maas.apps.184a73d47cc96ae9e775.prod.konflux-ocp-ci.dev" "10.132.0.227:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.47:39888 10.134.0.47:443 10.132.0.16:38250 - odh-ai-gateway-infra.maas-api-route.3 2026-10-30T22:53:42.411815Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:54:03.484379Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:54:08.152091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:54:24.518136Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-10-30T22:54:36.011017Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8