2026-09-15T13:48:59.232595Z info FLAG: --concurrency="0" 2026-09-15T13:48:59.232615Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-09-15T13:48:59.232619Z info FLAG: --help="false" 2026-09-15T13:48:59.232622Z info FLAG: --log_as_json="false" 2026-09-15T13:48:59.232624Z info FLAG: --log_caller="" 2026-09-15T13:48:59.232626Z info FLAG: --log_output_level="default:info" 2026-09-15T13:48:59.232628Z info FLAG: --log_stacktrace_level="default:none" 2026-09-15T13:48:59.232633Z info FLAG: --log_target="[stdout]" 2026-09-15T13:48:59.232636Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-09-15T13:48:59.232638Z info FLAG: --outlierLogPath="" 2026-09-15T13:48:59.232640Z info FLAG: --profiling="true" 2026-09-15T13:48:59.232642Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-09-15T13:48:59.232644Z info FLAG: --proxyLogLevel="warning" 2026-09-15T13:48:59.232646Z info FLAG: --serviceCluster="istio-proxy" 2026-09-15T13:48:59.232649Z info FLAG: --stsPort="0" 2026-09-15T13:48:59.232651Z info FLAG: --templateFile="" 2026-09-15T13:48:59.232653Z info FLAG: --tokenManagerPlugin="" 2026-09-15T13:48:59.232655Z info FLAG: --vklog="0" 2026-09-15T13:48:59.232658Z info Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean 2026-09-15T13:48:59.232811Z info Proxy role ips=[10.132.0.33] type=router id=maas-default-gateway-openshift-default-5ccb968c66-n4f4m.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-09-15T13:48:59.232860Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-09-15T13:48:59.234089Z info cpu limit detected as 2, setting concurrency 2026-09-15T13:48:59.234347Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-09-15T13:48:59.234359Z info JWT policy is third-party-jwt 2026-09-15T13:48:59.234363Z info using credential fetcher of JWT type in cluster.local trust domain 2026-09-15T13:48:59.235746Z info Starting default Istio SDS Server 2026-09-15T13:48:59.235732Z info Opening status port 15020 2026-09-15T13:48:59.235773Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-09-15T13:48:59.235799Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-09-15T13:48:59.236834Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-09-15T13:48:59.239037Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-09-15T13:48:59.241542Z info sds Starting SDS grpc server 2026-09-15T13:48:59.241566Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-09-15T13:48:59.241748Z info Starting proxy agent 2026-09-15T13:48:59.241775Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-09-15T13:48:59.297324Z warning envoy main external/envoy/source/server/server.cc:901 Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future. thread=8 2026-09-15T13:48:59.297633Z warning envoy main external/envoy/source/server/server.cc:997 There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. thread=8 2026-09-15T13:48:59.304200Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-09-15T13:48:59.394384Z info ads ADS: new connection for node:1 2026-09-15T13:48:59.394865Z info ads ADS: new connection for node:2 2026-09-15T13:48:59.755945Z info cache generated new workload certificate resourceName=default latency=518.526ms ttl=23h59m59.244058477s 2026-09-15T13:48:59.755978Z info cache Root cert has changed, start rotating root cert 2026-09-15T13:48:59.756007Z info cache returned workload certificate from cache ttl=23h59m59.243997s 2026-09-15T13:48:59.756017Z info cache returned workload trust anchor from cache ttl=23h59m59.243983995s 2026-09-15T13:48:59.756125Z info cache returned workload trust anchor from cache ttl=23h59m59.243876999s 2026-09-15T13:48:59.756479Z info cache returned workload trust anchor from cache ttl=23h59m59.243524538s 2026-09-15T13:48:59.801127Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-15T13:49:06.306082Z info Readiness succeeded in 7.075967839s 2026-09-15T13:49:06.306369Z info Envoy proxy is ready 2026-09-15T13:49:11.979883Z info ads ADS: new connection for node:3 2026-09-15T13:49:11.980033Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-15T13:49:11.980063Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-15T13:49:12.116748Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-15T13:49:36.225214Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-15T13:49:40.345266Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-15T13:49:50.449326Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-15T13:50:01.057071Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-15T13:50:06.274023Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-15T13:50:14.797251Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-15T13:51:39.548342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-15T13:51:39.517Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 31 - "44.212.242.249,10.133.0.11" "curl/7.76.1" "97f8a172-5533-4781-a579-b143746abae7" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46486 10.132.0.33:443 10.133.0.11:52620 - odh-ai-gateway-infra.maas-api-route.3 2026-09-15T13:51:39.639890Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-15T13:51:40.258186Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-15T13:51:39.602Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 37 - "44.212.242.249,10.133.0.11" "curl/7.76.1" "d13f0161-4771-48bc-bd29-6ade470d698a" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46498 10.132.0.33:443 10.133.0.11:52632 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:51:39.695Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 371 57 - "44.212.242.249,10.133.0.11" "curl/7.76.1" "f69f1206-b34e-4dc4-a75f-3f605facfa7d" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:55500 10.132.0.33:443 10.133.0.11:52642 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-15T13:51:39.793Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 360 17 - "44.212.242.249,10.133.0.11" "curl/7.76.1" "de2b9a46-030d-48e7-af6e-56210316a5c3" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:55500 10.132.0.33:443 10.133.0.11:52648 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-15T13:51:39.832Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 355 16 - "44.212.242.249,10.133.0.11" "curl/7.76.1" "6ee3a60b-3f31-4709-b256-9f77373b743d" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:55500 10.132.0.33:443 10.133.0.11:52654 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-15T13:51:39.874Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 437 21 - "44.212.242.249,10.133.0.11" "curl/7.76.1" "9af8c683-ec6d-483e-b7ff-c533bd5ff439" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:55504 10.132.0.33:443 10.133.0.11:52664 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-15T13:51:39.918Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 403 17 - "44.212.242.249,10.133.0.11" "curl/7.76.1" "84c2948e-1af6-4aac-9ed6-764e1fa08485" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:55504 10.132.0.33:443 10.133.0.11:52670 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-15T13:51:39.959Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "44.212.242.249,10.133.0.11" "curl/7.76.1" "42d13b1b-4adc-4d12-8bc5-b7afd1ca3179" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.33:443 10.133.0.11:52678 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-15T13:51:39.999Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "44.212.242.249,10.133.0.11" "curl/7.76.1" "b65fd55d-30bd-4d51-8b7f-7f98cd3e1556" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.33:443 10.133.0.11:52684 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-15T13:51:40.040Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "44.212.242.249,10.133.0.11" "curl/7.76.1" "6a9a6144-1006-41a8-adc0-f61a97e65d67" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.33:443 10.133.0.11:52690 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-15T13:51:40.082Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "44.212.242.249,10.133.0.11" "curl/7.76.1" "e7bb6faa-02b1-4f62-b0a2-de80afedfdcd" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.33:443 10.133.0.11:52698 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-15T13:51:40.130Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 15 - "44.212.242.249,10.133.0.11" "curl/7.76.1" "c0a199d1-2831-4436-b463-2f3612528b62" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.33:443 10.133.0.11:52712 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-15T13:51:40.172Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "44.212.242.249,10.133.0.11" "curl/7.76.1" "04e435bd-4598-4429-b964-22c12bbeff13" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.33:443 10.133.0.11:52718 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-15T13:51:40.213Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 0 5 - "44.212.242.249,10.133.0.11" "curl/7.76.1" "57baf198-db76-4704-8ef9-f12545f2f1a0" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.33:443 10.133.0.11:52732 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-15T13:51:40.243Z] "DELETE /v1/api-keys/93b3f582-28df-4e78-b45c-0cccc4bf6836 HTTP/1.1" 200 - via_upstream - "-" 0 365 14 - "44.212.242.249,10.133.0.11" "curl/7.76.1" "36edb2f6-da9d-4e7e-8370-7a797927fc44" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46486 10.132.0.33:443 10.133.0.11:52746 - odh-ai-gateway-infra.maas-api-route.3 2026-09-15T13:51:40.506261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-15T13:51:40.539905Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-15T13:51:40.502Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 4 - "44.212.242.249,10.133.0.11" "curl/7.76.1" "427218a8-a24b-4691-93af-0e76db14ee9c" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46498 10.132.0.33:443 10.133.0.11:60022 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-15T13:51:40.528Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 11 - "44.212.242.249,10.133.0.11" "curl/7.76.1" "814eb008-ae60-49a2-8b74-fd7f0c0d1151" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46486 10.132.0.33:443 10.133.0.11:60036 - odh-ai-gateway-infra.maas-api-route.3 2026-09-15T13:51:50.640450Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-09-15T13:51:50.640505Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-15T13:51:50.704230Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-15T13:51:50.738785Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-15T13:51:50.777027Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-15T13:51:50.786689Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-15T13:51:50.786847Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-09-15T13:51:50.804058Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-09-15T13:51:50.829892Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-15T13:51:50.830066Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 2026-09-15T13:51:50.835905Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-15T13:51:50.993104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-15T13:51:51.027271Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-15T13:51:51.088866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-15T13:51:51.121798Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-15T13:51:51.223181Z info ads ADS: new connection for node:4 2026-09-15T13:51:51.225769Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-09-15T13:51:51.225811Z info cache read certificate from file resource=file-root:system 2026-09-15T13:51:51.283909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-15T13:51:51.317922Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-15T13:51:51.393577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-15T13:51:51.428647Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-15T13:51:50.635Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 4 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "5f80a45a-97ee-46af-971f-29f7a5c34dd0" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46498 10.132.0.33:443 10.133.0.11:42540 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-15T13:51:50.664Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 0 6 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "1c43d91e-abc4-44bd-abf2-068a532dc3ee" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.33:443 10.133.0.11:42556 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:51:50.691Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 12 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "6c72b814-715e-41df-b142-df4cdfd4f0b7" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46486 10.132.0.33:443 10.133.0.11:42562 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:51:50.725Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 13 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "953c9316-55ad-449a-b901-23209f94a3e3" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46498 10.132.0.33:443 10.133.0.11:42570 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:51:50.762Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 14 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "5c9815f4-c2e2-4982-a8d5-e472bf6f2549" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46486 10.132.0.33:443 10.133.0.11:42576 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:51:50.763Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 111 126 23 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "0a4e5082-4baf-4f53-9721-ec80f05554aa" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:55500 10.132.0.33:443 10.133.0.11:42592 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-15T13:51:50.796Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 8 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "131db471-0ce0-458a-85b7-e1e0e716bc89" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.33:443 10.133.0.11:42600 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:51:50.811Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 18 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "cb8e355e-b25f-4512-8141-fb873265f5f1" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:55504 10.132.0.33:443 10.133.0.11:42604 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-15T13:51:50.822Z] "DELETE /v1/api-keys/08abd539-8dcf-4288-97d0-57fbb0681e0a HTTP/1.1" 200 - via_upstream - "-" 0 370 13 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "165192d7-d34d-4255-bddf-cbb9a95e8f3c" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46486 10.132.0.33:443 10.133.0.11:42618 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:51:50.979Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "405717a0-5db2-4a78-9427-8f7f9b69aa18" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46486 10.132.0.33:443 10.133.0.11:42632 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:51:51.012Z] "DELETE /v1/api-keys/ba468623-316b-4b87-ae74-1fb1c211682f HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "0673d779-3e3c-4f1d-8610-3880fd78bbf0" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46486 10.132.0.33:443 10.133.0.11:42644 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:51:51.049Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 9 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "bba652c9-1aeb-4d48-bf09-7664b555de53" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.33:443 10.133.0.11:42646 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:51:51.075Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 13 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "c9094288-aca1-4a92-af3d-b1b36f56e6a5" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46486 10.132.0.33:443 10.133.0.11:42660 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:51:51.108Z] "DELETE /v1/api-keys/f20c7ee2-8a42-4044-87e6-c8b1a953eb48 HTTP/1.1" 200 - via_upstream - "-" 0 321 13 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "9af1766f-000e-4679-8a60-dc3221fcd0ec" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46486 10.132.0.33:443 10.133.0.11:42674 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:51:51.267Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 16 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "95ed5f7c-172f-4c75-937f-0b14c9d8f90f" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46486 10.132.0.33:443 10.133.0.11:42682 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:51:51.303Z] "DELETE /v1/api-keys/f8a0d966-8c71-4d3f-9163-9ebc6bbf517b HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "fee9b6ed-c8fd-4bb0-874a-633720153356" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46498 10.132.0.33:443 10.133.0.11:42698 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:51:51.347Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 10 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "4399226a-beaf-46f7-8ba7-41a44364add7" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.33:443 10.133.0.11:42712 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:51:51.376Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 16 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "808c7cb3-964e-43c7-96e1-30ea23df5402" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46486 10.132.0.33:443 10.133.0.11:42718 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:51:51.411Z] "DELETE /v1/api-keys/fee9a9d5-da94-4d9f-8242-281270778af3 HTTP/1.1" 200 - via_upstream - "-" 0 321 16 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "0e324ba0-f936-4ddf-abf7-4ea72bb14384" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46486 10.132.0.33:443 10.133.0.11:42728 - odh-ai-gateway-infra.maas-api-route.3 2026-09-15T13:51:51.586323Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-15T13:51:51.773847Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-15T13:51:51.886024Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-15T13:51:51.571Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "4e4d6e30-51d1-454d-9b87-eadb62e712b5" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46498 10.132.0.33:443 10.133.0.11:42740 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:51:51.606Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 13 14 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "fa6f33f0-374b-457e-9b7b-569732264bd3" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.33:443 10.133.0.11:42748 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-15T13:51:51.756Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 17 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "74039ad5-41d6-4b4b-aff0-70e0e1fdeb1c" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46486 10.132.0.33:443 10.133.0.11:42754 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:51:51.791Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 279 20 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "a390211b-0358-44f3-ac23-f9b46835603d" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:55504 10.132.0.33:443 10.133.0.11:42762 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-15T13:51:51.828Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 22 - "44.212.242.249,10.133.0.11" "-" "0cbb29fb-c274-49ea-ae49-7b0e47efce6e" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:55500 10.132.0.33:443 10.133.0.11:42772 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-15T13:51:51.871Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 14 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "a6deadf9-25b0-43f3-b54b-a98025b6a254" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46498 10.132.0.33:443 10.133.0.11:42784 - odh-ai-gateway-infra.maas-api-route.3 2026-09-15T13:51:55.701878Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-15T13:51:56.413989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-15T13:51:56.399Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 14 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "916f9934-1d82-96c6-a0da-df694e5e7467" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46486 10.132.0.33:443 10.133.0.11:42796 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:51:56.753Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 403 - - "-" 83 0 11 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "0e404a9b-3409-4b45-b9ed-ae18dd2cc66f" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.132.0.33:443 10.133.0.11:42802 - llm.e2e-external-model.0 [2026-09-15T13:51:56.787Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 9 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "79b12fc5-6dd8-47c7-b210-df987d5a427e" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.132.0.33:443 10.133.0.11:42812 - llm.e2e-external-model.0 [2026-09-15T13:51:56.907Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 11 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "96b009fc-9a56-4fbc-9d0e-11470654e4dc" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.33:443 10.133.0.11:42830 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-15T13:51:57.260Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 7 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "3ed3386a-2984-4bd6-aace-01e292c16610" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" - - 10.132.0.33:443 10.133.0.11:42842 - - 2026-09-15T13:51:57.999194Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-15T13:51:57.999361Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-15T13:51:56.815Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 1183 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "a8f62a23-2043-43b5-8af9-3ba251a569fb" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.33:52932 10.132.0.33:443 10.133.0.11:42826 - llm.e2e-external-model.1 2026-09-15T13:52:03.647483Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-15T13:52:10.648Z] "POST /llm/nonexistent-model-xyz/v1/chat/completions HTTP/1.1" 404 NR route_not_found - "-" 86 0 9 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "c7e67691-b925-4621-8198-62d11c32e533" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" - - 10.132.0.33:443 10.133.0.11:59784 - - 2026-09-15T13:52:14.130657Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-15T13:52:16.332251Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-15T13:52:16.111Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 221 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "722fd5d9-0236-46c4-9120-db0077107654" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46486 10.132.0.33:443 10.133.0.11:59812 - odh-ai-gateway-infra.maas-api-route.3 2026-09-15T13:52:17.439551Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-15T13:52:17.439696Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-15T13:52:16.359Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 431 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "df929e6f-48d7-4acf-8051-07279d5385c3" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.33:443 10.133.0.11:59826 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-15T13:52:14.233Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 3206 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "acd9999a-3821-4fd5-be51-07384165a5bf" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.33:33438 10.132.0.33:443 10.133.0.11:59796 - llm.e2e-external-model.1 2026-09-15T13:52:22.362088Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-15T13:52:23.093832Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-15T13:52:23.093980Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-15T13:52:17.478Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 82 39 5615 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "82a56c42-47bd-4249-bb48-622d77fefb34" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.33:33438 10.132.0.33:443 10.133.0.11:59836 - llm.e2e-external-model.2 2026-09-15T13:52:26.256532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-15T13:52:26.256715Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-09-15T13:52:23.117Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 52 39 3139 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "764a2a13-2424-45cc-b28b-404ce7717d54" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.33:60834 10.132.0.33:443 10.133.0.11:47874 - llm.e2e-external-model.2 2026-09-15T13:52:48.480384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-15T13:52:48.461Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 18 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "aa910a42-85ab-4919-a51a-4ae46b1569f8" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:46486 10.132.0.33:443 10.133.0.11:49672 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T13:52:48.502Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 21 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "1e01e545-daa0-4cf2-a58c-8b1ed21ba80a" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:55504 10.132.0.33:443 10.133.0.11:49680 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-15T13:52:48.544Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 18 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "36e8c97a-0a87-4848-9661-78a9977fcbe4" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:55500 10.132.0.33:443 10.133.0.11:49684 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-15T13:52:48.584Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 18 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "4aa98a7c-45cf-4694-aae8-6d05d7e997e8" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:55500 10.132.0.33:443 10.133.0.11:49686 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-15T13:52:48.630Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 18 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "4524a6f6-6b35-4cfb-bd3b-bc9bf0649e96" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:55504 10.132.0.33:443 10.133.0.11:49702 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-15T13:52:57.205661Z info ads ADS: "" 4 terminated [2026-09-15T13:53:01.049Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 7 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "96a2fc71-15ae-4bdc-a85f-760a68956309" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" - - 10.132.0.33:443 10.133.0.11:49482 - - 2026-09-15T13:53:01.369918Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-15T13:53:01.523428Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-15T13:53:01.189Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 5 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "1aec926a-e6bc-44ad-b06e-8fb7d22c538f" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" - - 10.132.0.33:443 10.133.0.11:49486 - - [2026-09-15T13:53:01.333Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 5 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "47b3ba98-917b-4ca0-8fbe-eb267f1af2ec" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "-" - - 10.132.0.33:443 10.133.0.11:49496 - - [2026-09-15T13:53:01.363Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 6 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "5d2b8f6e-6359-4e47-a6e2-7fdee52f59d2" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:49280 10.132.0.33:443 10.133.0.11:49512 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-15T13:53:01.509Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 14 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "bf1528b8-202c-49fd-85ea-24844a900095" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:49280 10.132.0.33:443 10.133.0.11:49524 - odh-ai-gateway-infra.maas-api-route.3 2026-09-15T13:53:05.293519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-15T13:54:31.009555Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-15T13:55:04.787258Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-15T14:18:15.692644Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-09-15T14:26:07.641111Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-15T14:26:07.614Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 27 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "c42a9d96-b80d-4551-89f0-fb0a0fc07fb0" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:37092 10.132.0.33:443 10.133.0.11:59132 - odh-ai-gateway-infra.maas-api-route.3 2026-09-15T14:27:42.220261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-15T14:27:42.202Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 17 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "af6c9d4f-fb9b-4aa6-be03-f2cd540da431" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:39398 10.132.0.33:443 10.133.0.11:48476 - odh-ai-gateway-infra.maas-api-route.3 2026-09-15T14:31:10.781120Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-15T14:31:10.752Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 28 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "1490d2c1-a39f-441d-bee1-d83a0e1514a2" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.134.0.31:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.33:56986 10.132.0.33:443 10.133.0.11:58094 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-15T14:31:10.806Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 32 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "b40d4e9c-069c-4337-97c5-e5e5a2d9bd51" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:55504 10.132.0.33:443 10.133.0.11:58100 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-15T14:31:11.667Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 19 - "44.212.242.249,10.133.0.11" "python-requests/2.32.5" "d684b133-269a-4869-8535-effa1b9f92f9" "maas.apps.2709fc15-2a71-455b-b023-84604fff46ce.prod.konfluxeaas.com" "10.132.0.38:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.33:55504 10.132.0.33:443 10.133.0.11:58112 - llm.facebook-opt-125m-simulated-kserve-route.0