2026-09-16T18:55:11.128600Z info FLAG: --concurrency="0" 2026-09-16T18:55:11.128618Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-09-16T18:55:11.128622Z info FLAG: --help="false" 2026-09-16T18:55:11.128625Z info FLAG: --log_as_json="false" 2026-09-16T18:55:11.128627Z info FLAG: --log_caller="" 2026-09-16T18:55:11.128630Z info FLAG: --log_output_level="default:info" 2026-09-16T18:55:11.128632Z info FLAG: --log_stacktrace_level="default:none" 2026-09-16T18:55:11.128637Z info FLAG: --log_target="[stdout]" 2026-09-16T18:55:11.128640Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-09-16T18:55:11.128642Z info FLAG: --outlierLogPath="" 2026-09-16T18:55:11.128645Z info FLAG: --profiling="true" 2026-09-16T18:55:11.128647Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-09-16T18:55:11.128649Z info FLAG: --proxyLogLevel="warning" 2026-09-16T18:55:11.128651Z info FLAG: --serviceCluster="istio-proxy" 2026-09-16T18:55:11.128654Z info FLAG: --stsPort="0" 2026-09-16T18:55:11.128657Z info FLAG: --templateFile="" 2026-09-16T18:55:11.128660Z info FLAG: --tokenManagerPlugin="" 2026-09-16T18:55:11.128664Z info FLAG: --vklog="0" 2026-09-16T18:55:11.128668Z info Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean 2026-09-16T18:55:11.128830Z info Proxy role ips=[10.133.0.43] type=router id=maas-default-gateway-openshift-default-5ccb968c66-rcxf8.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-09-16T18:55:11.128886Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-09-16T18:55:11.130482Z info cpu limit detected as 2, setting concurrency 2026-09-16T18:55:11.130794Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-09-16T18:55:11.130807Z info JWT policy is third-party-jwt 2026-09-16T18:55:11.130813Z info using credential fetcher of JWT type in cluster.local trust domain 2026-09-16T18:55:11.132812Z info Opening status port 15020 2026-09-16T18:55:11.132828Z info Starting default Istio SDS Server 2026-09-16T18:55:11.132846Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-09-16T18:55:11.132865Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-09-16T18:55:11.133903Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-09-16T18:55:11.134048Z info sds Starting SDS grpc server 2026-09-16T18:55:11.134065Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-09-16T18:55:11.135140Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-09-16T18:55:11.136048Z info Starting proxy agent 2026-09-16T18:55:11.136079Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-09-16T18:55:11.192433Z warning envoy main external/envoy/source/server/server.cc:901 Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future. thread=9 2026-09-16T18:55:11.192717Z warning envoy main external/envoy/source/server/server.cc:997 There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. thread=9 2026-09-16T18:55:11.198892Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-09-16T18:55:11.289379Z info ads ADS: new connection for node:1 2026-09-16T18:55:11.290005Z info ads ADS: new connection for node:2 2026-09-16T18:55:11.496133Z info cache generated new workload certificate resourceName=default latency=361.966311ms ttl=23h59m59.503872462s 2026-09-16T18:55:11.496192Z info cache Root cert has changed, start rotating root cert 2026-09-16T18:55:11.496236Z info cache returned workload trust anchor from cache ttl=23h59m59.503765321s 2026-09-16T18:55:11.496259Z info cache returned workload certificate from cache ttl=23h59m59.503742173s 2026-09-16T18:55:11.496353Z info cache returned workload trust anchor from cache ttl=23h59m59.503651374s 2026-09-16T18:55:11.496727Z info cache returned workload trust anchor from cache ttl=23h59m59.503274647s 2026-09-16T18:55:11.540874Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T18:55:17.196767Z info Readiness succeeded in 6.07045188s 2026-09-16T18:55:17.197117Z info Envoy proxy is ready 2026-09-16T18:55:19.305297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T18:55:19.551351Z info ads ADS: new connection for node:3 2026-09-16T18:55:19.551508Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-16T18:55:19.551539Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-16T18:55:34.648890Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T18:55:41.958067Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T18:56:05.943974Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T18:56:12.329496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T18:56:19.149046Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T18:56:34.966473Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T18:57:47.082989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:57:47.046Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 36 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "8c8bfbae-739b-4469-82fa-45b4abbfaa95" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57664 10.133.0.43:443 10.134.0.9:52936 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:57:47.167485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:57:47.796953Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T18:57:47.129Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 37 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "5de73bdb-f9e5-48ac-abb0-e88ce31c9ade" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57664 10.133.0.43:443 10.134.0.9:52940 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:57:47.221Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 418 57 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "dd793686-8c4c-4c10-bc04-27b54febf2de" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49176 10.133.0.43:443 10.134.0.9:52946 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:57:47.321Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 326 23 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "afb28644-40f1-45e2-ae1f-ff2ed78d2da4" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49190 10.133.0.43:443 10.134.0.9:52958 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:57:47.370Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 367 17 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "59c03bc2-e8a3-410c-a69f-b5eba29c8445" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49176 10.133.0.43:443 10.134.0.9:52970 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:57:47.413Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 368 18 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "5eb2097d-db8c-4185-8423-1b036faa3cc8" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49190 10.133.0.43:443 10.134.0.9:52982 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:57:47.461Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 449 17 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "44933e27-e7a1-4ee1-8fcd-ede342799077" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49190 10.133.0.43:443 10.134.0.9:52994 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:57:47.503Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "4a449704-9a1c-42fa-b3b3-c44badee9e11" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:53004 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:57:47.544Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "43f54b45-e3b7-4030-b684-9cd82c263172" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:53016 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:57:47.585Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "9e8ed9c0-93df-41ec-a817-084a53870140" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:53032 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:57:47.628Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "f25889e8-afc2-481d-b2ec-8d5cd1cd5a23" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:53038 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:57:47.670Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "f4f4813e-237b-42d6-874b-09e6f6269d40" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:53054 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:57:47.709Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "8cb22a39-3c64-41dc-b31a-8e3112e8cb0d" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:53068 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:57:47.748Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 0 5 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "8f077a64-9276-4a9d-8deb-13081c946dca" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:53072 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:57:47.779Z] "DELETE /v1/api-keys/fdc310d8-16e2-49b7-bc2f-43a989d7cea2 HTTP/1.1" 200 - via_upstream - "-" 0 365 17 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "c7f3eec5-013e-4e33-bd6f-39b77b07d762" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57670 10.133.0.43:443 10.134.0.9:53080 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:57:48.113442Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-09-16T18:57:48.113513Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:57:48.153911Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:57:48.109Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 4 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "ffc05b05-4aa1-40ac-85ed-30670a54b463" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57670 10.133.0.43:443 10.134.0.9:53094 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-16T18:57:48.140Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 13 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "63a5818f-e145-461c-9662-d4faf4e422e8" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57664 10.133.0.43:443 10.134.0.9:53100 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:58:11.774125Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:58:11.849366Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T18:58:11.770Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 4 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "7435ba7b-34c2-405b-bb1e-45e65b900302" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57670 10.133.0.43:443 10.134.0.9:35760 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-16T18:58:11.800Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 0 5 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "719a7f44-40d8-4b85-9677-f72c05e59100" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.43:443 10.134.0.9:35764 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:11.834Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 14 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "3ec9fdce-8425-4a00-ba6b-51221b91f18b" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57670 10.133.0.43:443 10.134.0.9:35780 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:58:11.885590Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:58:11.926063Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:58:11.927401Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:58:11.927541Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-09-16T18:58:11.968717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:58:11.968894Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-09-16T18:58:11.993610Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:58:12.168746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:58:12.206452Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:58:12.238418Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-09-16T18:58:12.271149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:58:12.309702Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:58:12.383908Z info ads ADS: new connection for node:4 2026-09-16T18:58:12.387027Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-09-16T18:58:12.387077Z info cache read certificate from file resource=file-root:system 2026-09-16T18:58:12.484661Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:58:12.527258Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:58:12.604407Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:58:12.646370Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:58:12.817352Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:58:12.857357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T18:58:11.870Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "75d057ee-3ab8-43da-957d-a61385e401fd" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57664 10.133.0.43:443 10.134.0.9:35788 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:11.902Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 23 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "ce327d9e-5d80-4025-89fe-cd30bcd7f8b0" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57670 10.133.0.43:443 10.134.0.9:35792 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:11.908Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 111 126 18 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "a93a5a50-ef54-4c78-8cc6-31b60020a74a" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49190 10.133.0.43:443 10.134.0.9:35806 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-16T18:58:11.948Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 10 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "e7dfaec6-3165-4965-9458-a6e4aaa510b5" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.43:443 10.134.0.9:35814 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:11.951Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "87dc6143-143b-4281-aaf5-f1c104d7dc4c" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49190 10.133.0.43:443 10.134.0.9:35820 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:58:11.979Z] "DELETE /v1/api-keys/e8b5fc13-3256-47e9-8799-2c4e9a293626 HTTP/1.1" 200 - via_upstream - "-" 0 370 14 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "21e11875-c3a8-40b2-85f4-a968c54e9e30" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57670 10.133.0.43:443 10.134.0.9:35826 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:12.154Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "f71e8e2f-bda6-4d0c-9bde-036a51aa2573" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57670 10.133.0.43:443 10.134.0.9:35834 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:12.191Z] "DELETE /v1/api-keys/7558736c-e9df-4f72-bdb7-d0b8b66b8feb HTTP/1.1" 200 - via_upstream - "-" 0 321 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "4af684b1-b7c6-42d0-baa5-be73f4515030" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57664 10.133.0.43:443 10.134.0.9:35840 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:12.228Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 10 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "d037d1cc-ced8-4e0e-8ad9-ce4af1195ada" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.43:443 10.134.0.9:35854 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:12.257Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 13 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "4e6440f2-8d80-4d28-9003-4fd65a5ec50b" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57664 10.133.0.43:443 10.134.0.9:35866 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:12.295Z] "DELETE /v1/api-keys/1d6566fb-520d-4f92-840d-f0dc39387ac5 HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "fb1b9611-e6ac-41d1-9e92-b199579b32ad" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57664 10.133.0.43:443 10.134.0.9:35870 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:12.471Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 312 13 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "f119109f-5aef-4676-8b21-2d97c196144d" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57664 10.133.0.43:443 10.134.0.9:35886 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:12.511Z] "DELETE /v1/api-keys/f33f4b14-5497-46c0-9903-038cc6652a16 HTTP/1.1" 200 - via_upstream - "-" 0 321 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "4035b4d7-e409-41ce-8b5f-d0eb9124a42c" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57670 10.133.0.43:443 10.134.0.9:35892 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:12.552Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 12 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "75b067ed-b09b-4c6e-9b5f-dc324d629a19" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.43:443 10.134.0.9:35900 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:12.585Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 18 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "0f187182-91ad-45a5-968b-7296e3d5cab0" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57664 10.133.0.43:443 10.134.0.9:35910 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:12.627Z] "DELETE /v1/api-keys/7745d3df-a2bc-4ccf-8720-7e66bdcad519 HTTP/1.1" 200 - via_upstream - "-" 0 321 19 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "7fe94728-815f-45bc-8436-c75edb78ea89" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57670 10.133.0.43:443 10.134.0.9:35918 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:12.802Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "a7d6bc38-babd-46fb-815e-f6974b2ca348" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57670 10.133.0.43:443 10.134.0.9:35928 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:12.840Z] "DELETE /v1/api-keys/58ff889b-6001-4393-af08-7e8cccc2de4f HTTP/1.1" 200 - via_upstream - "-" 0 321 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "00c2f9aa-e727-4a87-9d83-def6825da26b" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57670 10.133.0.43:443 10.134.0.9:35942 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:12.882Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "6d338bad-827c-4ab7-9b9b-b23ae1997387" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.43:443 10.134.0.9:35946 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:58:12.943114Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:58:12.981207Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:58:13.170093Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:58:13.367054Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:58:13.489372Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T18:58:12.921Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 21 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "d6cfa935-00a8-48ee-9512-a0e0c46f8471" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57664 10.133.0.43:443 10.134.0.9:35962 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:12.963Z] "DELETE /v1/api-keys/73144dbc-b304-4bca-aa16-15dc74da9780 HTTP/1.1" 200 - via_upstream - "-" 0 321 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "a196ed84-dc37-4088-97d3-dec5cd60a50d" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57670 10.133.0.43:443 10.134.0.9:35970 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:13.154Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "9afe0b49-5a6f-4da1-be7d-880da3080dd0" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57670 10.133.0.43:443 10.134.0.9:35976 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:13.192Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 13 12 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "edc56476-c94b-475b-adb2-dd959090d45d" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:35986 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:58:13.351Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "ea733416-ed6a-43d8-88e1-b1d11984d27b" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57664 10.133.0.43:443 10.134.0.9:35988 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:13.390Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 19 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "d9610e93-f3a6-4405-b99f-02779631fccb" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49176 10.133.0.43:443 10.134.0.9:35990 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:58:13.427Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 21 - "34.228.250.194,10.134.0.9" "-" "e98bf7f1-8db4-4430-811a-fe0d44897397" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49176 10.133.0.43:443 10.134.0.9:36000 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:58:13.472Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 16 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "30989e33-991f-457a-8191-c3ff1821feb0" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57670 10.133.0.43:443 10.134.0.9:36010 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:58:17.272297Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T18:58:17.470001Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:58:17.451Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 18 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "a59a9fe2-dad5-4eda-bb69-6b5876a90952" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57664 10.133.0.43:443 10.134.0.9:36018 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:18.515Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 12 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "8589d1f7-ef0b-4081-bdf1-89a1fe0b6f11" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:36028 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:58:17.950Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 2782 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "bbb74d45-a53e-4cdf-b580-9030a4a03852" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.43:48852 10.133.0.43:443 10.134.0.9:36026 - llm.e2e-external-model.1 [2026-09-16T18:58:20.800Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 7 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "937f88b1-e4e3-4a2a-82cc-04ea20ba4ec0" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.133.0.43:443 10.134.0.9:36030 - llm.e2e-external-model.0 [2026-09-16T18:58:21.283Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 5 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "f223204c-9e67-4671-bb27-b3b4e36de0f8" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" - - 10.133.0.43:443 10.134.0.9:36046 - - 2026-09-16T18:58:22.959229Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:58:22.959485Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-09-16T18:58:20.830Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 2128 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "cbae68a5-fb2c-4e38-9d2d-1f8b926e1486" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.43:48852 10.133.0.43:443 10.134.0.9:36036 - llm.e2e-external-model.1 2026-09-16T18:58:25.077356Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T18:58:25.059Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "bf5a484a-58f7-41a7-a9eb-32810051d5f5" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57670 10.133.0.43:443 10.134.0.9:45832 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:25.100Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 10 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "a2a56a08-590b-4769-97b7-81564a8453be" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:45836 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-16T18:58:27.104381Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:58:27.087Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "416b21f3-6897-9316-b956-3d09b26c5ca9" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57664 10.133.0.43:443 10.134.0.9:45842 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:58:27.124Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 37 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "8c575cb3-9845-4bf5-b8a9-6675eb80c0d1" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49176 10.133.0.43:443 10.134.0.9:45848 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:58:27.185Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 35 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "812d4e15-3538-46dc-a347-06ffda03ec10" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49190 10.133.0.43:443 10.134.0.9:45854 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:58:27.252Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 38 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "f696465d-4de9-4291-a58d-ec54f786f07a" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49190 10.133.0.43:443 10.134.0.9:45864 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:58:27.311Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 19 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "efd69982-c839-4e2d-8ab8-accc62ce72eb" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49190 10.133.0.43:443 10.134.0.9:45872 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T18:58:33.969545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-16T18:58:35.697Z] "POST /llm/nonexistent-model-xyz/v1/chat/completions HTTP/1.1" 404 NR route_not_found - "-" 86 0 10 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "6aedc24e-90b4-43db-bbcb-47c1fed52679" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" - - 10.133.0.43:443 10.134.0.9:37518 - - 2026-09-16T18:58:41.299270Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:58:41.299520Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-16T18:58:39.478Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 1820 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "c3cdbdfa-d6c2-49b4-b0e5-3f596db39d2f" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.43:35608 10.133.0.43:443 10.134.0.9:37520 - llm.e2e-external-model.1 2026-09-16T18:58:43.531332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:58:43.531484Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-09-16T18:58:41.324Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 82 39 2206 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "8f144825-3bcf-4480-830e-eeb6bf951d4f" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.43:34548 10.133.0.43:443 10.134.0.9:47370 - llm.e2e-external-model.2 2026-09-16T18:58:45.459253Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T18:58:45.459437Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-09-16T18:58:45.487112Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-16T18:58:43.555Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 52 39 1903 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "de1affdc-6fec-4617-a5d5-2622d77a7c6c" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.43:34548 10.133.0.43:443 10.134.0.9:47382 - llm.e2e-external-model.2 2026-09-16T18:58:47.106509Z info ads ADS: "" 4 terminated with stream closed 2026-09-16T18:58:47.973471Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:58:47.551Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 29 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "2d5dca40-15b8-4468-b8ca-6a8ed0b3b0d6" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" - - 10.133.0.43:443 10.134.0.9:47396 - - [2026-09-16T18:58:47.737Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 21 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "faf30cd6-af0f-4b00-be71-280a6875e5dd" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" - - 10.133.0.43:443 10.134.0.9:47402 - - [2026-09-16T18:58:47.919Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 11 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "c987c941-6d4f-47d6-8885-f1e62a6d6608" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" - - 10.133.0.43:443 10.134.0.9:47410 - - [2026-09-16T18:58:47.964Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 9 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "d9d0fff2-506d-43b2-8219-12dd896cb95d" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57664 10.133.0.43:443 10.134.0.9:47416 - odh-ai-gateway-infra.maas-api-route.4 2026-09-16T18:58:48.127504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:58:48.111Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 16 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "ed71f9ab-fee1-4355-8d19-2a69c4f374c1" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:57664 10.133.0.43:443 10.134.0.9:47426 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:58:56.340561Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T19:02:45.910150Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T19:03:03.084874Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T19:16:49.942882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T19:16:49.924Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 18 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "20d1a6dc-bf55-4c41-bbfd-7fce85e90ea5" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:34316 10.133.0.43:443 10.134.0.9:40532 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:16:49.968Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 321 32 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "d6c5bb81-cd54-41df-b604-028feff4bb17" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49190 10.133.0.43:443 10.134.0.9:40540 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-16T19:16:50.024Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 316 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "2d69f984-dc99-421c-a49a-102d5f6c856a" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49190 10.133.0.43:443 10.134.0.9:40546 - llm.facebook-opt-125m-simulated-kserve-route.2 2026-09-16T19:20:31.700377Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T19:20:31.672Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 28 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "3a9f5e66-a213-49ec-a874-d02a436abe5f" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:49958 10.133.0.43:443 10.134.0.9:40808 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T19:20:33.578446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T19:20:33.560Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "8d75584f-6c9e-4e59-a935-4f9801582480" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:49964 10.133.0.43:443 10.134.0.9:40824 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T19:20:34.384029Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T19:21:56.694399Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T19:21:57.084548Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T19:21:57.067Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "1ac40e0b-b3eb-4aed-a515-5307e9b02f32" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:58272 10.133.0.43:443 10.134.0.9:41028 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T19:22:22.187047Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T19:22:25.663979Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T19:22:25.643Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 20 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "02afba4b-13b4-4ad2-a132-857cf25a0aef" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:55706 10.133.0.43:443 10.134.0.9:42042 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:22:25.683Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 43 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "a756510b-d33e-4052-9566-0919d745fcf8" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.132.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:53468 10.133.0.43:443 10.134.0.9:42052 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:22:25.849Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 18 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "eaf02f60-e7ad-4d60-9f88-25c12eeb5651" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.132.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:53468 10.133.0.43:443 10.134.0.9:42064 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:22:25.989Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 20 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "60adac9e-a02d-49d5-944b-823a5898b82d" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.132.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:53484 10.133.0.43:443 10.134.0.9:42072 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:22:26.136Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 18 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "7538cc57-4061-41b1-ab1b-eb6ab4601ea3" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.132.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:53484 10.133.0.43:443 10.134.0.9:42074 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:22:26.276Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 18 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "c79b7511-ddb1-46e2-900f-404990193817" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.132.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:53484 10.133.0.43:443 10.134.0.9:42082 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:22:26.417Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "c76db1c5-049e-42b8-92c3-0a1f00340c05" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:42092 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-16T19:22:30.478283Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T19:22:35.070289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T19:22:35.054Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 16 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "111a5237-e578-4c2f-8774-78ff2e34ea49" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:55706 10.133.0.43:443 10.134.0.9:33226 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:22:35.090Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 298 18 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "26c8cd77-19fd-4c22-ae29-386e4cd8d3b0" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.132.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:53484 10.133.0.43:443 10.134.0.9:33230 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-16T19:22:35.212637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T19:22:35.974995Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T19:22:35.127Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "093e98b8-054c-447b-ae54-c1255086f108" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:33244 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:22:35.162Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "eed7a3f4-3289-4c04-9ca9-e5fef0a249ff" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:33258 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:22:35.197Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "8e9d1d82-6b19-4a29-b753-75cce52de0b5" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.132.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:53468 10.133.0.43:443 10.134.0.9:33262 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.6 [2026-09-16T19:22:35.956Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 18 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "bebd1c9b-80bf-4671-85cd-db1089ed510b" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:58272 10.133.0.43:443 10.134.0.9:33272 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:22:35.994Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 19 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "8482d5a4-803c-4ecb-b78e-85171d812bff" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49190 10.133.0.43:443 10.134.0.9:33278 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:22:36.999Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 19 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "e1b8d014-6db6-4870-a884-0aee0bb3cf9b" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49176 10.133.0.43:443 10.134.0.9:33288 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:22:37.735Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 20 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "e0a49a39-96c2-4aca-9a49-43ecd1f1360f" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49190 10.133.0.43:443 10.134.0.9:33298 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T19:22:38.584225Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-16T19:22:40.967Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 22 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "b94110eb-9dea-419e-97fa-866700a100d8" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49190 10.133.0.43:443 10.134.0.9:33310 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:22:44.293Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 11 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "1b750e48-e928-421c-8f7b-e0739da33585" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:39366 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T19:22:50.131630Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T19:22:49.339Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 11 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "f4a18cd7-7f6d-4f2b-92a0-efdb82b2fb74" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:39382 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:22:50.116Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "fadcb433-daee-44ae-8d14-d868d366672b" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:55706 10.133.0.43:443 10.134.0.9:39394 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:22:50.474Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 11 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "a8c8cf5e-9b8a-4792-9c54-3247c4a91d08" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:39396 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T19:22:53.370136Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T19:22:58.439671Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T19:22:58.472819Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-16T19:22:58.422Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 327 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "1cae4013-b68b-400d-bcc9-ae8d5aeb0f6f" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:55706 10.133.0.43:443 10.134.0.9:56816 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:22:58.461Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 66 18 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "d7a59324-783f-4430-8e88-7cec90370339" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:56822 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:23:00.500Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 19 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "a9acdea1-c850-4c98-9e8f-6c9fe96e755d" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.47:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:49176 10.133.0.43:443 10.134.0.9:56838 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T19:23:01.768845Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T19:23:01.753Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "b5aadac0-f516-4831-ae19-8d862f6d9020" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:55706 10.133.0.43:443 10.134.0.9:46140 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:23:02.130Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 11 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "c8b7163b-2bdf-4d0a-b687-e069823463bb" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:46156 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T19:23:03.673161Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T19:23:20.297311Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-09-16T19:24:10.281891Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T19:24:10.263Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 18 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "217a931d-9f5e-4e5f-8a66-a27dc36d1066" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:44246 10.133.0.43:443 10.134.0.9:45264 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:24:10.304Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 49 21 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "3bdd417c-7e70-47e3-b636-f24e4071f48c" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:45276 - llm.e2e-trlp-test-simulated-kserve-route.0 2026-09-16T19:24:32.855071Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-16T19:24:34.397Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 295 33 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "c2abbf61-5e84-4567-8056-96059b45623f" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.132.0.26:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:42126 10.133.0.43:443 10.134.0.9:45740 - llm.e2e-trlp-test-simulated-kserve-route.0 2026-09-16T19:24:35.027139Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T19:24:35.011Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "55be2320-83ad-4aca-a34e-2bffcb2c23a6" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:44246 10.133.0.43:443 10.134.0.9:45742 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T19:24:39.473692Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T19:24:41.384266Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T19:24:41.545432Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T19:24:41.366Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 40 330 18 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "e355c4f9-43fd-4c65-87b2-766e2c252da8" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:59252 10.133.0.43:443 10.134.0.9:42270 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:24:41.533Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 479 11 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "a616cd9d-11ff-4ba2-8bf0-a68ed7c61f6c" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:59252 10.133.0.43:443 10.134.0.9:42282 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T19:24:44.565083Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T19:24:59.463711Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T19:25:07.291631Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T19:25:30.912155Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T19:25:30.949867Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T19:25:30.894Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "b9f0c755-0183-46e3-a69d-cfa5a85be68f" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:59252 10.133.0.43:443 10.134.0.9:53380 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:25:30.938Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 670 11 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "44f0b2de-6d7e-4ac8-8b76-d62392401227" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:59252 10.133.0.43:443 10.134.0.9:53394 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T19:25:35.570278Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T19:25:39.955441Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T19:25:40.176686Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T19:25:40.212478Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T19:25:40.149Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 325 26 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "cf31d659-3ea3-42e9-8662-fe5df994ca81" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:55370 10.133.0.43:443 10.134.0.9:38616 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:25:40.201Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 11 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "3e8c2776-f4a2-425b-b6e7-cd6e96ba1695" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:55370 10.133.0.43:443 10.134.0.9:38622 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T19:25:43.950312Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T19:25:49.055725Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T19:25:49.088622Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T19:25:49.280761Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T19:25:49.040Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "390bcb75-5583-4299-a7e2-dd18a666f875" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:59252 10.133.0.43:443 10.134.0.9:44822 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:25:49.078Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 10 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "0a935353-1c37-4c2f-b974-0ba9f9240d86" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:55370 10.133.0.43:443 10.134.0.9:44830 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:25:49.111Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 19 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "97af1b25-2757-4fea-8579-56d37759cfcd" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.132.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:53468 10.133.0.43:443 10.134.0.9:44834 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:25:49.155Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "39ebfeb3-725e-4bae-8886-272cd5978bb4" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.132.0.27:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:53484 10.133.0.43:443 10.134.0.9:44840 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:25:49.198Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "9a2f7406-3b75-4c86-8ede-e232d2aedca3" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:44842 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:25:49.234Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "cad1b208-6f21-487d-b5b5-cff7231a1f6e" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:44856 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:25:49.270Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 10 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "d445c543-f663-4db3-ac73-9e3545626899" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.37:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:59252 10.133.0.43:443 10.134.0.9:44860 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T19:25:52.164364Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-16T19:25:56.852Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 39 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "e83d8624-fe47-438e-9c0d-93589cabf12f" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:41074 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-16T19:25:59.380022Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T19:26:02.977284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T19:26:02.953Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 23 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "61db0020-f2c9-4509-99ad-9003f81a0fc6" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.84:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:44270 10.133.0.43:443 10.134.0.9:58178 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:26:02.997Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 35 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "b7db5a8f-becb-495e-8916-65ef52100dbc" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:56436 10.133.0.43:443 10.134.0.9:58182 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-16T19:26:03.152Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 19 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "6d1f09f5-1909-4ba3-ad47-43e102bb5c9d" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:56436 10.133.0.43:443 10.134.0.9:58194 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-16T19:26:03.293Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 21 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "8d6b6683-79cc-498f-b4dd-b947611903b1" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:56452 10.133.0.43:443 10.134.0.9:58200 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-16T19:26:03.438Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 16 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "5c17607a-1e4d-4e99-964c-4f49a202a693" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.43:443 10.134.0.9:58216 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-16T19:26:06.452309Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T19:26:12.370431Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T19:26:16.051196Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T19:26:16.030Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 20 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "dee61edd-09fe-4507-82f7-2c58bcf3984c" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.133.0.97:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.43:34450 10.133.0.43:443 10.134.0.9:35672 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:26:16.071Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 34 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "b28ac5c0-f223-43c1-bbe7-e4a66af2671d" "maas.apps.623d8dda-ee8d-4669-a061-12fc58ed30f9.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.43:56452 10.133.0.43:443 10.134.0.9:35676 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-16T19:26:18.562620Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9