2026-09-19T10:43:28.752252Z info FLAG: --concurrency="0" 2026-09-19T10:43:28.752270Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-09-19T10:43:28.752274Z info FLAG: --help="false" 2026-09-19T10:43:28.752276Z info FLAG: --log_as_json="false" 2026-09-19T10:43:28.752279Z info FLAG: --log_caller="" 2026-09-19T10:43:28.752281Z info FLAG: --log_output_level="default:info" 2026-09-19T10:43:28.752283Z info FLAG: --log_stacktrace_level="default:none" 2026-09-19T10:43:28.752288Z info FLAG: --log_target="[stdout]" 2026-09-19T10:43:28.752290Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-09-19T10:43:28.752292Z info FLAG: --outlierLogPath="" 2026-09-19T10:43:28.752294Z info FLAG: --profiling="true" 2026-09-19T10:43:28.752296Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-09-19T10:43:28.752299Z info FLAG: --proxyLogLevel="warning" 2026-09-19T10:43:28.752301Z info FLAG: --serviceCluster="istio-proxy" 2026-09-19T10:43:28.752303Z info FLAG: --stsPort="0" 2026-09-19T10:43:28.752305Z info FLAG: --templateFile="" 2026-09-19T10:43:28.752307Z info FLAG: --tokenManagerPlugin="" 2026-09-19T10:43:28.752310Z info FLAG: --vklog="0" 2026-09-19T10:43:28.752312Z info Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean 2026-09-19T10:43:28.752445Z info Proxy role ips=[10.133.0.33] type=router id=maas-default-gateway-openshift-default-78bb78ff78-g4xvk.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-09-19T10:43:28.752497Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-09-19T10:43:28.753573Z info cpu limit detected as 2, setting concurrency 2026-09-19T10:43:28.753826Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-09-19T10:43:28.753837Z info JWT policy is third-party-jwt 2026-09-19T10:43:28.753840Z info using credential fetcher of JWT type in cluster.local trust domain 2026-09-19T10:43:28.756275Z info Starting default Istio SDS Server 2026-09-19T10:43:28.756299Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-09-19T10:43:28.756318Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-09-19T10:43:28.756472Z info Opening status port 15020 2026-09-19T10:43:28.757406Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-09-19T10:43:28.758588Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-09-19T10:43:28.759375Z info Starting proxy agent 2026-09-19T10:43:28.759403Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-09-19T10:43:28.768004Z info sds Starting SDS grpc server 2026-09-19T10:43:28.768026Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-09-19T10:43:28.813751Z warning envoy main external/envoy/source/server/server.cc:901 Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future. thread=9 2026-09-19T10:43:28.814021Z warning envoy main external/envoy/source/server/server.cc:997 There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. thread=9 2026-09-19T10:43:28.819631Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-09-19T10:43:28.911641Z info ads ADS: new connection for node:1 2026-09-19T10:43:28.912286Z info ads ADS: new connection for node:2 2026-09-19T10:43:29.293290Z info cache generated new workload certificate resourceName=default latency=535.748381ms ttl=23h59m59.706715364s 2026-09-19T10:43:29.293408Z info cache Root cert has changed, start rotating root cert 2026-09-19T10:43:29.293488Z info cache returned workload trust anchor from cache ttl=23h59m59.706513326s 2026-09-19T10:43:29.293532Z info cache returned workload certificate from cache ttl=23h59m59.706469682s 2026-09-19T10:43:29.294086Z info cache returned workload trust anchor from cache ttl=23h59m59.705915684s 2026-09-19T10:43:29.294353Z info cache returned workload trust anchor from cache ttl=23h59m59.705648648s 2026-09-19T10:43:29.341968Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T10:43:35.871205Z info Readiness succeeded in 7.121030706s 2026-09-19T10:43:35.871517Z info Envoy proxy is ready 2026-09-19T10:43:46.405678Z info ads ADS: new connection for node:3 2026-09-19T10:43:46.405836Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-19T10:43:46.405861Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-19T10:43:46.804940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T10:43:52.398476Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T10:44:09.316545Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T10:44:17.326377Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T10:44:26.741742Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T10:44:33.951255Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T10:44:42.845025Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T10:46:36.736376Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T10:46:54.510322Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T10:47:19.584277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T10:47:19.545Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 38 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "a1d4c88e-62e1-49c7-b914-6e1ec420e546" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48872 10.133.0.33:443 10.132.0.15:49862 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T10:47:19.670132Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T10:47:20.296427Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-09-19T10:47:20.296487Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T10:47:20.339551Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T10:47:20.397149Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T10:47:19.634Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 35 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "f98122af-9f31-40e4-b000-2b5c7982d5de" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48872 10.133.0.33:443 10.132.0.15:49866 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:19.730Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 355 31 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "6b25d23d-1fdb-4f53-851f-48f2e1d739fe" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60392 10.133.0.33:443 10.132.0.15:49876 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T10:47:19.822Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 348 20 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "7ca3df6e-ea65-4d08-a80a-43fa54e094f0" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60406 10.133.0.33:443 10.132.0.15:49884 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T10:47:19.878Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 371 15 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "998f28c4-798b-4084-82c0-3fcfd999eb97" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60392 10.133.0.33:443 10.132.0.15:49892 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T10:47:19.927Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 423 14 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "7ac10019-1a89-465c-9ec8-32107010e1ff" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60392 10.133.0.33:443 10.132.0.15:49894 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T10:47:19.970Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 402 14 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "f2fe6648-0cb0-4199-aa4f-d062d214e8cf" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60392 10.133.0.33:443 10.132.0.15:49910 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T10:47:20.017Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 11 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "f44fd56a-987e-427f-8842-4a21165817ce" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:49922 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T10:47:20.054Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "72448c0e-1861-45c7-903b-08c9894e7bdc" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:49924 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T10:47:20.112Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "b5368c05-2a78-447f-9322-fae16c6f9de8" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:49938 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T10:47:20.147Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "51088c3f-72a4-4d0c-8e28-df696f2fac37" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:49948 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T10:47:20.182Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 11 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "4323f4e3-a9db-43ae-a474-a1b61a7e5259" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:49960 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T10:47:20.217Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "c3ec815c-5e1b-4361-b4fa-a16759d98f66" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:49976 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T10:47:20.254Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 0 4 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "493d3917-1bd6-4984-bac2-d7411a923dcf" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" - - 10.133.0.33:443 10.132.0.15:49978 - - [2026-09-19T10:47:20.283Z] "DELETE /v1/api-keys/a1e8ddcf-9cd2-4384-857d-6e0723df6880 HTTP/1.1" 200 - via_upstream - "-" 0 365 13 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "8fec9f4e-00d8-4ed2-9d6a-5577aea46422" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48872 10.133.0.33:443 10.132.0.15:49982 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:20.334Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 5 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "5d0f7ec0-5ee6-48df-abca-eda4afe2e1e2" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48876 10.133.0.33:443 10.132.0.15:49994 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-19T10:47:20.385Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 11 - "34.228.250.194,10.132.0.15" "curl/7.76.1" "cb3b161e-f92b-45a2-9634-1addf18ae979" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48876 10.133.0.33:443 10.132.0.15:50000 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T10:47:29.414862Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T10:47:29.486654Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T10:47:29.409Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 5 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "cf554d26-4738-4c28-b110-205eca9e2bb6" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48872 10.133.0.33:443 10.132.0.15:50010 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-19T10:47:29.442Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 0 6 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "f9e57c9d-6d51-4a75-8ef5-6a8ad85570e5" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.33:443 10.132.0.15:50022 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:29.473Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 13 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "ee3b2b0d-ad2c-436c-8a4c-368bc617b97c" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48876 10.133.0.33:443 10.132.0.15:50032 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T10:47:29.544887Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T10:47:29.546281Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T10:47:29.579684Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T10:47:29.579880Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-09-19T10:47:29.616100Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T10:47:29.618256Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T10:47:29.618401Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-09-19T10:47:29.771748Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-09-19T10:47:29.774674Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T10:47:29.831952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T10:47:29.892905Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T10:47:29.925174Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T10:47:30.107603Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T10:47:30.143375Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T10:47:30.213773Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T10:47:30.246205Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T10:47:30.414351Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T10:47:30.451181Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T10:47:30.515883Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T10:47:29.530Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 14 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "681e9d57-2ccf-4d67-8db0-52c1cfb7036c" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48872 10.133.0.33:443 10.132.0.15:44388 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:29.531Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 14 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "776b74d1-cc52-4745-afc3-0175015503aa" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48876 10.133.0.33:443 10.132.0.15:44396 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:29.563Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 111 126 16 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "d86e8966-f14a-4a30-b378-aab70095cea5" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60392 10.133.0.33:443 10.132.0.15:44400 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-19T10:47:29.564Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 18 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "a9dd23c9-32d4-4ac5-a838-216bad12c11a" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.33:443 10.132.0.15:44404 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:29.601Z] "DELETE /v1/api-keys/fa99a022-2ab6-4811-af8c-f83e022160d7 HTTP/1.1" 200 - via_upstream - "-" 0 370 14 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "64dc72c7-4525-4d35-a0ef-bc412ee5b99d" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48872 10.133.0.33:443 10.132.0.15:44406 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:29.602Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 15 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "71ef2c4a-5676-4e63-8858-11fa6951c1a2" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60406 10.133.0.33:443 10.132.0.15:44418 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T10:47:29.761Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 13 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "dad767fb-c02f-4a2d-ae32-ae5c4649fc40" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48876 10.133.0.33:443 10.132.0.15:44428 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:29.818Z] "DELETE /v1/api-keys/7fca2d70-7904-4114-a59d-33c445b517b5 HTTP/1.1" 200 - via_upstream - "-" 0 321 13 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "aaa11e91-5412-47e7-b748-d3265cd7580e" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48872 10.133.0.33:443 10.132.0.15:44430 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:29.851Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 9 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "43a8a9fd-b90a-4e61-bd6a-164a86ea7e92" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.33:443 10.132.0.15:44434 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:29.880Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 12 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "73e814b8-8727-4da4-bcff-2e08d85268a8" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48872 10.133.0.33:443 10.132.0.15:44444 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:29.911Z] "DELETE /v1/api-keys/e89bbb37-a309-449a-85ed-1139dd435d6a HTTP/1.1" 200 - via_upstream - "-" 0 321 13 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "2056d54d-46f1-45c7-8a47-5f9ee66845b6" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48872 10.133.0.33:443 10.132.0.15:44458 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:30.087Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 19 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "490f9a02-adbc-446a-ac27-31095749936f" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48872 10.133.0.33:443 10.132.0.15:44464 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:30.126Z] "DELETE /v1/api-keys/b86273b1-c709-4a89-b063-5b5703606a26 HTTP/1.1" 200 - via_upstream - "-" 0 321 17 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "81f3c1e1-3ace-4db0-bd2a-fa4682dae78a" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48872 10.133.0.33:443 10.132.0.15:44476 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:30.162Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 15 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "55330c46-7aa3-40b0-8a16-2f61af8ba048" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.33:443 10.132.0.15:44480 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:30.197Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "d31aea90-99c6-48db-8e51-d5494dc01f51" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48872 10.133.0.33:443 10.132.0.15:44496 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:30.231Z] "DELETE /v1/api-keys/ac3568d1-35d9-44e4-bf06-f49dd5c4c7fe HTTP/1.1" 200 - via_upstream - "-" 0 321 15 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "744adc47-ca43-4aa5-bbe8-a71574fcb3f9" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48872 10.133.0.33:443 10.132.0.15:44510 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:30.394Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 20 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "bfa63141-4e9c-402a-82b5-1ab9eb37b211" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48876 10.133.0.33:443 10.132.0.15:44514 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:30.432Z] "DELETE /v1/api-keys/1899e590-2a91-4156-b200-3182a17595c3 HTTP/1.1" 200 - via_upstream - "-" 0 321 18 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "b47a6e4e-77d1-47aa-b37d-f87cda000a00" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48872 10.133.0.33:443 10.132.0.15:44524 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:30.469Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 11 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "83f1024d-b86d-9332-80f6-f0d8201b7370" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.33:443 10.132.0.15:44528 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:30.501Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "7f298105-b184-4eb8-abbf-130cb6ea0a22" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48876 10.133.0.33:443 10.132.0.15:44530 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T10:47:30.547736Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T10:47:30.703290Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T10:47:30.903170Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T10:47:30.533Z] "DELETE /v1/api-keys/51d8b0f8-2289-4654-b0ef-23cd185766da HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "c0f1437d-ae5b-480f-9f3f-7142b5d6f91d" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48876 10.133.0.33:443 10.132.0.15:44534 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:30.687Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "f02df1c6-245f-4b02-9de4-460a95c5e02c" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48876 10.133.0.33:443 10.132.0.15:44536 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:30.726Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 13 12 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "df607a51-30e9-4f9f-9cd3-6ba46e4872c3" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:44540 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T10:47:30.886Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "7ca6168b-642b-461d-8c8b-325ea0fc3a5b" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48876 10.133.0.33:443 10.132.0.15:44542 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:37.390Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 6 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "bfdaa67c-2eec-4556-ad55-f50230ddd0aa" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" - - 10.133.0.33:443 10.132.0.15:44552 - - 2026-09-19T10:47:39.025529Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T10:47:38.932Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 22 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "ae11a64a-c1c9-4d7e-84fe-2bbb98edf2fb" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60392 10.133.0.33:443 10.132.0.15:44556 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T10:47:38.973Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 16 - "34.228.250.194,10.132.0.15" "-" "bfe733b5-9b86-4de0-9072-956d008ab6e6" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60392 10.133.0.33:443 10.132.0.15:44568 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T10:47:39.010Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 317 14 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "94e77735-7355-4f80-9ef0-8de1dbae4af1" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48872 10.133.0.33:443 10.132.0.15:44572 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T10:47:44.241964Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T10:47:44.055Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 15 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "10b24099-3d6a-4a44-a8b5-b47e57d31202" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:43312 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T10:47:44.222Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 19 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "c7c08a9e-2dbd-4275-a852-b2cfe1a3c928" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48872 10.133.0.33:443 10.132.0.15:43322 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:44.273Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 46 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "a3767183-2cae-4e29-9ca7-1dbc992d4254" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:43334 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-19T10:47:48.288166Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T10:47:48.269Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 19 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "3434924c-3da5-429d-a1f4-1ffa8e1464e0" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48876 10.133.0.33:443 10.132.0.15:43342 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T10:47:48.311Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 23 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "03c25797-a041-4890-ab75-077927499b98" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60406 10.133.0.33:443 10.132.0.15:43346 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T10:47:48.357Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 18 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "2e72b737-4f24-40f0-89f6-681f756a09a8" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60406 10.133.0.33:443 10.132.0.15:43360 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T10:47:48.396Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 22 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "eab54632-d4bd-4a59-82c2-5d0889dc75fb" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60392 10.133.0.33:443 10.132.0.15:43370 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T10:47:48.436Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 21 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "dde543e9-3ebb-4480-93e3-ad681e402f91" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60392 10.133.0.33:443 10.132.0.15:43376 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T10:48:01.511Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 6 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "52c842fb-770a-4960-bfc0-37f1d31d448d" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" - - 10.133.0.33:443 10.132.0.15:45860 - - 2026-09-19T10:48:01.863411Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T10:48:02.036309Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T10:48:01.692Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 5 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "e86b96a6-2ebc-41e8-86ed-bfd1038b0a76" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" - - 10.133.0.33:443 10.132.0.15:45870 - - [2026-09-19T10:48:01.830Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 4 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "6318e2cb-be55-446b-82e7-8893b3289b9d" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" - - 10.133.0.33:443 10.132.0.15:45874 - - [2026-09-19T10:48:01.858Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 4 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "fabbb349-26da-418d-a12f-6700609fe9ae" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48876 10.133.0.33:443 10.132.0.15:45890 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-19T10:48:02.021Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 14 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "996d0bd3-2102-4e13-9823-7a0766fcb52b" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:48876 10.133.0.33:443 10.132.0.15:45892 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T10:51:45.772600Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T10:51:58.676119Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T10:57:24.379519Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T10:57:34.856100Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T11:02:08.566175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T11:02:08.545Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 310 20 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "04f753ec-e9fb-4244-967d-768da039a02a" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:56006 10.133.0.33:443 10.132.0.15:50678 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T11:02:08.588Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 331 28 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "62986e74-0d21-49a3-8f1f-c868ab8e5e77" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60406 10.133.0.33:443 10.132.0.15:50686 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-19T11:02:08.637Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 324 17 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "d4f33d1e-ef2b-4717-99dc-3a10e0a38111" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60406 10.133.0.33:443 10.132.0.15:50696 - llm.facebook-opt-125m-simulated-kserve-route.2 2026-09-19T11:02:11.291975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T11:02:11.292133Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-19T11:02:11.274Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 120 126 18 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "694a5a8f-4776-4986-98b5-67a01c85489b" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60406 10.133.0.33:443 10.132.0.15:47848 - llm.facebook-opt-125m-simulated-kserve-route.2 2026-09-19T11:05:22.782422Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T11:05:22.751Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 30 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "bc72bd0f-f009-4450-b60c-473c9cfb95ac" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:50918 10.133.0.33:443 10.132.0.15:36550 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T11:05:24.578824Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T11:05:24.563Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 15 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "fe66e51a-1981-46b5-9393-6221d2841884" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:50918 10.133.0.33:443 10.132.0.15:36552 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T11:05:26.270154Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T11:06:46.864622Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T11:06:48.130393Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T11:06:48.112Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 17 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "cf24feb1-86d2-4ce4-b307-e3800c575667" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:32962 10.133.0.33:443 10.132.0.15:59574 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T11:07:13.162833Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T11:07:16.542397Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T11:07:16.521Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 330 20 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "f2537734-4adf-452e-b348-762e610a11ae" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:54348 10.133.0.33:443 10.132.0.15:50232 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T11:07:16.576Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 39 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "7d7afa97-7203-4175-b10d-ab6e5c41ab51" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:45900 10.133.0.33:443 10.132.0.15:50242 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T11:07:16.738Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 18 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "c5f42959-1f40-43dd-9bf8-e248620bfd72" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:45904 10.133.0.33:443 10.132.0.15:50254 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T11:07:16.877Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 16 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "27c04b4a-f3d2-4c04-b99e-f9618813bc88" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:45900 10.133.0.33:443 10.132.0.15:50258 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T11:07:17.013Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 16 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "b20446f0-6579-4722-a3f5-57e0795fc5b5" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:45904 10.133.0.33:443 10.132.0.15:50264 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T11:07:17.151Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 16 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "36d5bd0c-4a38-4323-8055-32013590c11d" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:45904 10.133.0.33:443 10.132.0.15:50268 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T11:07:17.289Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "398f7f23-3dcc-44ed-b820-f5899d8b5bfa" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:50272 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-19T11:07:20.947382Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T11:07:25.865448Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T11:07:26.010793Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T11:07:26.702084Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T11:07:25.848Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 17 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "809e5bc3-6cc6-448e-928c-73360031c731" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:54348 10.133.0.33:443 10.132.0.15:37038 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T11:07:25.896Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 298 17 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "e983e8cc-831a-474b-93c2-808f10d08f7e" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:45904 10.133.0.33:443 10.132.0.15:37044 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T11:07:25.932Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "339ed52b-1d8d-4083-aee0-db2543c4c39e" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:37050 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T11:07:25.964Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 12 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "a7090957-b79b-4c9f-9361-dd33b86bfb32" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:37066 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T11:07:25.997Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 13 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "8e7a4278-07f4-472d-9047-ef1fd4bb5920" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:45900 10.133.0.33:443 10.132.0.15:37070 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.6 [2026-09-19T11:07:26.686Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 15 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "af291331-2696-4acc-bc15-75c9693e1d63" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:32962 10.133.0.33:443 10.132.0.15:37082 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T11:07:26.728Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 16 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "847f5d84-2fa8-42e9-8152-0f6f730bcd53" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60406 10.133.0.33:443 10.132.0.15:37084 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T11:07:27.625Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 17 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "b9028b8c-fece-43e0-a8e6-a9430c8c04dc" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60406 10.133.0.33:443 10.132.0.15:37086 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T11:07:28.309Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 17 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "79c46819-f8c8-4066-a222-92a77b6e86c6" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60392 10.133.0.33:443 10.132.0.15:37098 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T11:07:28.954868Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-19T11:07:29.314Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 18 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "86b48b56-7ded-445c-94b3-82c6c7d756d8" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60392 10.133.0.33:443 10.132.0.15:37112 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T11:07:34.635Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 11 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "57460ef2-3c94-47e4-9965-6a6cd7609c57" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:56248 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T11:07:39.657Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 12 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "003551db-448e-4aa9-b2f4-df7cdce8489a" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:57856 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-19T11:07:40.488118Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T11:07:40.469Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 18 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "641d60b0-cf20-4c34-b66e-17b74af75a11" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:32962 10.133.0.33:443 10.132.0.15:57860 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T11:07:40.823Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 10 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "d59d1d52-7072-4bc6-a092-6555ca3acb5a" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:57876 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T11:07:47.059940Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T11:07:48.736880Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T11:07:48.720Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 327 15 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "84a5d001-d513-4edc-aaf5-6dde705d740a" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:32962 10.133.0.33:443 10.132.0.15:57882 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T11:07:48.767Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 17 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "13a66c6d-fdf0-4bb7-97af-d7b53c44d08b" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:60406 10.133.0.33:443 10.132.0.15:57894 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T11:07:50.023951Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T11:07:50.008Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 15 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "c22ca013-e27d-4dea-aea0-d5cd64e07dd9" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:32962 10.133.0.33:443 10.132.0.15:32958 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T11:07:50.367Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 10 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "2523c28f-6e30-4f5c-bc52-8d3cda5e3ce7" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:32960 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T11:07:50.978248Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T11:08:56.309712Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T11:08:56.289Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 20 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "202b55d1-1be4-4d4c-a871-7d05f2884db5" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:57658 10.133.0.33:443 10.132.0.15:43340 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T11:08:56.331Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 49 19 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "ce48ec7e-5273-49a9-a2b0-f59879b09997" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:43354 - llm.e2e-trlp-test-simulated-kserve-route.0 2026-09-19T11:09:18.351720Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T11:09:20.541859Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T11:09:19.934Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 285 34 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "9e1d224e-fa4e-444d-a62c-7d2faa7a2f10" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.132.0.33:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:57992 10.133.0.33:443 10.132.0.15:35356 - llm.e2e-trlp-test-simulated-kserve-route.0 [2026-09-19T11:09:20.525Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 16 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "0a4e5655-5184-4253-b946-9771399056a9" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:46156 10.133.0.33:443 10.132.0.15:35360 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T11:09:24.946822Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T11:09:26.737437Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T11:09:26.878925Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T11:09:26.720Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 40 330 17 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "fc9ee6e0-8f8f-48d2-a1db-589bb6597630" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:57658 10.133.0.33:443 10.132.0.15:35364 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T11:09:26.867Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 479 11 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "cdb573ae-c895-4c61-aad3-ae076de57280" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:57658 10.133.0.33:443 10.132.0.15:35374 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T11:09:28.945627Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T11:09:32.952960Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T11:09:53.456911Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T11:10:05.878334Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T11:10:22.068543Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T11:10:22.103002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T11:10:22.050Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 17 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "10fa3217-54a6-46a0-bb12-3e1336458ad8" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:57658 10.133.0.33:443 10.132.0.15:55862 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T11:10:22.091Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 670 11 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "dc82c244-c2e6-4ecd-8b83-65e9c2cab45e" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:57658 10.133.0.33:443 10.132.0.15:55864 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T11:10:26.771575Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T11:10:28.986642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T11:10:29.019156Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T11:10:28.960Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 26 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "401f0792-dc48-43a1-9130-5aba99fa6234" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:42058 10.133.0.33:443 10.132.0.15:55876 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T11:10:29.007Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 11 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "d98591b9-d5cc-41c2-99a6-82842e2cc167" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:42058 10.133.0.33:443 10.132.0.15:55892 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T11:10:31.862583Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T11:10:38.812096Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T11:10:38.842764Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T11:10:39.017495Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T11:10:38.794Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 17 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "8ab70223-69fb-4e73-af08-92889ae24d73" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:57658 10.133.0.33:443 10.132.0.15:34392 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T11:10:38.831Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 11 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "ddd022ec-fdf6-48d1-8a23-ebaf8c471460" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:42058 10.133.0.33:443 10.132.0.15:34394 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T11:10:38.864Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 288 18 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "85af6055-ecd5-42ea-9bac-208b5598e8d3" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:45900 10.133.0.33:443 10.132.0.15:34396 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T11:10:38.902Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 289 15 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "82b9ba47-dc70-43e9-b722-ddb278a5aada" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.134.0.36:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:45900 10.133.0.33:443 10.132.0.15:34404 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T11:10:38.938Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "439818ff-04e6-41b0-b92e-367a27cb50a4" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:34418 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T11:10:38.975Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 12 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "b19da250-05a2-4719-a26e-3489e6b061a9" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:34430 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T11:10:39.006Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 10 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "d9482522-d3d9-47f0-9d40-66d66fd74160" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.42:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:57658 10.133.0.33:443 10.132.0.15:34442 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T11:10:41.055104Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-19T11:10:46.431Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 39 15 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "0ca6be94-fc39-49e4-abb9-01e13334a440" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:49644 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-19T11:10:48.927676Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-09-19T11:10:48.976797Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T11:10:52.494585Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T11:10:52.469Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 25 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "643aa841-e67a-42ba-a957-11aded31a33d" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.133.0.86:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:57078 10.133.0.33:443 10.132.0.15:60094 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T11:10:52.513Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 31 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "5a8471a7-30b2-4407-a3b8-f9fcca733854" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:54024 10.133.0.33:443 10.132.0.15:60102 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-19T11:10:52.663Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 17 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "e4b65d57-76be-4af4-9834-a51deed8d0be" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:54024 10.133.0.33:443 10.132.0.15:60104 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-19T11:10:52.801Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 17 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "5275814d-f4bb-4d1e-b89b-e27a8679c27d" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:54024 10.133.0.33:443 10.132.0.15:60108 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-19T11:10:52.936Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 15 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "150f11c8-5106-4929-9c5c-3ef5272f6642" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.33:443 10.132.0.15:60110 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-19T11:10:55.470962Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T11:11:01.446315Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T11:11:05.539418Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T11:11:05.512Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 26 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "2f879d4f-3cf6-402a-ba59-44126729436a" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.134.0.80:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.33:57758 10.133.0.33:443 10.132.0.15:60958 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T11:11:05.562Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 30 - "34.228.250.194,10.132.0.15" "python-requests/2.32.5" "375b8227-7440-43e5-ab75-add1dcc4b4f6" "maas.apps.98bc2981-e79b-4132-ac79-f057d6bc0e55.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.33:54024 10.133.0.33:443 10.132.0.15:60972 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-19T11:11:08.352839Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9