2026-09-19T01:21:28.546092Z info FLAG: --concurrency="0" 2026-09-19T01:21:28.546182Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-09-19T01:21:28.546188Z info FLAG: --help="false" 2026-09-19T01:21:28.546192Z info FLAG: --log_as_json="false" 2026-09-19T01:21:28.546195Z info FLAG: --log_caller="" 2026-09-19T01:21:28.546199Z info FLAG: --log_output_level="default:info" 2026-09-19T01:21:28.546202Z info FLAG: --log_stacktrace_level="default:none" 2026-09-19T01:21:28.546209Z info FLAG: --log_target="[stdout]" 2026-09-19T01:21:28.546213Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-09-19T01:21:28.546216Z info FLAG: --outlierLogPath="" 2026-09-19T01:21:28.546220Z info FLAG: --profiling="true" 2026-09-19T01:21:28.546223Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-09-19T01:21:28.546227Z info FLAG: --proxyLogLevel="warning" 2026-09-19T01:21:28.546230Z info FLAG: --serviceCluster="istio-proxy" 2026-09-19T01:21:28.546233Z info FLAG: --stsPort="0" 2026-09-19T01:21:28.546236Z info FLAG: --templateFile="" 2026-09-19T01:21:28.546239Z info FLAG: --tokenManagerPlugin="" 2026-09-19T01:21:28.546244Z info FLAG: --vklog="0" 2026-09-19T01:21:28.546249Z info Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean 2026-09-19T01:21:28.546438Z info Proxy role ips=[10.134.0.30] type=router id=maas-default-gateway-openshift-default-78bb78ff78-ks4rw.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-09-19T01:21:28.546512Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-09-19T01:21:28.548503Z info cpu limit detected as 2, setting concurrency 2026-09-19T01:21:28.548821Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-09-19T01:21:28.548832Z info JWT policy is third-party-jwt 2026-09-19T01:21:28.548835Z info using credential fetcher of JWT type in cluster.local trust domain 2026-09-19T01:21:28.551490Z info Opening status port 15020 2026-09-19T01:21:28.551501Z info Starting default Istio SDS Server 2026-09-19T01:21:28.551515Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-09-19T01:21:28.551532Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-09-19T01:21:28.552275Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-09-19T01:21:28.553830Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-09-19T01:21:28.554776Z info Starting proxy agent 2026-09-19T01:21:28.554808Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-09-19T01:21:28.570516Z info sds Starting SDS grpc server 2026-09-19T01:21:28.570538Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-09-19T01:21:28.612720Z warning envoy main external/envoy/source/server/server.cc:901 Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future. thread=9 2026-09-19T01:21:28.613036Z warning envoy main external/envoy/source/server/server.cc:997 There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. thread=9 2026-09-19T01:21:28.619444Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-09-19T01:21:28.709613Z info ads ADS: new connection for node:1 2026-09-19T01:21:28.710205Z info ads ADS: new connection for node:2 2026-09-19T01:21:29.009944Z info cache generated new workload certificate resourceName=default latency=457.364188ms ttl=23h59m59.990061703s 2026-09-19T01:21:29.009978Z info cache Root cert has changed, start rotating root cert 2026-09-19T01:21:29.010016Z info cache returned workload trust anchor from cache ttl=23h59m59.989983994s 2026-09-19T01:21:29.010035Z info cache returned workload certificate from cache ttl=23h59m59.989965101s 2026-09-19T01:21:29.010124Z info cache returned workload trust anchor from cache ttl=23h59m59.989879718s 2026-09-19T01:21:29.010456Z info cache returned workload trust anchor from cache ttl=23h59m59.989544894s 2026-09-19T01:21:29.055051Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:21:35.473097Z info Readiness succeeded in 6.929601319s 2026-09-19T01:21:35.473366Z info Envoy proxy is ready 2026-09-19T01:21:37.042263Z info ads ADS: new connection for node:3 2026-09-19T01:21:37.042393Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-19T01:21:37.042416Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-19T01:21:37.476358Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:21:48.200125Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:21:53.508446Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:22:20.523098Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:22:38.432138Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:22:44.953518Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:22:58.247855Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:24:59.031102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T01:24:59.003Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 27 - "52.71.36.72,10.132.0.16" "curl/7.76.1" "78038066-f00f-4aa8-9be9-da6b50af0d27" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42412 10.134.0.30:443 10.132.0.16:36150 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T01:24:59.120179Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:24:59.757163Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T01:24:59.082Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 37 - "52.71.36.72,10.132.0.16" "curl/7.76.1" "cbe3b70d-79e1-4bca-a346-f742ad22a35b" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42424 10.134.0.30:443 10.132.0.16:36158 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:24:59.170Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 501 55 - "52.71.36.72,10.132.0.16" "curl/7.76.1" "9cd7f30f-d701-4b2f-bfb1-e6ad5dee5e81" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35584 10.134.0.30:443 10.132.0.16:36166 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T01:24:59.267Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 334 19 - "52.71.36.72,10.132.0.16" "curl/7.76.1" "6b0ca173-767c-4561-9d59-3a29c47a2f28" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35594 10.134.0.30:443 10.132.0.16:36172 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T01:24:59.312Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 388 17 - "52.71.36.72,10.132.0.16" "curl/7.76.1" "c334ec9c-6761-41c5-a51a-497df0cc8046" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35584 10.134.0.30:443 10.132.0.16:36186 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T01:24:59.358Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 380 14 - "52.71.36.72,10.132.0.16" "curl/7.76.1" "1ad04c15-baad-484a-ba99-4be22ec2a9ea" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35594 10.134.0.30:443 10.132.0.16:36196 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T01:24:59.395Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "52.71.36.72,10.132.0.16" "curl/7.76.1" "865e9acb-e7ed-46e7-9a24-aefd1246a33a" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:36212 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T01:24:59.442Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "52.71.36.72,10.132.0.16" "curl/7.76.1" "45365d7b-5d77-4fb4-a911-9e94aa42bcca" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:36224 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T01:24:59.487Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "52.71.36.72,10.132.0.16" "curl/7.76.1" "a98de39c-ce28-49d0-b33c-2714841c936c" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:36226 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T01:24:59.533Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "52.71.36.72,10.132.0.16" "curl/7.76.1" "7750f3d3-5fb6-40c7-8b8a-0882bb62bc18" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:36232 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T01:24:59.569Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 15 - "52.71.36.72,10.132.0.16" "curl/7.76.1" "2fb051a5-79d2-4c74-bbe7-676f50caa52e" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:36236 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T01:24:59.608Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "52.71.36.72,10.132.0.16" "curl/7.76.1" "f1a66387-face-42c7-b95b-c6a47bebb64f" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:36242 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T01:24:59.668Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "52.71.36.72,10.132.0.16" "curl/7.76.1" "1716baa3-705a-40ad-bb48-71b9b5fb3e94" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:36244 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T01:24:59.705Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 0 4 - "52.71.36.72,10.132.0.16" "curl/7.76.1" "ee53d30c-2e5a-4a6a-952f-3517cbe146f5" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:36254 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T01:24:59.742Z] "DELETE /v1/api-keys/b5f8bd27-8f08-4039-b2ab-1855d378e6ee HTTP/1.1" 200 - via_upstream - "-" 0 365 14 - "52.71.36.72,10.132.0.16" "curl/7.76.1" "15971a92-91ac-4e98-9512-fbf527022651" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42424 10.134.0.30:443 10.132.0.16:36264 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T01:25:00.022722Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:25:00.060840Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T01:25:00.018Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "52.71.36.72,10.132.0.16" "curl/7.76.1" "7c9adcf7-fb5f-4b0a-85e7-bdeac8d920e4" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42424 10.134.0.30:443 10.132.0.16:36270 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-19T01:25:00.048Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 11 - "52.71.36.72,10.132.0.16" "curl/7.76.1" "01428396-d3a9-4aaa-b279-b9f8c7ec9e85" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42412 10.134.0.30:443 10.132.0.16:36278 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T01:25:09.947025Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:25:10.008170Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:25:10.048635Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:25:10.090276Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-09-19T01:25:10.096191Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T01:25:10.096337Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-09-19T01:25:10.100108Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-09-19T01:25:10.102285Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:25:10.137901Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:25:10.138077Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-09-19T01:25:10.186608Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T01:25:10.367760Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:25:10.399245Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:25:10.459184Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:25:10.492593Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:25:10.574964Z info ads ADS: new connection for node:4 2026-09-19T01:25:10.578132Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-09-19T01:25:10.578178Z info cache read certificate from file resource=file-root:system 2026-09-19T01:25:10.682088Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:25:10.721091Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T01:25:10.791523Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T01:25:10.826661Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T01:25:09.943Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "b7af6d23-385f-438d-a005-11e8f35a4f55" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42424 10.134.0.30:443 10.132.0.16:52522 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-19T01:25:09.968Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 0 5 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "005f09ba-3757-4d03-93a1-5c77b43d621e" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.30:443 10.132.0.16:52524 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:09.995Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 12 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "d5faff90-b139-4d3c-a0f1-2d69b0a55d02" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42424 10.134.0.30:443 10.132.0.16:52536 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:10.030Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 17 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "949b358e-89c0-4747-b34b-d1ede1b7e462" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42424 10.134.0.30:443 10.132.0.16:52546 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:10.071Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 111 126 24 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "2fac2902-1659-415a-8c90-ed309f55fbc3" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35594 10.134.0.30:443 10.132.0.16:52552 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-19T01:25:10.088Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 13 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "e61f22c6-3f32-4669-9a50-fc33a38e4a6f" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42424 10.134.0.30:443 10.132.0.16:52554 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:10.119Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 18 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "2db869ef-4e5a-4663-9dee-c3d787acdd1b" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35584 10.134.0.30:443 10.132.0.16:52566 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:25:10.130Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 8 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "1cead944-2225-4666-8cf5-52a6768aaa66" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.30:443 10.132.0.16:52572 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:10.170Z] "DELETE /v1/api-keys/e424a519-19ef-4e01-babf-5dcb6d042300 HTTP/1.1" 200 - via_upstream - "-" 0 370 16 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "822e8dac-e737-44fd-84fe-3b0d4049d208" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42412 10.134.0.30:443 10.132.0.16:52580 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:10.353Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "8918d5dc-d2ee-4063-8b79-affd36920fa7" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42424 10.134.0.30:443 10.132.0.16:52590 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:10.386Z] "DELETE /v1/api-keys/6e1cf1f3-c6cc-413a-b845-f9349e624f2e HTTP/1.1" 200 - via_upstream - "-" 0 321 12 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "31596bd3-c018-4da5-9ef6-eb08703e1a70" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42424 10.134.0.30:443 10.132.0.16:52606 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:10.418Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 10 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "19ae0ccf-4c3c-4a79-8c40-41126bdf3db3" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.30:443 10.132.0.16:52616 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:10.446Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 12 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "428642e3-0f6b-40ab-99ec-4b1aff300eeb" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42424 10.134.0.30:443 10.132.0.16:52630 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:10.479Z] "DELETE /v1/api-keys/e6757377-3cd5-484e-9cd9-3806fcc4430b HTTP/1.1" 200 - via_upstream - "-" 0 321 13 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "a2bc6e2f-e40a-426e-af0e-9537289d8d88" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42424 10.134.0.30:443 10.132.0.16:52642 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:10.666Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 16 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "40f66497-de2a-4da7-867f-a26c1a87f019" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42424 10.134.0.30:443 10.132.0.16:52650 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:10.703Z] "DELETE /v1/api-keys/b040f8fb-8fd0-4b84-8791-0dc02988d0e8 HTTP/1.1" 200 - via_upstream - "-" 0 321 17 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "292be1cf-6b05-4347-8398-8da22c53a3bc" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42412 10.134.0.30:443 10.132.0.16:52654 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:10.740Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 14 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "35ce228c-ec8c-40df-8deb-a59ab2dc578a" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.30:443 10.132.0.16:52660 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:10.774Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 17 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "84227e3a-05ae-4701-b44e-01f469fe9601" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42412 10.134.0.30:443 10.132.0.16:52666 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:10.811Z] "DELETE /v1/api-keys/05554629-6dfe-4525-b1a9-46c8e7cc8563 HTTP/1.1" 200 - via_upstream - "-" 0 321 15 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "8225834d-e6ea-438a-8ed8-1a5d5b6b4278" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42424 10.134.0.30:443 10.132.0.16:52676 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T01:25:10.991306Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:25:11.030137Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T01:25:11.099589Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:25:11.150054Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T01:25:11.323044Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:25:11.514436Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T01:25:10.974Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 17 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "88d68876-8e02-4b7e-b30d-4e9ff7ab01f8" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42424 10.134.0.30:443 10.132.0.16:52682 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:11.011Z] "DELETE /v1/api-keys/d7004155-247a-4ef6-a8b2-329c1dba40fd HTTP/1.1" 200 - via_upstream - "-" 0 321 19 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "be66594b-7eb5-4ff2-9cf8-bac5c9dd62e8" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42412 10.134.0.30:443 10.132.0.16:52694 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:11.051Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 13 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "b1c88d80-665d-4279-8833-5caa55b1ac0f" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.30:443 10.132.0.16:52696 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:11.083Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 16 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "5ccae71a-422b-487d-a2e4-980eec8b43d3" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42424 10.134.0.30:443 10.132.0.16:52700 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:11.118Z] "DELETE /v1/api-keys/9484017b-5625-4a39-8b5b-41b6a7ee4d47 HTTP/1.1" 200 - via_upstream - "-" 0 321 31 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "953604e4-6493-4c5d-9d9f-8cb16748b17e" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42412 10.134.0.30:443 10.132.0.16:52708 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:11.309Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 13 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "8c0c29fe-9117-4a3c-835e-de1b5083169c" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42424 10.134.0.30:443 10.132.0.16:52724 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:11.341Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 13 10 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "eae4a121-a452-470f-90d8-a208751a2273" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:52740 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:25:11.499Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "1eb1da3e-0c9a-474f-903c-84004ce81ffe" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42412 10.134.0.30:443 10.132.0.16:52750 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T01:25:16.109417Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:25:17.673552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T01:25:17.656Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 17 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "0cabd539-fa20-4778-90c1-401eed02e8f4" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42412 10.134.0.30:443 10.132.0.16:42716 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T01:25:18.209437Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:25:18.209582Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-09-19T01:25:18.064Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 403 - - "-" 83 0 13 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "8b19243a-11d4-47e1-8e15-40c8ae2f162d" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.30:443 10.132.0.16:42728 - llm.e2e-external-model.0 [2026-09-19T01:25:18.103Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 14 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "4e2378f8-f35d-43a5-bb07-68120333b981" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.30:443 10.132.0.16:42740 - llm.e2e-external-model.0 [2026-09-19T01:25:18.139Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 70 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "9da26626-a61e-4110-bda3-967686bbb876" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.30:44174 10.134.0.30:443 10.132.0.16:42752 - llm.e2e-external-model.1 2026-09-19T01:25:19.634402Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T01:25:19.542Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 18 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "10a4f93c-3702-46b8-8336-e84577f34ce5" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35594 10.134.0.30:443 10.132.0.16:42762 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:25:19.579Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 18 - "52.71.36.72,10.132.0.16" "-" "7663c4ad-498f-4c90-b8bd-36dab2e68b82" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35584 10.134.0.30:443 10.132.0.16:42772 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:25:19.620Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 14 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "7a87d053-3068-4b70-b17f-ed9ff5f7c073" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42412 10.134.0.30:443 10.132.0.16:42782 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T01:25:22.973634Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-19T01:25:24.661Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 16 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "199a8fdc-7cc6-48f6-b953-d92375a1703e" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:42792 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:25:26.142Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 5 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "b071afe0-d487-4302-922d-aecdb709734c" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" - - 10.134.0.30:443 10.132.0.16:42804 - - [2026-09-19T01:25:30.903Z] "POST /llm/nonexistent-model-xyz/v1/chat/completions HTTP/1.1" 404 NR route_not_found - "-" 86 0 12 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "b3c36a3b-547e-4ab1-8b95-579a6b6933c0" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" - - 10.134.0.30:443 10.132.0.16:39866 - - 2026-09-19T01:25:31.813999Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:25:33.341511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T01:25:33.320Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 21 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "6ae81d76-d29e-4c38-8878-88dda661c4bb" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42424 10.134.0.30:443 10.132.0.16:39882 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:33.363Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 11 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "5aa154f8-709b-4441-ace5-c4822d2d8209" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:39894 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-19T01:25:34.939859Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:25:34.940212Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-09-19T01:25:35.025727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:25:35.025989Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-09-19T01:25:35.133844Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T01:25:35.134173Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-19T01:25:34.865Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 75 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "62b9d410-3f07-4a3c-89f8-edf307c4317b" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.30:35986 10.134.0.30:443 10.132.0.16:39904 - llm.e2e-external-model.1 [2026-09-19T01:25:34.964Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 82 39 61 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "1beac627-1cf0-4d70-be56-8ca5b991f1eb" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.30:35986 10.134.0.30:443 10.132.0.16:39908 - llm.e2e-external-model.2 [2026-09-19T01:25:35.053Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 52 39 80 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "da68ef52-7ed3-9137-aa6b-dc5ff392bacd" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.30:35988 10.134.0.30:443 10.132.0.16:39922 - llm.e2e-external-model.2 2026-09-19T01:25:36.372015Z info ads ADS: "" 4 terminated with stream closed 2026-09-19T01:25:39.737937Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T01:25:39.719Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 18 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "9452bb9f-8d3f-4fa6-8472-44c0ca4a6ed1" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42412 10.134.0.30:443 10.132.0.16:40670 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:25:39.758Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 295 27 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "46c5624d-91f5-45e1-8953-eb1de9248899" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35594 10.134.0.30:443 10.132.0.16:40674 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:25:39.809Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 295 32 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "f7ce345d-a1b0-43e9-ad06-bddc7d2e4f1a" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35594 10.134.0.30:443 10.132.0.16:40682 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:25:39.862Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 22 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "51d8a199-f9ea-4ce1-8072-643c6f73f1a0" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35594 10.134.0.30:443 10.132.0.16:40694 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:25:39.904Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 34 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "f9c9277f-1c60-4daa-80be-502f25386b5f" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35584 10.134.0.30:443 10.132.0.16:40706 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T01:25:44.449647Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:25:57.365148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T01:25:57.525532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T01:25:57.022Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 5 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "d1de5b6a-71f6-470f-84c9-856bc5fa1a7f" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" - - 10.134.0.30:443 10.132.0.16:54610 - - [2026-09-19T01:25:57.178Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 4 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "78ba01f4-65ef-44d0-b2d5-5927aadc2f8d" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" - - 10.134.0.30:443 10.132.0.16:54622 - - [2026-09-19T01:25:57.335Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 4 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "ac905f48-ecfd-409d-a036-e52289f37f1c" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" - - 10.134.0.30:443 10.132.0.16:54638 - - [2026-09-19T01:25:57.361Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "645e9f10-bce1-48a0-b078-c56a4b5b8144" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42412 10.134.0.30:443 10.132.0.16:54644 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-19T01:25:57.513Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 12 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "5ea1f135-a0cc-489a-900a-3288c668bae4" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:42424 10.134.0.30:443 10.132.0.16:54654 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T01:29:53.675887Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:30:00.285861Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:41:34.015178Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T01:41:33.990Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 312 24 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "2e952273-dd11-4374-8291-ef98b66e9b11" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:54772 10.134.0.30:443 10.132.0.16:54800 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:41:34.043Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 321 31 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "2eef003f-8052-4466-8a9e-0892260a844d" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35594 10.134.0.30:443 10.132.0.16:54810 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-19T01:41:34.096Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 320 17 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "71ebe6ec-e4f7-4aed-a382-c9ebfb95be52" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35594 10.134.0.30:443 10.132.0.16:54826 - llm.facebook-opt-125m-simulated-kserve-route.2 2026-09-19T01:45:27.053626Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T01:45:27.033Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 20 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "318a9910-e92d-4275-bd68-62c1f6bfa1d8" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:58506 10.134.0.30:443 10.132.0.16:37800 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T01:45:29.026069Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T01:45:29.011Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 14 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "4b9b10f1-c58e-47da-bb36-b35fd9ca0a6c" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:58506 10.134.0.30:443 10.132.0.16:37808 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T01:45:29.861892Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:46:54.265239Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:46:54.657330Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T01:46:54.642Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 15 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "272f951a-5e7d-4f08-8b3a-78ae5d7b5968" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:51992 10.134.0.30:443 10.132.0.16:35144 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T01:47:07.935705Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T01:47:07.910Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 25 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "dd6438dd-1914-4542-8a32-aa7c29cac560" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:51992 10.134.0.30:443 10.132.0.16:47978 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:47:13.473Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 31 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "7236aee9-5597-4588-b188-12793c76cd7c" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35584 10.134.0.30:443 10.132.0.16:47990 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:47:13.529Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 0 5 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "5181cbef-2189-4c79-a518-1109e6b43851" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:47996 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:47:13.595Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 17 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "a2695ef5-4934-4838-90c6-6318cdf6db86" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35584 10.134.0.30:443 10.132.0.16:48012 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:47:13.644Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 0 4 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "1675afe9-6233-437d-88df-62d33d911cc4" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:48026 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:47:13.689Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 0 4 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "46558ae0-d089-4a6a-b999-4355f15ee23d" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:48040 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:47:13.711Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 18 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "c044b4be-87a7-4b45-b65d-987c17e92e37" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35594 10.134.0.30:443 10.132.0.16:48050 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T01:47:33.342430Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:47:36.804731Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T01:47:36.786Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 330 18 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "4fc48552-116d-40e4-8b36-c9f54fd13cb1" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:51992 10.134.0.30:443 10.132.0.16:45996 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:47:36.823Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 30 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "1e0ed386-12ab-4333-b643-fe3c02e5c5bb" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:53262 10.134.0.30:443 10.132.0.16:45998 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:47:36.978Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 19 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "c4227b22-5266-495a-94fb-c142a5f76c8c" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:53268 10.134.0.30:443 10.132.0.16:46010 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:47:37.116Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 16 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "de045fd2-c6f7-4439-9136-d6bb69d58249" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:53268 10.134.0.30:443 10.132.0.16:46024 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:47:37.256Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 16 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "bc39af19-47e2-4e8f-b42b-e1fd567d8444" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:53268 10.134.0.30:443 10.132.0.16:46040 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:47:37.392Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 16 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "2c37e0b6-b39e-4d1f-9d1b-ed758dc2d865" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:53268 10.134.0.30:443 10.132.0.16:46042 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:47:37.527Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "31b1979a-102e-4a9f-8972-c29ab23a3fdb" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:46046 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-19T01:47:41.261950Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:47:45.261410Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:47:52.547231Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T01:47:52.739337Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T01:47:52.529Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 17 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "d7bed7f6-56d8-4f8d-bf5e-cfcdfac97929" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:36312 10.134.0.30:443 10.132.0.16:58912 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:47:52.570Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 288 19 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "437ea722-e2d8-49e7-8f80-d2543df39839" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:53262 10.134.0.30:443 10.132.0.16:58920 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:47:52.609Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 16 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "184d34ec-30c0-44ef-ac1e-c8252f549e1e" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:53268 10.134.0.30:443 10.132.0.16:58928 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:47:52.643Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "16bb1fb8-a7ba-4c80-ae70-522c3ea7929c" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:58932 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:47:52.678Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "1e4ac28b-6645-408c-a4ea-e9a0709ff35e" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:58944 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:47:52.724Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 14 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "e4255410-5695-4b2a-9d40-19e9c9e95308" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:53262 10.134.0.30:443 10.132.0.16:58958 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.6 2026-09-19T01:47:53.555584Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T01:47:53.541Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 13 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "cc78a2c2-fc74-450a-baf8-c13c71646e9a" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:51992 10.134.0.30:443 10.132.0.16:58968 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:47:53.576Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 17 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "64d9ab3c-27df-4b4e-bb82-72c354931f70" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35584 10.134.0.30:443 10.132.0.16:58970 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:47:54.593Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 19 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "195c6727-9126-4e5b-85ab-36c48c54e0bc" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35584 10.134.0.30:443 10.132.0.16:58972 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:47:55.387Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 18 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "a834b8e5-65da-46e6-b12d-2a20434558ee" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35594 10.134.0.30:443 10.132.0.16:58974 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T01:47:56.138691Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-19T01:47:56.501Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 18 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "d1f92e17-b7ed-4d34-b319-8f0867120f99" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35584 10.134.0.30:443 10.132.0.16:40688 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:48:01.984Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 11 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "02022cfe-ab15-4e2c-a70a-7ba0fca1830e" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:40696 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:48:07.134Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 11 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "411045a8-d003-422e-8706-e3d05c950447" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:33514 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-19T01:48:08.015952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T01:48:08.001Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "3565b7a0-9220-4917-964a-ebe66cfb0a04" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:36312 10.134.0.30:443 10.132.0.16:33518 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:48:08.390Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 11 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "e9dc7e08-6d59-4fe0-bfd0-be3be8dca153" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:33526 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T01:48:11.053993Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:48:15.180966Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:48:16.479935Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T01:48:16.462Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 328 17 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "939fb38d-2b74-4607-a322-f1c6a976d665" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:36312 10.134.0.30:443 10.132.0.16:39766 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:48:16.505Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 23 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "c532ce8b-e3c5-4969-a7a3-e29b0c9f0478" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.23:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:35584 10.134.0.30:443 10.132.0.16:39774 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T01:48:17.854396Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T01:48:17.839Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 15 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "96b22a36-0e7d-492d-aa4e-323dad550968" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:51992 10.134.0.30:443 10.132.0.16:39776 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:48:18.208Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 10 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "53016d48-7de5-49ae-9250-c0b6b1445a68" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:39790 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T01:48:19.451666Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:49:26.343389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T01:49:26.325Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 17 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "3276fc69-a39c-42c0-a6b1-847390017db5" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:47564 10.134.0.30:443 10.132.0.16:33142 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:49:26.369Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 49 20 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "6fc18495-a23c-4791-a5f5-fc6f4830f236" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:33152 - llm.e2e-trlp-test-simulated-kserve-route.0 2026-09-19T01:49:47.869324Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:49:49.125700Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T01:49:48.460Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 288 52 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "342d301e-ef00-4abc-ab24-0c115aeb3e0a" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.133.0.22:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:46400 10.134.0.30:443 10.132.0.16:33346 - llm.e2e-trlp-test-simulated-kserve-route.0 [2026-09-19T01:49:49.109Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 15 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "d8aad369-6f85-4df5-bb91-d0731900cf3d" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:39664 10.134.0.30:443 10.132.0.16:33356 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T01:49:51.953953Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:49:55.755686Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:49:57.636193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T01:49:57.785744Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T01:49:57.615Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 40 329 20 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "c6a0d947-2d37-4195-a34b-fc75fcb9e641" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:39664 10.134.0.30:443 10.132.0.16:33914 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:49:57.775Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 479 10 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "6ae3967a-8f1d-9b9e-bd9d-f5f7c6dca96e" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:39664 10.134.0.30:443 10.132.0.16:33924 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T01:50:01.740611Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:50:14.957006Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:50:25.255715Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:50:38.661486Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T01:50:38.697253Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T01:50:38.644Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 16 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "8d58fe30-00de-44f0-ab85-e211a1eef5c2" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:39664 10.134.0.30:443 10.132.0.16:34238 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:50:38.684Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 670 12 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "94f0b7ce-9c8a-4c14-bdab-8ce33b0cd1f2" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:34796 10.134.0.30:443 10.132.0.16:34246 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T01:50:42.757840Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:50:47.362187Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:50:48.698940Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:50:48.735887Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T01:50:48.682Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 16 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "c1041bce-9548-4bb9-9dad-03e781ca047d" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:34796 10.134.0.30:443 10.132.0.16:35944 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:50:48.724Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 11 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "3ba8a5f7-f471-47b4-83e7-01b45dc85c52" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:39664 10.134.0.30:443 10.132.0.16:35946 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T01:50:51.780378Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:50:58.629385Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T01:50:58.658931Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T01:50:58.802909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T01:50:58.614Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 14 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "780b753d-883d-4435-b0a7-7ce9a3c06f57" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:34796 10.134.0.30:443 10.132.0.16:55878 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:50:58.648Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 10 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "31cc6857-a122-4f67-b2c1-8c1b059d2322" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:39664 10.134.0.30:443 10.132.0.16:55882 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:50:58.685Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 17 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "e7d38915-6b1d-9dcf-a9f8-03e803604eb1" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.35:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:53262 10.134.0.30:443 10.132.0.16:55884 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:50:58.723Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "488fcbc7-d463-4929-81ff-52aa9e2be0f6" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:55888 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:50:58.759Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "8661a319-0dd1-463b-8c55-bc5af3df3e85" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:55896 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T01:50:58.793Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 9 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "31b2c584-358b-433c-baa6-b411e6cf4821" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.32:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:39664 10.134.0.30:443 10.132.0.16:55904 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T01:51:00.940847Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-19T01:51:06.461Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 39 15 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "07bac53d-7a01-4a32-b44d-2f2e77cda4c9" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:42494 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-19T01:51:08.853824Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:51:17.602726Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T01:51:17.583Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 19 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "8d044d44-473f-455e-9c28-e3096b77cc5e" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.132.0.104:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:37076 10.134.0.30:443 10.132.0.16:53014 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:51:17.625Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 42 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "5f020757-4e4a-4699-8385-95dbfa4a64d1" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:42162 10.134.0.30:443 10.132.0.16:53022 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-19T01:51:17.793Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 22 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "f8e000f4-cb85-4c57-9564-bd8863198b06" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:42166 10.134.0.30:443 10.132.0.16:53024 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-19T01:51:17.940Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 18 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "377fb52f-7901-49cc-9806-00efca1c9f57" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:42162 10.134.0.30:443 10.132.0.16:53038 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-19T01:51:18.085Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 15 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "85ef95a9-434a-4102-aab7-9307bbf4b4b3" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.30:443 10.132.0.16:53040 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-19T01:51:20.243305Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:51:26.260035Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-19T01:51:30.769820Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T01:51:30.746Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 22 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "116b3c18-ec50-4130-9ecf-09f1a1971d9a" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.75:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.30:39584 10.134.0.30:443 10.132.0.16:57540 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T01:51:30.795Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 20 - "52.71.36.72,10.132.0.16" "python-requests/2.32.5" "78be36ef-b44e-4132-be23-c0d07679240e" "maas.apps.e00bdbeb-98f4-4a28-aa35-7a41a8abe93f.prod.konfluxeaas.com" "10.134.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.30:42162 10.134.0.30:443 10.132.0.16:57552 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-19T01:51:33.546153Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9