2026-09-18T18:00:23.620201Z info FLAG: --concurrency="0" 2026-09-18T18:00:23.620223Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-09-18T18:00:23.620228Z info FLAG: --help="false" 2026-09-18T18:00:23.620232Z info FLAG: --log_as_json="false" 2026-09-18T18:00:23.620235Z info FLAG: --log_caller="" 2026-09-18T18:00:23.620238Z info FLAG: --log_output_level="default:info" 2026-09-18T18:00:23.620241Z info FLAG: --log_stacktrace_level="default:none" 2026-09-18T18:00:23.620249Z info FLAG: --log_target="[stdout]" 2026-09-18T18:00:23.620253Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-09-18T18:00:23.620256Z info FLAG: --outlierLogPath="" 2026-09-18T18:00:23.620258Z info FLAG: --profiling="true" 2026-09-18T18:00:23.620260Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-09-18T18:00:23.620262Z info FLAG: --proxyLogLevel="warning" 2026-09-18T18:00:23.620264Z info FLAG: --serviceCluster="istio-proxy" 2026-09-18T18:00:23.620266Z info FLAG: --stsPort="0" 2026-09-18T18:00:23.620268Z info FLAG: --templateFile="" 2026-09-18T18:00:23.620270Z info FLAG: --tokenManagerPlugin="" 2026-09-18T18:00:23.620272Z info FLAG: --vklog="0" 2026-09-18T18:00:23.620275Z info Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean 2026-09-18T18:00:23.620424Z info Proxy role ips=[10.133.0.30] type=router id=maas-default-gateway-openshift-default-78bb78ff78-62zx7.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-09-18T18:00:23.620473Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-09-18T18:00:23.621624Z info cpu limit detected as 2, setting concurrency 2026-09-18T18:00:23.621924Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-09-18T18:00:23.621940Z info JWT policy is third-party-jwt 2026-09-18T18:00:23.621943Z info using credential fetcher of JWT type in cluster.local trust domain 2026-09-18T18:00:23.624153Z info Starting default Istio SDS Server 2026-09-18T18:00:23.624167Z info Opening status port 15020 2026-09-18T18:00:23.624173Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-09-18T18:00:23.624233Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-09-18T18:00:23.624965Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-09-18T18:00:23.625684Z info sds Starting SDS grpc server 2026-09-18T18:00:23.625701Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-09-18T18:00:23.626243Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-09-18T18:00:23.627071Z info Starting proxy agent 2026-09-18T18:00:23.627112Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-09-18T18:00:23.683559Z warning envoy main external/envoy/source/server/server.cc:901 Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future. thread=9 2026-09-18T18:00:23.683851Z warning envoy main external/envoy/source/server/server.cc:997 There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. thread=9 2026-09-18T18:00:23.689005Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-09-18T18:00:23.782108Z info ads ADS: new connection for node:1 2026-09-18T18:00:23.782587Z info ads ADS: new connection for node:2 2026-09-18T18:00:24.063395Z info cache generated new workload certificate resourceName=default latency=437.596523ms ttl=23h59m59.936610687s 2026-09-18T18:00:24.063430Z info cache Root cert has changed, start rotating root cert 2026-09-18T18:00:24.063465Z info cache returned workload trust anchor from cache ttl=23h59m59.936535386s 2026-09-18T18:00:24.063483Z info cache returned workload certificate from cache ttl=23h59m59.93651724s 2026-09-18T18:00:24.063569Z info cache returned workload trust anchor from cache ttl=23h59m59.93643407s 2026-09-18T18:00:24.063858Z info cache returned workload trust anchor from cache ttl=23h59m59.936142329s 2026-09-18T18:00:24.107636Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:00:30.558506Z info Readiness succeeded in 6.940449061s 2026-09-18T18:00:30.558783Z info Envoy proxy is ready 2026-09-18T18:00:35.274102Z info ads ADS: new connection for node:3 2026-09-18T18:00:35.274267Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-18T18:00:35.274299Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-18T18:00:35.434215Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:00:46.341064Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:01:06.745394Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:01:17.138578Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:01:25.277021Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:01:33.098743Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:01:53.077437Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:03:11.822605Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-18T18:03:11.788Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 33 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "78f49439-a605-4a0b-8bbf-3d779a95b95e" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35572 10.133.0.30:443 10.132.0.9:46254 - odh-ai-gateway-infra.maas-api-route.3 2026-09-18T18:03:11.907783Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-18T18:03:12.551596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-18T18:03:11.869Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 37 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "ffddcecf-9b0d-4fc2-87cc-bea5309e3e9a" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35578 10.133.0.30:443 10.132.0.9:46262 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:11.973Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 377 58 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "d9448822-2e50-4e82-b5de-ebca9e0f2fb9" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54876 10.133.0.30:443 10.132.0.9:46278 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-18T18:03:12.074Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 336 22 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "72f32263-c837-408b-8551-58b7bf1560db" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54878 10.133.0.30:443 10.132.0.9:46290 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-18T18:03:12.126Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 464 17 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "b588a7b8-44e3-46ca-a269-34d34d83c11f" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54876 10.133.0.30:443 10.132.0.9:46304 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-18T18:03:12.177Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 334 16 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "3ab8c8aa-9968-47b7-af03-3ab80060f775" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54876 10.133.0.30:443 10.132.0.9:46316 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-18T18:03:12.217Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 316 17 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "3a3f1b50-41c4-423e-ba23-6f1a114f98b5" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54878 10.133.0.30:443 10.132.0.9:46326 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-18T18:03:12.261Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "fcc2f72c-c4cb-4bc1-8767-cd984f4bc0bb" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:46328 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-18T18:03:12.299Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "c0eed68d-d89e-4a32-b6cf-a083313cebdc" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:46344 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-18T18:03:12.342Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "119903df-9938-4667-9a7d-e5ad326a8e7f" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:46354 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-18T18:03:12.380Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "0edfdee3-97c4-4d49-a1e1-eb3294300916" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:46358 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-18T18:03:12.424Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "dca510b3-5041-4c54-aef2-77a2ec65b6eb" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:46370 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-18T18:03:12.461Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "c48c3c3d-7f47-4c90-aacc-ceee4c684150" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:46372 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-18T18:03:12.501Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 0 5 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "a2016cac-d36f-4a7b-9596-c958784e440c" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:46380 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-18T18:03:12.535Z] "DELETE /v1/api-keys/ce8d8c1b-ec94-43fe-8ec7-f392db61f0f7 HTTP/1.1" 200 - via_upstream - "-" 0 365 16 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "f7e97474-7fd5-4ebd-a860-2118381b6f19" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35578 10.133.0.30:443 10.132.0.9:46388 - odh-ai-gateway-infra.maas-api-route.3 2026-09-18T18:03:12.814758Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-18T18:03:12.851461Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-09-18T18:03:12.851578Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-18T18:03:12.810Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 4 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "d6c705a3-a2c3-4fcd-b3c9-93bb5e27e3ac" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35572 10.133.0.30:443 10.132.0.9:46402 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-18T18:03:12.838Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 13 - "44.212.242.249,10.132.0.9" "curl/7.76.1" "f3efeeb3-6f12-45f8-a264-21b7939c30ea" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35572 10.133.0.30:443 10.132.0.9:46412 - odh-ai-gateway-infra.maas-api-route.3 2026-09-18T18:03:23.657309Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-18T18:03:23.728627Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-18T18:03:23.652Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 5 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "f23d6291-1f61-4539-b780-26ac84b8dd5d" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35578 10.133.0.30:443 10.132.0.9:37902 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-18T18:03:23.683Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 0 6 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "4973f8c1-3b06-4ee3-9386-d7bbf531a69a" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.30:443 10.132.0.9:37918 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:23.715Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 13 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "bfcb925d-fcc1-4d69-8a77-c2de49743127" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35578 10.133.0.30:443 10.132.0.9:37926 - odh-ai-gateway-infra.maas-api-route.3 2026-09-18T18:03:23.770106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-18T18:03:23.811447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-18T18:03:23.811591Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-09-18T18:03:23.815900Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-18T18:03:23.864389Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-18T18:03:23.864532Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-09-18T18:03:23.879717Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-18T18:03:24.050727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-09-18T18:03:24.053605Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-18T18:03:24.085905Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-18T18:03:24.174603Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-18T18:03:24.215037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-18T18:03:24.408308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-18T18:03:24.446282Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-18T18:03:24.530239Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-18T18:03:24.569577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-18T18:03:24.620946Z info ads ADS: new connection for node:4 2026-09-18T18:03:24.626233Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-09-18T18:03:24.626288Z info cache read certificate from file resource=file-root:system [2026-09-18T18:03:23.755Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 14 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "6226f2ee-abf3-4881-a2fa-4c2b07e5aa90" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35572 10.133.0.30:443 10.132.0.9:37932 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:23.791Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 111 126 20 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "8391555e-1375-44ac-842c-9f6babd58456" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54876 10.133.0.30:443 10.132.0.9:37938 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-18T18:03:23.801Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 14 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "6d3ea2ce-ec7d-476a-bf4d-6c82f8e0e012" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35578 10.133.0.30:443 10.132.0.9:37952 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:23.835Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 10 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "9e0da8af-70dc-4169-8f1b-96a9dd1292cb" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.30:443 10.132.0.9:37982 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:23.835Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 29 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "a94d4c18-2c7b-4fa6-ab83-c51af7b50565" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54876 10.133.0.30:443 10.132.0.9:37968 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:03:23.865Z] "DELETE /v1/api-keys/7889765a-ae7f-452a-8506-410bd676a38b HTTP/1.1" 200 - via_upstream - "-" 0 370 14 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "630a60d3-9bd5-44bf-ad86-bbbc23ac69db" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35572 10.133.0.30:443 10.132.0.9:37992 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:24.037Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 312 15 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "c84b9883-a2cd-4bea-9fd5-bb886f332949" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35578 10.133.0.30:443 10.132.0.9:37998 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:24.072Z] "DELETE /v1/api-keys/5098eabf-b811-402a-b00b-efae4d157153 HTTP/1.1" 200 - via_upstream - "-" 0 321 13 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "53328cc5-62d5-4058-b92b-1512828ca394" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35572 10.133.0.30:443 10.132.0.9:38000 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:24.106Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 11 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "f816e80c-b2da-4861-9ccf-f88d0f138ba1" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.30:443 10.132.0.9:38008 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:24.135Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 39 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "90a63a58-e113-4280-b800-9719b5f2d5e0" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35572 10.133.0.30:443 10.132.0.9:38024 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:24.197Z] "DELETE /v1/api-keys/cc9d64f4-caae-4a7a-ac55-2fda9365f5f9 HTTP/1.1" 200 - via_upstream - "-" 0 321 17 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "c00259b9-3500-4966-94e9-54e8363ada1e" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35578 10.133.0.30:443 10.132.0.9:38034 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:24.391Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "74885a32-8a56-4d30-a42b-3219fe393f3f" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35572 10.133.0.30:443 10.132.0.9:38048 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:24.427Z] "DELETE /v1/api-keys/49407116-99f5-428a-aa91-873b033fabcd HTTP/1.1" 200 - via_upstream - "-" 0 321 18 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "34314fd7-1ac0-4973-be6b-33979be64339" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35572 10.133.0.30:443 10.132.0.9:38064 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:24.467Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 11 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "ac57fad6-f3ba-41b0-a30a-773c89145563" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.30:443 10.132.0.9:38074 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:24.496Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 33 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "33139e89-bef7-45b5-87db-a2a8db92fb41" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35578 10.133.0.30:443 10.132.0.9:38078 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:24.547Z] "DELETE /v1/api-keys/d0567333-66c1-418d-9a6e-20cd78f78f83 HTTP/1.1" 200 - via_upstream - "-" 0 321 22 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "ae23d7a1-7887-46ce-88b6-ee09dc5601ab" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35578 10.133.0.30:443 10.132.0.9:38086 - odh-ai-gateway-infra.maas-api-route.3 2026-09-18T18:03:24.748279Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-18T18:03:24.790163Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-18T18:03:24.870106Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-18T18:03:24.906482Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-18T18:03:25.078110Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-18T18:03:25.293018Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-18T18:03:24.721Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 26 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "91886e75-e1ce-4874-a2b9-4ebfced6c413" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35572 10.133.0.30:443 10.132.0.9:38100 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:24.766Z] "DELETE /v1/api-keys/9bd3f326-b51c-42b9-801b-c0c2e9276673 HTTP/1.1" 200 - via_upstream - "-" 0 321 23 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "820c08b2-2da9-4b2c-a5b3-bb347d680bdc" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35578 10.133.0.30:443 10.132.0.9:35376 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:24.823Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 12 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "0b4bdedc-eefe-400f-a509-bf7dc7fa775a" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.133.0.30:443 10.132.0.9:35378 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:24.853Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "ba03a0fc-53d6-4097-8d09-92edcc42258f" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35572 10.133.0.30:443 10.132.0.9:35390 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:24.888Z] "DELETE /v1/api-keys/f0fef6d4-0f86-4802-ade4-f0f20e97fc84 HTTP/1.1" 200 - via_upstream - "-" 0 321 18 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "5dc0648a-ec8f-4d93-9294-725c969a4016" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35572 10.133.0.30:443 10.132.0.9:35402 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:25.061Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "a5fe2ec4-4a18-4bbf-8667-30edf97261bc" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35578 10.133.0.30:443 10.132.0.9:35412 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:25.097Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 13 12 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "fd4ad55b-92d6-4257-b330-c06437557642" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:35422 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:03:25.276Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "0747a698-8e2b-4ac5-bc1a-ce821e963782" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35572 10.133.0.30:443 10.132.0.9:35438 - odh-ai-gateway-infra.maas-api-route.3 2026-09-18T18:03:29.431272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:03:31.588384Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-18T18:03:31.573Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 14 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "96a5f87d-db90-46af-a537-c94f6839fe59" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35572 10.133.0.30:443 10.132.0.9:35454 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:31.987Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 403 - - "-" 83 0 10 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "ccba7d82-9916-4e12-93ef-05901e5148bf" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.133.0.30:443 10.132.0.9:35468 - llm.e2e-external-model.0 [2026-09-18T18:03:32.019Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 6 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "3365f56a-76ae-47ae-b66f-496e7d7ab7db" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.133.0.30:443 10.132.0.9:35472 - llm.e2e-external-model.0 2026-09-18T18:03:32.806259Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-18T18:03:32.806429Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-18T18:03:32.045Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 761 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "ed26f8a8-f06e-48dd-86e0-2a4c48750308" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.30:50212 10.133.0.30:443 10.132.0.9:35488 - llm.e2e-external-model.1 [2026-09-18T18:03:32.944Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 5 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "b339e7e7-6569-421f-a907-6e30c84fdea2" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" - - 10.133.0.30:443 10.132.0.9:35492 - - 2026-09-18T18:03:33.415766Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-18T18:03:33.322Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 19 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "693ecd5d-4486-47ac-8839-cf9a17438128" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54876 10.133.0.30:443 10.132.0.9:35498 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:03:33.358Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 19 - "44.212.242.249,10.132.0.9" "-" "761df921-e374-4b96-8198-154c40392a08" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54878 10.133.0.30:443 10.132.0.9:35504 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:03:33.398Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 317 17 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "50947f93-2ee1-4a8e-b2ac-7ea102e8b9d8" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35578 10.133.0.30:443 10.132.0.9:35520 - odh-ai-gateway-infra.maas-api-route.3 2026-09-18T18:03:37.733179Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-18T18:03:38.813Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 17 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "25e2a0fa-217f-4bf1-a03b-fccaec757d9d" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:48944 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-18T18:03:45.384046Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-18T18:03:45.513Z] "POST /llm/nonexistent-model-xyz/v1/chat/completions HTTP/1.1" 404 NR route_not_found - "-" 86 0 10 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "c0aaca07-e747-4ab9-b896-8b5ccc1a8936" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" - - 10.133.0.30:443 10.132.0.9:35562 - - 2026-09-18T18:03:47.495047Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-18T18:03:47.475Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 19 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "52b0e568-13a1-4ee0-bc11-41b85908227a" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35572 10.133.0.30:443 10.132.0.9:35572 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:47.518Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 13 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "7ff8de01-2ce9-4e6f-b463-d99c87f69d65" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:35582 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-18T18:03:50.014110Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-18T18:03:50.014390Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-18T18:03:49.478Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 535 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "4b691ead-ce5c-4272-9ac2-83ba3fec71b4" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.30:58898 10.133.0.30:443 10.132.0.9:35590 - llm.e2e-external-model.1 2026-09-18T18:03:50.810036Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-18T18:03:50.810309Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-18T18:03:50.044Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 82 39 765 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "fd31bf30-e1e8-4eb6-857d-c98a4764b804" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.30:58898 10.133.0.30:443 10.132.0.9:35602 - llm.e2e-external-model.2 2026-09-18T18:03:52.158831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-18T18:03:52.158976Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-18T18:03:50.848Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 52 39 1310 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "8e9a5c90-d451-4162-9087-d12fc7eee65e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.133.0.30:58898 10.133.0.30:443 10.132.0.9:35618 - llm.e2e-external-model.2 2026-09-18T18:03:52.899916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:03:54.004508Z info ads ADS: "" 4 terminated with stream closed 2026-09-18T18:03:54.204476Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-18T18:03:54.159Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 44 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "c0694a1b-47c7-4cee-aba1-6b4c362816bc" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35578 10.133.0.30:443 10.132.0.9:35620 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:03:54.228Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 26 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "abc7b965-7f30-43fa-8355-2b8f7f0f3367" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54876 10.133.0.30:443 10.132.0.9:35628 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:03:54.277Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 43 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "09a552c0-9eb7-4e1a-a3ba-e45b9a8f9831" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54878 10.133.0.30:443 10.132.0.9:35640 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:03:54.338Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 22 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "43bfd2f2-2db9-4fe4-9e2a-c6091d799dbe" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54876 10.133.0.30:443 10.132.0.9:35650 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:03:54.383Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 35 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "b7c59bea-afdb-4839-8719-0df26466e9fe" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54878 10.133.0.30:443 10.132.0.9:35662 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-18T18:04:01.939012Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:04:15.706566Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-18T18:04:15.871379Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-18T18:04:15.363Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 5 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "56db195d-40df-4f62-96a7-94503e23e070" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" - - 10.133.0.30:443 10.132.0.9:58054 - - [2026-09-18T18:04:15.513Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 5 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "972be797-367e-47a6-adf3-98ecdf061c70" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" - - 10.133.0.30:443 10.132.0.9:58062 - - [2026-09-18T18:04:15.658Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 5 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "054840a4-09e0-4d43-bfc9-13d8cac7411c" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" - - 10.133.0.30:443 10.132.0.9:58064 - - [2026-09-18T18:04:15.687Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 19 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "63292e7b-3664-4c98-b3a0-02a9279a37ea" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35578 10.133.0.30:443 10.132.0.9:58072 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-18T18:04:15.850Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 21 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "0f81781a-5161-43a4-89c6-3f8fde1e4b2a" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:35572 10.133.0.30:443 10.132.0.9:58086 - odh-ai-gateway-infra.maas-api-route.3 2026-09-18T18:08:02.934459Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:08:16.977474Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:16:23.897916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:16:37.502131Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:22:58.123202Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-18T18:22:58.097Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 312 25 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "b2e86c56-3070-4fd3-9c24-ffbbbbe46c02" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:55754 10.133.0.30:443 10.132.0.9:48228 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:22:58.143Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 328 28 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "dae90de2-a0b1-4530-897d-9f7da004de6b" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54876 10.133.0.30:443 10.132.0.9:48244 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-18T18:22:58.194Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 328 17 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "9fef6a31-233d-41e7-8461-1cb6336e7a6e" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54878 10.133.0.30:443 10.132.0.9:48260 - llm.facebook-opt-125m-simulated-kserve-route.2 2026-09-18T18:26:33.179964Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-18T18:26:33.162Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 17 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "09fcdcc5-136d-4f61-83cb-166c77483f4d" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:58186 10.133.0.30:443 10.132.0.9:34484 - odh-ai-gateway-infra.maas-api-route.3 2026-09-18T18:26:35.399412Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-18T18:26:35.804854Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-18T18:26:35.383Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 16 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "1f8566d9-62fc-4db5-a5dc-61869879d029" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:58196 10.133.0.30:443 10.132.0.9:41228 - odh-ai-gateway-infra.maas-api-route.3 2026-09-18T18:27:56.477079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:27:56.874965Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-18T18:27:56.858Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 16 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "f4b45679-fd64-4502-ba89-d711a256fc61" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:49914 10.133.0.30:443 10.132.0.9:46254 - odh-ai-gateway-infra.maas-api-route.3 2026-09-18T18:28:10.159841Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-18T18:28:10.133Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 26 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "6b3f6505-e680-47f2-8673-771b87571889" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:52300 10.133.0.30:443 10.132.0.9:37874 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:28:15.645Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 32 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "516da94e-2542-4106-9891-dc4a7c194f32" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54878 10.133.0.30:443 10.132.0.9:36712 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:28:15.700Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 0 5 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "5617c1ef-2102-4c0a-b1fa-e35a237acc67" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:36726 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:28:15.764Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 19 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "3025b77d-1f04-47b2-8467-f36652aec568" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54876 10.133.0.30:443 10.132.0.9:36732 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:28:15.804Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 0 5 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "42ca17c7-2c9e-4a09-80eb-d66b48ab5b90" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:36740 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:28:15.830Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 0 5 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "c969445c-8063-4abc-ae73-a7527c504012" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:36742 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:28:15.853Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 18 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "ac4b12c8-9e97-493c-83c3-2a710f5336f2" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54878 10.133.0.30:443 10.132.0.9:36758 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-18T18:28:40.568930Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:28:44.099671Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-18T18:28:44.081Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 18 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "e0f809f0-5a1a-440f-b729-ce5d64806304" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:49914 10.133.0.30:443 10.132.0.9:46118 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:28:44.125Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 32 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "a0180ccc-49f9-4944-91ed-c2c3baa4e94e" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:44496 10.133.0.30:443 10.132.0.9:46128 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:28:44.280Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 19 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "24316638-42cc-4f4e-a011-03a92efa6daa" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:44500 10.133.0.30:443 10.132.0.9:46138 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:28:44.423Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 18 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "c3753892-f9c8-4277-a431-320a4fdc930b" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:44500 10.133.0.30:443 10.132.0.9:46146 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:28:44.568Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 18 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "44524d1d-1952-41c7-82b6-fb884f101627" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:44496 10.133.0.30:443 10.132.0.9:46158 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:28:44.707Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 17 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "e2bbd934-c345-48dc-8baf-7869cbec5c09" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:44496 10.133.0.30:443 10.132.0.9:46174 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:28:44.842Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 15 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "d92d94e4-d0bd-47d7-9237-599a9e26f2fd" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:36354 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-18T18:28:47.570095Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:28:50.572599Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:28:55.607324Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-18T18:28:55.760658Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-18T18:28:55.589Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 18 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "a31f6ace-620a-4309-80b2-042b1cfd2d10" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:52300 10.133.0.30:443 10.132.0.9:44970 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:28:55.633Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 309 21 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "31d63ba0-aef8-4299-91ce-e803ed6eb36b" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:44500 10.133.0.30:443 10.132.0.9:44972 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:28:55.677Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "55369673-b997-45fb-be9f-b167aee36e3b" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:44980 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:28:55.711Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "a4a2aadc-d685-4be1-9907-8fb5f617f688" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:44988 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:28:55.746Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 14 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "4db107e8-3822-4031-899e-43461a67f38b" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:44496 10.133.0.30:443 10.132.0.9:45004 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.6 2026-09-18T18:28:56.464798Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-18T18:28:56.451Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 317 13 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "c6097dff-b228-49e1-a26e-0b7f543fd80d" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:49914 10.133.0.30:443 10.132.0.9:45010 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:28:56.506Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 292 17 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "8c15b006-fc0a-4f80-97a2-95d7b46f516e" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54878 10.133.0.30:443 10.132.0.9:45022 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:28:57.462Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 19 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "f7961b89-cc21-48ca-aec0-2fee2f5ead81" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54878 10.133.0.30:443 10.132.0.9:45026 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:28:58.197Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 18 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "e4a7c747-ac2d-494c-9258-74c6c467b611" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54876 10.133.0.30:443 10.132.0.9:45032 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:28:59.266Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 18 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "10d1501c-914d-4971-b316-04db8a36693c" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54878 10.133.0.30:443 10.132.0.9:45048 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-18T18:29:00.775864Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:29:05.072763Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-18T18:29:06.782Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 11 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "920b5312-ebae-4bee-b1c1-99c6727d1f88" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:42662 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:29:15.979Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 11 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "37c6deba-db76-9464-be76-6aefe90fc9ed" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:37886 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-18T18:29:16.814713Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-18T18:29:16.799Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "48602ef4-f0f3-49b2-8bbc-e70cbcff3e35" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:49914 10.133.0.30:443 10.132.0.9:37900 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:29:17.167Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 11 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "ee7399e5-1559-4fc1-a306-47abc1d2f9c0" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:37904 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-18T18:29:23.282562Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:29:25.188685Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-18T18:29:25.172Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 328 16 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "891ed058-9a92-4440-8608-3f2d01429949" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:52300 10.133.0.30:443 10.132.0.9:39164 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:29:25.207Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 19 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "03a1e7f9-32bb-4ed6-96b4-e2333bd983ef" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:54878 10.133.0.30:443 10.132.0.9:39178 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-18T18:29:26.553176Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-18T18:29:26.537Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 15 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "229a4fa4-26bf-46f9-befd-c0f1f4be483a" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:49914 10.133.0.30:443 10.132.0.9:39180 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:29:26.908Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 12 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "e5d4d1f9-7057-4d2e-95b5-705a6f7e860c" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:39192 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-18T18:29:29.173981Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:30:40.733074Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-18T18:30:40.712Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 20 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "5bc76eba-00b3-410d-b41e-f13737902573" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:49176 10.133.0.30:443 10.132.0.9:35226 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:30:40.757Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 49 22 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "3afba9b6-86d1-4998-87c6-05d1e876bac0" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:35236 - llm.e2e-trlp-test-simulated-kserve-route.0 2026-09-18T18:31:02.765580Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-18T18:31:04.165Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 285 32 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "2fefc2c1-eec5-4da9-9089-a9fb0491b65d" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.43:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:40760 10.133.0.30:443 10.132.0.9:34126 - llm.e2e-trlp-test-simulated-kserve-route.0 2026-09-18T18:31:04.780943Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-18T18:31:04.762Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 18 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "8873172a-071c-4e01-b75e-b92bf3b8866a" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:54556 10.133.0.30:443 10.132.0.9:42686 - odh-ai-gateway-infra.maas-api-route.3 2026-09-18T18:31:08.581850Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:31:08.861349Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-18T18:31:09.231215Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-18T18:31:08.846Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 40 330 14 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "19064209-912a-4f27-8cfc-26f7909fa6c4" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:49176 10.133.0.30:443 10.132.0.9:42700 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:31:09.220Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 479 11 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "ff17e454-2682-40ea-8901-3e42cd090de5" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:54556 10.133.0.30:443 10.132.0.9:42702 - odh-ai-gateway-infra.maas-api-route.3 2026-09-18T18:31:11.678079Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:31:19.597132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:31:31.798505Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:31:36.807856Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-09-18T18:31:47.760530Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-18T18:31:47.792287Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-18T18:31:47.745Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 15 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "64181de9-e217-4811-83c5-b53a9c0fc7a1" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:49176 10.133.0.30:443 10.132.0.9:50538 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:31:47.781Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 670 10 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "434a158e-590f-4760-97f8-6e864a2be2a2" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:54556 10.133.0.30:443 10.132.0.9:50544 - odh-ai-gateway-infra.maas-api-route.3 2026-09-18T18:31:51.498751Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:31:56.261699Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:31:57.403404Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-18T18:31:57.439038Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-18T18:31:57.387Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 16 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "99d3c938-53c4-4ea5-9f5a-d052b52237b9" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:54556 10.133.0.30:443 10.132.0.9:35502 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:31:57.425Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 13 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "0269ac4c-c69f-4d93-ae60-fde687139227" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:54556 10.133.0.30:443 10.132.0.9:35514 - odh-ai-gateway-infra.maas-api-route.3 2026-09-18T18:32:00.070799Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:32:07.227467Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-18T18:32:07.259537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-18T18:32:07.426950Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-18T18:32:07.212Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 331 15 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "27e0a8f0-d802-4abc-b182-3489d8add5d8" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:54556 10.133.0.30:443 10.132.0.9:45112 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:32:07.249Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 10 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "02491d10-02a0-4b6a-8d94-7e48c4988154" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:49176 10.133.0.30:443 10.132.0.9:45122 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:32:07.277Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 17 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "f4116c4d-55d0-42da-a8c9-9a771fc04399" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:44496 10.133.0.30:443 10.132.0.9:45130 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:32:07.317Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 302 17 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "a652ce15-c26d-43b0-a041-29ec395e3b99" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:44496 10.133.0.30:443 10.132.0.9:45144 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:32:07.354Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "46ff0462-fba7-4b49-bea9-4523c624e1da" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:45148 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:32:07.385Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "36e5eafa-bff4-4256-9c5e-1507fecfcdf6" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:45154 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-18T18:32:07.417Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 9 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "aa2af19a-873f-4161-ad81-38ae467eeb1f" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.38:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:54556 10.133.0.30:443 10.132.0.9:45170 - odh-ai-gateway-infra.maas-api-route.3 2026-09-18T18:32:09.489371Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-18T18:32:14.830Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 39 15 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "a6f52fcd-8584-4863-9b9d-b5dbb59d6366" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:56522 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-18T18:32:17.085470Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:32:20.898261Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-18T18:32:20.876Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 318 22 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "f34388c1-92bc-4f12-9ac6-ca046ccf82df" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.132.0.90:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:37258 10.133.0.30:443 10.132.0.9:56526 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:32:20.922Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 31 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "33762eeb-79e1-4f7b-b221-45a78e836625" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.133.0.31:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:39610 10.133.0.30:443 10.132.0.9:56528 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-18T18:32:21.076Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 20 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "1d1dda68-8c15-4ff3-9f64-b0227952eb56" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.133.0.31:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:39622 10.133.0.30:443 10.132.0.9:56530 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-18T18:32:21.216Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 18 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "2a4607cd-dfe8-439e-93fd-bd9789e61390" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.133.0.31:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:39610 10.133.0.30:443 10.132.0.9:56546 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-18T18:32:21.351Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 16 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "b1b7b674-b432-4b52-b2cc-5acb30876e7a" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.133.0.30:443 10.132.0.9:56552 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-18T18:32:24.104336Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:32:29.992846Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-18T18:32:34.078445Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-18T18:32:34.056Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 21 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "836c099a-b91e-4ab0-a87d-48c556e36a11" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.134.0.85:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.133.0.30:54208 10.133.0.30:443 10.132.0.9:39392 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-18T18:32:34.107Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 30 - "44.212.242.249,10.132.0.9" "python-requests/2.32.5" "7f7f6bc8-17a5-4f31-b721-99c81b1498cf" "maas.apps.580cc06c-a88d-4ba6-a803-a36a6c8f9a2f.prod.konfluxeaas.com" "10.133.0.31:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.133.0.30:39610 10.133.0.30:443 10.132.0.9:39400 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-18T18:32:36.885303Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9