2026-09-14T04:58:52.815157Z info FLAG: --concurrency="0" 2026-09-14T04:58:52.815174Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-09-14T04:58:52.815178Z info FLAG: --help="false" 2026-09-14T04:58:52.815180Z info FLAG: --log_as_json="false" 2026-09-14T04:58:52.815182Z info FLAG: --log_caller="" 2026-09-14T04:58:52.815184Z info FLAG: --log_output_level="default:info" 2026-09-14T04:58:52.815187Z info FLAG: --log_stacktrace_level="default:none" 2026-09-14T04:58:52.815201Z info FLAG: --log_target="[stdout]" 2026-09-14T04:58:52.815204Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-09-14T04:58:52.815205Z info FLAG: --outlierLogPath="" 2026-09-14T04:58:52.815208Z info FLAG: --profiling="true" 2026-09-14T04:58:52.815210Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-09-14T04:58:52.815213Z info FLAG: --proxyLogLevel="warning" 2026-09-14T04:58:52.815216Z info FLAG: --serviceCluster="istio-proxy" 2026-09-14T04:58:52.815219Z info FLAG: --stsPort="0" 2026-09-14T04:58:52.815222Z info FLAG: --templateFile="" 2026-09-14T04:58:52.815225Z info FLAG: --tokenManagerPlugin="" 2026-09-14T04:58:52.815229Z info FLAG: --vklog="0" 2026-09-14T04:58:52.815233Z info Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean 2026-09-14T04:58:52.815369Z info Proxy role ips=[10.132.0.31] type=router id=maas-default-gateway-openshift-default-78bb78ff78-6jjp4.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-09-14T04:58:52.815414Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-09-14T04:58:52.816450Z info cpu limit detected as 2, setting concurrency 2026-09-14T04:58:52.816659Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-09-14T04:58:52.816669Z info JWT policy is third-party-jwt 2026-09-14T04:58:52.816672Z info using credential fetcher of JWT type in cluster.local trust domain 2026-09-14T04:58:52.819607Z info Starting default Istio SDS Server 2026-09-14T04:58:52.819631Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-09-14T04:58:52.819649Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-09-14T04:58:52.819734Z info Opening status port 15020 2026-09-14T04:58:52.820344Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-09-14T04:58:52.821704Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-09-14T04:58:52.822547Z info Starting proxy agent 2026-09-14T04:58:52.822579Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-09-14T04:58:52.830283Z info sds Starting SDS grpc server 2026-09-14T04:58:52.830304Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-09-14T04:58:52.877802Z warning envoy main external/envoy/source/server/server.cc:901 Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future. thread=9 2026-09-14T04:58:52.878065Z warning envoy main external/envoy/source/server/server.cc:997 There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. thread=9 2026-09-14T04:58:52.883067Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-09-14T04:58:52.921451Z info cache generated new workload certificate resourceName=default latency=100.887194ms ttl=23h59m59.078551591s 2026-09-14T04:58:52.921483Z info cache Root cert has changed, start rotating root cert 2026-09-14T04:58:52.921510Z info cache returned workload trust anchor from cache ttl=23h59m59.07849024s 2026-09-14T04:58:52.968995Z info ads ADS: new connection for node:1 2026-09-14T04:58:52.969086Z info cache returned workload certificate from cache ttl=23h59m59.030917665s 2026-09-14T04:58:52.969274Z info ads ADS: new connection for node:2 2026-09-14T04:58:52.969337Z info cache returned workload trust anchor from cache ttl=23h59m59.030664214s 2026-09-14T04:58:53.010546Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T04:58:59.515418Z info Readiness succeeded in 6.70233151s 2026-09-14T04:58:59.515691Z info Envoy proxy is ready 2026-09-14T04:59:00.289184Z info ads ADS: new connection for node:3 2026-09-14T04:59:00.289312Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-14T04:59:00.289334Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-14T04:59:00.730712Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T04:59:10.454505Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T04:59:20.146367Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T04:59:41.967444Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T04:59:49.364676Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T04:59:56.871576Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:00:06.199753Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:01:11.241281Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-14T05:01:11.211Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 321 29 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "a08fc093-d240-4b05-982b-e9b172d6140d" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36736 10.132.0.31:443 10.133.0.9:50032 - odh-ai-gateway-infra.maas-api-route.3 2026-09-14T05:01:11.321992Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-14T05:01:11.845002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 [2026-09-14T05:01:11.287Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 34 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "cfd0720b-7840-4f9e-a3fe-8d25c932df31" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36736 10.132.0.31:443 10.133.0.9:50038 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:11.374Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 445 59 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "d47b3bbb-4106-477a-88cc-40622dc085f8" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:53552 10.132.0.31:443 10.133.0.9:50054 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-14T05:01:11.476Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 381 18 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "68941dc8-2b5a-4897-9f07-719687e18611" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:53552 10.132.0.31:443 10.133.0.9:50058 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-14T05:01:11.526Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 538 17 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "e3c648f1-7d76-4e21-b8c3-c8b7fc512005" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:53552 10.132.0.31:443 10.133.0.9:50070 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-14T05:01:11.572Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 15 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "ec7ea4c9-3ec6-4357-8303-e3582c1a4a8d" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:50084 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-14T05:01:11.617Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "184ed157-a0b1-482d-8cde-78b2a7948349" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:50090 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-14T05:01:11.657Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 18 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "1a2dfb2c-dba8-42d3-9c21-89ed0c12985e" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:50092 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-14T05:01:11.701Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "33cb856d-d66f-43aa-9f0a-db8beae5a8fb" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:50106 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-14T05:01:11.744Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "4e029d72-3003-4853-be58-dad94cbfd3c6" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:53048 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-14T05:01:11.789Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "99c58980-800f-4c5f-a875-e32a70c578db" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:53054 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-14T05:01:11.831Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "5a340f1f-d415-47c0-88c3-3ecbd4887fd9" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:53064 - llm.facebook-opt-125m-simulated-kserve-route.3 2026-09-14T05:01:11.963502Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-14T05:01:12.240048Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-14T05:01:12.278386Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-14T05:01:11.876Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "bfc4a8c5-de6d-44f5-a70e-12187d9912c3" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:53070 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-14T05:01:11.916Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 0 5 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "72865d3f-7278-429a-b27e-6a7e71944ab5" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:53086 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-14T05:01:11.948Z] "DELETE /v1/api-keys/f5c2252c-5b80-44cd-b3a9-19c827b61735 HTTP/1.1" 200 - via_upstream - "-" 0 365 15 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "f1c27352-0a9a-4d70-a49d-9b099612c20f" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36736 10.132.0.31:443 10.133.0.9:53088 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:12.234Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 5 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "e24c35af-a4e2-4df5-9e3e-f2b81715cb10" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36744 10.132.0.31:443 10.133.0.9:53098 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-14T05:01:12.265Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 12 - "34.228.250.194,10.133.0.9" "curl/7.76.1" "0f3acf33-3e25-45a9-849a-a41c583eca91" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36736 10.132.0.31:443 10.133.0.9:53112 - odh-ai-gateway-infra.maas-api-route.3 2026-09-14T05:01:27.725345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-14T05:01:27.794724Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-14T05:01:27.835631Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-14T05:01:27.721Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 4 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "7674a058-67fc-4699-94e3-af4e3fad6583" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36744 10.132.0.31:443 10.133.0.9:55190 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-14T05:01:27.750Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 0 5 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "418f23cb-1cae-4364-b49a-f396f05a86ff" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.31:443 10.133.0.9:55196 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:27.780Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "a723a7f1-c8bb-426f-adf6-7d7bb19a8547" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36744 10.132.0.31:443 10.133.0.9:55202 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:27.820Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 15 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "b08711a6-98bb-462c-b693-b41662e9e634" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36744 10.132.0.31:443 10.133.0.9:55210 - odh-ai-gateway-infra.maas-api-route.3 2026-09-14T05:01:27.863618Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-14T05:01:27.889909Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-14T05:01:27.890071Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-09-14T05:01:27.928056Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-14T05:01:27.933160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-14T05:01:27.933315Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 2026-09-14T05:01:28.093443Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-09-14T05:01:28.103704Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-14T05:01:28.139197Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-14T05:01:28.210352Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-14T05:01:28.246148Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-14T05:01:28.325129Z info ads ADS: new connection for node:4 2026-09-14T05:01:28.330968Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-09-14T05:01:28.331010Z info cache read certificate from file resource=file-root:system 2026-09-14T05:01:28.445947Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-14T05:01:28.485451Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-14T05:01:28.551331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-14T05:01:28.586282Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-14T05:01:28.754380Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-14T05:01:27.847Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 16 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "ada9a561-f311-472a-9e13-ed964b8cb6a2" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36744 10.132.0.31:443 10.133.0.9:55214 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:27.856Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 111 126 33 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "c78b21b3-c607-4181-9bcb-dc61ad141331" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:50352 10.132.0.31:443 10.133.0.9:55216 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-14T05:01:27.883Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 9 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "ec6d1d0a-a712-4da6-9711-f6f7dd732241" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.31:443 10.133.0.9:55232 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:27.913Z] "DELETE /v1/api-keys/a4f0e860-643f-4399-943c-854fcdefb5fa HTTP/1.1" 200 - via_upstream - "-" 0 370 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "ea10256a-2419-4a0b-930f-7497da3fb49b" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36744 10.132.0.31:443 10.133.0.9:55246 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:27.915Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 18 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "1a807167-79a7-4607-b619-119382285715" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:53552 10.132.0.31:443 10.133.0.9:55254 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:01:28.089Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "0ee7ab20-37e6-45db-a64f-c32b96b2dcd6" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36744 10.132.0.31:443 10.133.0.9:55266 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:28.125Z] "DELETE /v1/api-keys/f25ddbe1-a8cc-44cb-94ba-503ba0610180 HTTP/1.1" 200 - via_upstream - "-" 0 321 13 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "52b1569c-c442-4ab1-a8b8-d58351236f42" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36736 10.132.0.31:443 10.133.0.9:55274 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:28.160Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 10 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "22d62d28-aaa8-4020-8f6b-e97713570fb4" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.31:443 10.133.0.9:55286 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:28.196Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 13 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "210a0ba3-9ae9-4c1f-83cb-5121b008ad94" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36744 10.132.0.31:443 10.133.0.9:55290 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:28.232Z] "DELETE /v1/api-keys/ef5f59dc-d5fd-451e-9b7b-df4f9de79954 HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "c3cf28d4-b6b6-4ff8-b1ac-db43bb674bc7" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36736 10.132.0.31:443 10.133.0.9:55300 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:28.430Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "f2d29d93-ba85-4865-b1e2-af8f3e388f23" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36736 10.132.0.31:443 10.133.0.9:55310 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:28.468Z] "DELETE /v1/api-keys/501614dd-0215-4854-8db5-6609d303eb0c HTTP/1.1" 200 - via_upstream - "-" 0 321 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "479eb367-14b6-4e10-97d2-49e56a8899f9" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36744 10.132.0.31:443 10.133.0.9:55320 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:28.505Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 11 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "49ab1a2b-19e3-49ea-bf68-b147d8a267fc" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.132.0.31:443 10.133.0.9:55324 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:28.535Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "b0198af8-4fb2-4f90-8f80-5aae2ebc2629" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36744 10.132.0.31:443 10.133.0.9:55336 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:28.569Z] "DELETE /v1/api-keys/aca70d65-4217-4ef3-8c05-c55b7b67fef0 HTTP/1.1" 200 - via_upstream - "-" 0 321 16 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "e13a19c9-5ddc-42d9-8ad6-e5be0b3896fb" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36744 10.132.0.31:443 10.133.0.9:55342 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:28.739Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "aa5ca86e-5e7f-41e0-8884-9d11a35a5514" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36744 10.132.0.31:443 10.133.0.9:55348 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:28.774Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 13 11 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "f957441b-86ac-409c-a3d6-e1f37e3be8b2" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:55350 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-14T05:01:28.963576Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-14T05:01:29.091141Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-14T05:01:28.948Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "d9be3795-3e25-4da9-8d38-fdb4d81f7677" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36736 10.132.0.31:443 10.133.0.9:55360 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:28.987Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 288 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "cfbf419f-72fc-4e65-a8f7-43c539a00ce1" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:50352 10.132.0.31:443 10.133.0.9:55372 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:01:29.025Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 20 - "34.228.250.194,10.133.0.9" "-" "4d75dccf-a4b9-4bbe-a546-1b1200b6cd07" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:53552 10.132.0.31:443 10.133.0.9:55376 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:01:29.072Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 317 18 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "3eaeb08f-9289-4068-8311-ac6b2395f9d9" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36736 10.132.0.31:443 10.133.0.9:55378 - odh-ai-gateway-infra.maas-api-route.3 2026-09-14T05:01:33.837716Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-14T05:01:34.120Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 18 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "8130f8b3-9609-4e53-a01c-205069152baa" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:34372 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-14T05:01:35.382448Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-14T05:01:35.367Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 15 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "acfb7d21-6a2f-4eaf-9eb2-3b4c44ece186" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36744 10.132.0.31:443 10.133.0.9:34376 - odh-ai-gateway-infra.maas-api-route.3 2026-09-14T05:01:35.866254Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-14T05:01:35.866399Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-09-14T05:01:35.738Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 403 - - "-" 83 0 11 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "aa55915f-ca05-4545-9aa5-77a747c20e1e" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.132.0.31:443 10.133.0.9:34380 - llm.e2e-external-model.0 [2026-09-14T05:01:35.774Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 6 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "4586e0fb-ccd8-48c4-aa5d-c56bfefd5e7b" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.132.0.31:443 10.133.0.9:34396 - llm.e2e-external-model.0 [2026-09-14T05:01:35.802Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 64 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "2648bced-78fe-412f-8194-45f42f01cf61" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.31:44076 10.132.0.31:443 10.133.0.9:34402 - llm.e2e-external-model.1 2026-09-14T05:01:41.628808Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-14T05:01:48.512Z] "POST /llm/nonexistent-model-xyz/v1/chat/completions HTTP/1.1" 404 NR route_not_found - "-" 86 0 7 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "a87a2865-a725-47ff-bbb2-ba360e8d8031" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" - - 10.132.0.31:443 10.133.0.9:34646 - - 2026-09-14T05:01:51.303633Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:01:52.299855Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-14T05:01:52.299995Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 2026-09-14T05:01:52.384142Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-14T05:01:52.384331Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 2026-09-14T05:01:52.468295Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-14T05:01:52.468538Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-09-14T05:01:52.219Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 80 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "e3be1e13-47ce-48e0-b4a5-ec15b738ec87" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.31:35630 10.132.0.31:443 10.133.0.9:48922 - llm.e2e-external-model.1 [2026-09-14T05:01:52.322Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 82 39 62 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "c0836b2c-575f-4189-ad71-f005661ba51c" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.31:35630 10.132.0.31:443 10.133.0.9:48932 - llm.e2e-external-model.2 [2026-09-14T05:01:52.407Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 52 39 60 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "158843f2-aa94-4c9d-a265-fc0a66a4cdc3" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.132.0.31:35630 10.132.0.31:443 10.133.0.9:48940 - llm.e2e-external-model.2 2026-09-14T05:01:53.371440Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-14T05:01:53.347Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 23 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "c5ba132c-c859-4727-8b68-420e73aee155" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36744 10.132.0.31:443 10.133.0.9:48954 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:53.409Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "9cd94770-f75e-4d21-a0e0-f12816457066" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:48966 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-14T05:01:53.625386Z info ads ADS: "" 4 terminated with stream closed 2026-09-14T05:01:57.669304Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-14T05:01:57.637Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 31 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "0804a6a8-e495-41f9-8876-a361e0ce4300" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36744 10.132.0.31:443 10.133.0.9:48980 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:01:57.693Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 37 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "0041f42f-08fa-47dd-b094-77633da125b8" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:50352 10.132.0.31:443 10.133.0.9:48992 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:01:57.756Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 40 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "bf55676f-278c-4db0-b956-0d986e920982" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:50352 10.132.0.31:443 10.133.0.9:49002 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:01:57.815Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 29 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "2d3088ca-efe9-489b-af85-7eee6c2a7db7" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:53552 10.132.0.31:443 10.133.0.9:49016 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:01:57.864Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 42 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "472f1faf-e8fd-4895-94cc-9d088af6f0b3" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:53552 10.132.0.31:443 10.133.0.9:49022 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:01:59.898Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 5 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "f25d5121-9a48-41e4-b35d-0e612d1a1d74" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" - - 10.132.0.31:443 10.133.0.9:49026 - - 2026-09-14T05:02:00.986000Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-14T05:02:11.486Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 6 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "aa988ecd-719b-4bee-ab6a-26344d1cb0e8" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" - - 10.132.0.31:443 10.133.0.9:41604 - - 2026-09-14T05:02:11.822526Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-14T05:02:11.991532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-14T05:02:11.634Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "49359259-ee29-4f08-beef-386c86146e11" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" - - 10.132.0.31:443 10.133.0.9:41614 - - [2026-09-14T05:02:11.787Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 5 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "844e7eb0-ff07-44d6-8174-4b3151bbf06a" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" - - 10.132.0.31:443 10.133.0.9:56584 - - [2026-09-14T05:02:11.817Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 5 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "ddb2190a-137d-464d-ade6-84354d708d21" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36744 10.132.0.31:443 10.133.0.9:56592 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-14T05:02:11.966Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 25 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "5e7922cb-f35f-4097-be77-95a88805c6a2" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:36744 10.132.0.31:443 10.133.0.9:56608 - odh-ai-gateway-infra.maas-api-route.3 2026-09-14T05:05:44.273752Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:05:52.905539Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:12:21.022417Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:12:34.901961Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:18:25.303443Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-14T05:18:25.284Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 19 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "a6734d16-3644-4f71-83bd-a02bdc543609" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:46630 10.132.0.31:443 10.133.0.9:36878 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:18:25.330Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 320 30 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "8cf45475-7b03-4d6d-a5e1-ea7fe0013825" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:53552 10.132.0.31:443 10.133.0.9:36888 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-14T05:18:25.388Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 327 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "7c58eee9-fe34-437a-9cc2-7204e011b5c1" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:53552 10.132.0.31:443 10.133.0.9:36898 - llm.facebook-opt-125m-simulated-kserve-route.2 2026-09-14T05:22:08.521682Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-14T05:22:08.495Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 315 25 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "bb5068f7-05ae-489f-bd20-56676b13adf2" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:34942 10.132.0.31:443 10.133.0.9:51012 - odh-ai-gateway-infra.maas-api-route.3 2026-09-14T05:22:10.894882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-14T05:22:11.507021Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-14T05:22:10.879Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 15 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "5fcd7263-d3ff-4492-8a20-98222108e789" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:34942 10.132.0.31:443 10.133.0.9:51026 - odh-ai-gateway-infra.maas-api-route.3 2026-09-14T05:23:34.449029Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-14T05:23:34.598186Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-14T05:23:34.432Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 16 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "1dd93c64-9d9f-4e93-8097-9b83ee9ffb2b" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:57270 10.132.0.31:443 10.133.0.9:34718 - odh-ai-gateway-infra.maas-api-route.3 2026-09-14T05:23:59.478849Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:24:05.991565Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-14T05:24:05.973Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "21d59fab-3237-46e3-8273-cd79aafde5b5" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:59908 10.132.0.31:443 10.133.0.9:56280 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:24:06.013Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 43 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "19d8b972-261e-4472-bb47-06a3fa3369f8" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:38568 10.132.0.31:443 10.133.0.9:56294 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:24:06.180Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 19 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "9ee2caff-6b92-4d72-aacc-259bdabf72f5" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:38576 10.132.0.31:443 10.133.0.9:56300 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:24:06.320Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "aede098b-c7de-4d0a-a7ba-9116a7fc1bae" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:38568 10.132.0.31:443 10.133.0.9:56302 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:24:06.461Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "ed0a1e28-8147-42ee-9b9f-a9acfeb08b23" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:38576 10.132.0.31:443 10.133.0.9:56306 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:24:06.601Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "3c113e37-282c-4917-ac01-f37b7f9dfca5" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:38568 10.132.0.31:443 10.133.0.9:56320 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:24:06.743Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "8a5b20c7-f28e-4779-b382-32e0933729ac" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:56328 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-14T05:24:09.088369Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:24:12.200081Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:24:18.626887Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-14T05:24:18.607Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 19 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "ffe71946-676e-4e4f-b5d1-9cff6d7f1203" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:59908 10.132.0.31:443 10.133.0.9:47466 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:24:18.650Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 289 22 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "b145719e-d5fe-40cb-9c33-615a729b7daa" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:38576 10.132.0.31:443 10.133.0.9:47480 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:24:18.691Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "461d1f2a-4d54-4cc5-976a-271046b69364" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:38576 10.132.0.31:443 10.133.0.9:47488 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:24:18.732Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "6cfabd27-225d-4d12-8c7f-3a8685d033ee" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:47496 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:24:18.765Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "41c2a853-3d19-4e6b-9c2a-2b2017850e8a" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:47502 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-14T05:24:18.817432Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-14T05:24:19.579940Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-14T05:24:18.803Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 13 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "f09d510f-705f-4b46-a938-10e9841a6a6a" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:38576 10.132.0.31:443 10.133.0.9:47518 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.6 [2026-09-14T05:24:19.562Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "f4993f84-6355-4412-9236-b66413156198" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:59908 10.132.0.31:443 10.133.0.9:47526 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:24:19.601Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 16 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "361f793b-273a-453f-935f-11adccafd106" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:50352 10.132.0.31:443 10.133.0.9:47528 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:24:20.597Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 18 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "1169573a-2bdf-43bb-8ddc-83ffa19c64a5" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:53552 10.132.0.31:443 10.133.0.9:47530 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:24:21.321Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "a0ad50f1-c32e-4811-8c2a-b5e94f92ec3d" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:50352 10.132.0.31:443 10.133.0.9:47544 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:24:22.395Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 19 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "70d2290f-cd82-4c46-be37-5af180e59288" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:53552 10.132.0.31:443 10.133.0.9:39122 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-14T05:24:23.384307Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-14T05:24:27.831Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 11 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "ad40a956-ec99-432c-bc8b-03b04a58e8e0" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:39134 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-14T05:24:31.716591Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-14T05:24:30.842Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 11 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "a6dd1a42-a7b5-4161-a90d-4c0f320b2de8" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:39150 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:24:31.700Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "7cb89f43-9601-47bb-88dd-281d2818ddba" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:59908 10.132.0.31:443 10.133.0.9:39160 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:24:32.071Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 11 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "abc22c8b-6a79-44b1-9b52-9df62a869e28" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:43874 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-14T05:24:38.377841Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:24:40.049159Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-14T05:24:40.033Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 327 15 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "fa4b998b-cbb1-4ce1-86f8-9746acd20a99" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:59908 10.132.0.31:443 10.133.0.9:43890 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:24:40.071Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 295 18 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "be33ef20-a33a-41ab-a5fd-18bb5e64d083" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.35:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:53552 10.132.0.31:443 10.133.0.9:43902 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-14T05:24:41.395400Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-14T05:24:41.381Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "d1004f35-cf7d-477a-85e7-06975453cbb9" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:59908 10.132.0.31:443 10.133.0.9:43904 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:24:41.759Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 10 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "be13e786-a811-490d-9dfa-97030f270e27" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:52438 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-14T05:24:44.376337Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:25:45.688539Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-14T05:25:45.671Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "b0c67300-7d7e-4a26-bafe-8b28ac99fa33" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:45210 10.132.0.31:443 10.133.0.9:48778 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:25:45.718Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 49 20 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "5f64238d-3816-44a8-99fd-b8a7775c3333" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:48784 - llm.e2e-trlp-test-simulated-kserve-route.0 2026-09-14T05:26:08.586974Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:26:09.900634Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-14T05:26:09.239Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 294 32 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "e6706fd8-7dc0-45ae-8670-389802b6065b" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.51:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:33402 10.132.0.31:443 10.133.0.9:35584 - llm.e2e-trlp-test-simulated-kserve-route.0 [2026-09-14T05:26:09.882Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 18 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "4a8108e9-005d-4b34-ba9c-2771161a6b0f" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:53730 10.132.0.31:443 10.133.0.9:35592 - odh-ai-gateway-infra.maas-api-route.3 2026-09-14T05:26:12.590605Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:26:16.594682Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:26:18.381258Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-14T05:26:18.527373Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-14T05:26:18.365Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 40 330 16 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "cd7c6219-8718-4c4e-8414-7333ad5ebb36" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:45210 10.132.0.31:443 10.133.0.9:36114 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:26:18.516Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 479 10 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "c8209f1e-406f-4fd7-9770-5e1c0ebd1b5e" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:53730 10.132.0.31:443 10.133.0.9:36118 - odh-ai-gateway-infra.maas-api-route.3 2026-09-14T05:26:22.411561Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:26:38.091339Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:26:57.406977Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:27:20.913695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-14T05:27:20.958424Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-14T05:27:20.886Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 27 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "5e144612-299f-4168-9bf9-aeff7bd4ccba" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:34300 10.132.0.31:443 10.133.0.9:50304 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:27:20.938Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 670 20 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "54e87e39-9706-47f3-90ef-6d0f33a9e910" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:34300 10.132.0.31:443 10.133.0.9:50306 - odh-ai-gateway-infra.maas-api-route.3 2026-09-14T05:27:25.599066Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:27:27.649359Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-14T05:27:27.680485Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-14T05:27:27.632Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 16 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "37938c70-4516-42fe-bd67-c72f1b161212" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:34310 10.132.0.31:443 10.133.0.9:39112 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:27:27.670Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 10 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "9a666623-2129-4946-8bd3-afc81f3698d4" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:34300 10.132.0.31:443 10.133.0.9:39122 - odh-ai-gateway-infra.maas-api-route.3 2026-09-14T05:27:30.980893Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:27:40.699187Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-14T05:27:40.734244Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-14T05:27:40.903431Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-14T05:27:40.681Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 331 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "e06dd513-7243-4397-ba54-2400fe06c7d2" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:34300 10.132.0.31:443 10.133.0.9:60692 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:27:40.722Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 11 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "0d32bf9e-a139-4cba-80ea-e60c494e3d4b" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:34300 10.132.0.31:443 10.133.0.9:60696 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:27:40.762Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 20 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "4656280c-9978-48e7-9978-247c5776288e" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.133.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:38568 10.132.0.31:443 10.133.0.9:60712 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:27:40.803Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "9a6da0da-dd57-4db9-952d-d222d863f8fb" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:60728 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:27:40.835Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "a5644cd6-61bb-48e0-889a-413233451f37" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:60738 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-14T05:27:40.893Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 10 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "c0857a05-d452-4276-81f0-5e3eafa6596d" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:34310 10.132.0.31:443 10.133.0.9:60752 - odh-ai-gateway-infra.maas-api-route.3 2026-09-14T05:27:43.080851Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-14T05:27:48.415Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 39 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "f2a4831f-8906-431a-a272-b3bb4b746438" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:37082 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-14T05:27:50.848442Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:27:54.546439Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-14T05:27:54.528Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 17 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "1725aa96-08f2-49ce-b1d6-ca4c5263dd16" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.134.0.48:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:34310 10.132.0.31:443 10.133.0.9:45888 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:27:54.569Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 34 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "c2727da6-39ef-45af-ab7e-3e4cb67568ae" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46064 10.132.0.31:443 10.133.0.9:45896 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-14T05:27:54.723Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 19 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "f3ec15fb-bceb-438e-ba6f-6d4e24b79809" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46064 10.132.0.31:443 10.133.0.9:45898 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-14T05:27:54.862Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 20 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "bdfd8ec2-762d-4af6-bca3-ca959032b0b5" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46080 10.132.0.31:443 10.133.0.9:45910 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-14T05:27:55.013Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 15 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "104ad911-eba4-41c2-b96c-8dcc2333e467" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.132.0.31:443 10.133.0.9:45924 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-14T05:27:57.686455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:28:03.596348Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-14T05:28:07.777942Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-14T05:28:07.752Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 25 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "933e9037-55a1-4b9f-9dd9-a22269f21cc5" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.78:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.132.0.31:40268 10.132.0.31:443 10.133.0.9:57330 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-14T05:28:07.808Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 33 - "34.228.250.194,10.133.0.9" "python-requests/2.32.5" "5ebbf3d3-19f9-46b5-99d6-4411d6538bab" "maas.apps.c6d06d7f-bc5d-454a-af8a-85f576437b01.prod.konfluxeaas.com" "10.132.0.34:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.132.0.31:46064 10.132.0.31:443 10.133.0.9:57342 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-14T05:28:10.689204Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9