2026-09-16T18:37:13.445549Z info FLAG: --concurrency="0" 2026-09-16T18:37:13.445570Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-09-16T18:37:13.445573Z info FLAG: --help="false" 2026-09-16T18:37:13.445576Z info FLAG: --log_as_json="false" 2026-09-16T18:37:13.445578Z info FLAG: --log_caller="" 2026-09-16T18:37:13.445580Z info FLAG: --log_output_level="default:info" 2026-09-16T18:37:13.445582Z info FLAG: --log_stacktrace_level="default:none" 2026-09-16T18:37:13.445587Z info FLAG: --log_target="[stdout]" 2026-09-16T18:37:13.445590Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-09-16T18:37:13.445592Z info FLAG: --outlierLogPath="" 2026-09-16T18:37:13.445594Z info FLAG: --profiling="true" 2026-09-16T18:37:13.445596Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-09-16T18:37:13.445598Z info FLAG: --proxyLogLevel="warning" 2026-09-16T18:37:13.445600Z info FLAG: --serviceCluster="istio-proxy" 2026-09-16T18:37:13.445602Z info FLAG: --stsPort="0" 2026-09-16T18:37:13.445604Z info FLAG: --templateFile="" 2026-09-16T18:37:13.445606Z info FLAG: --tokenManagerPlugin="" 2026-09-16T18:37:13.445608Z info FLAG: --vklog="0" 2026-09-16T18:37:13.445611Z info Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean 2026-09-16T18:37:13.445760Z info Proxy role ips=[10.134.0.28] type=router id=maas-default-gateway-openshift-default-78bb78ff78-ltztx.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-09-16T18:37:13.445847Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-09-16T18:37:13.447222Z info cpu limit detected as 2, setting concurrency 2026-09-16T18:37:13.447509Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-09-16T18:37:13.447522Z info JWT policy is third-party-jwt 2026-09-16T18:37:13.447525Z info using credential fetcher of JWT type in cluster.local trust domain 2026-09-16T18:37:13.450054Z info Starting default Istio SDS Server 2026-09-16T18:37:13.450078Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-09-16T18:37:13.450117Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-09-16T18:37:13.450314Z info Opening status port 15020 2026-09-16T18:37:13.452286Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-09-16T18:37:13.452622Z info sds Starting SDS grpc server 2026-09-16T18:37:13.452714Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-09-16T18:37:13.453632Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-09-16T18:37:13.454627Z info Starting proxy agent 2026-09-16T18:37:13.454673Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-09-16T18:37:13.513225Z warning envoy main external/envoy/source/server/server.cc:901 Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future. thread=8 2026-09-16T18:37:13.513495Z warning envoy main external/envoy/source/server/server.cc:997 There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. thread=8 2026-09-16T18:37:13.520059Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-09-16T18:37:13.609062Z info ads ADS: new connection for node:1 2026-09-16T18:37:13.609492Z info ads ADS: new connection for node:2 2026-09-16T18:37:13.941459Z info cache generated new workload certificate resourceName=default latency=488.600708ms ttl=23h59m59.058546973s 2026-09-16T18:37:13.941495Z info cache Root cert has changed, start rotating root cert 2026-09-16T18:37:13.941536Z info cache returned workload trust anchor from cache ttl=23h59m59.058464793s 2026-09-16T18:37:13.941550Z info cache returned workload certificate from cache ttl=23h59m59.058450991s 2026-09-16T18:37:13.941680Z info cache returned workload trust anchor from cache ttl=23h59m59.058323231s 2026-09-16T18:37:13.942049Z info cache returned workload trust anchor from cache ttl=23h59m59.05795252s 2026-09-16T18:37:13.985484Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:37:19.923841Z info Readiness succeeded in 6.480826598s 2026-09-16T18:37:19.924153Z info Envoy proxy is ready 2026-09-16T18:37:25.842496Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:37:26.069339Z info ads ADS: new connection for node:3 2026-09-16T18:37:26.069479Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-16T18:37:26.069503Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-16T18:37:34.338753Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:37:41.257929Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:38:06.958153Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:38:17.076362Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:38:29.086128Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:38:48.582074Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:40:23.621483Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:40:23.590Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 321 30 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "fb72ffcd-bc8b-4d87-8cd1-50f4b39831d8" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38752 10.134.0.28:443 10.134.0.9:58166 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:40:23.712711Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T18:40:23.675Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 37 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "a74c08be-bc10-4b77-980e-7e53edfa2ce9" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38758 10.134.0.28:443 10.134.0.9:58182 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:23.771Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 328 57 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "e75e6429-88b4-40f1-9ab7-cddf957aac99" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56794 10.134.0.28:443 10.134.0.9:58184 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:40:23.871Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 501 22 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "77c3210d-18e5-4a15-80da-5c7ec72365ac" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56810 10.134.0.28:443 10.134.0.9:58196 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:40:23.920Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 320 18 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "087929a0-2386-4e67-8ca4-5c7ed37f3523" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56810 10.134.0.28:443 10.134.0.9:58198 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:40:23.962Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 343 16 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "070a7508-2693-476b-890f-aad4c49a8655" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56794 10.134.0.28:443 10.134.0.9:58200 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:40:24.008Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 479 20 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "dac89e22-95fc-46d4-bdce-449eb0acd1f6" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56810 10.134.0.28:443 10.134.0.9:58210 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:40:24.050Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "f4ed37a2-e31a-4866-bebf-b5ea812964cc" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:58212 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:40:24.094Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "65dc3c03-0ded-4dd7-89e6-9ccdfa34bae3" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:58214 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:40:24.132Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "f3a0b1b1-886d-4415-855b-821faeebffe1" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:58220 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:40:24.169Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "7b69f443-2cc4-49ba-9b84-befaef5bb4a6" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:58234 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:40:24.212Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 15 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "9485a138-7a6e-48ba-b75a-3399be57025e" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:58246 - llm.facebook-opt-125m-simulated-kserve-route.3 2026-09-16T18:40:24.333472Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:40:24.597014Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T18:40:24.630943Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:40:24.251Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "c07f28bd-a279-4d94-92e3-6dcf14b30236" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:58248 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:40:24.288Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 0 5 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "6e26890d-871e-4f99-8b1e-454479544cab" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:58260 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T18:40:24.319Z] "DELETE /v1/api-keys/14d042ad-7dc6-442c-a6c7-12e51f6e7e25 HTTP/1.1" 200 - via_upstream - "-" 0 365 14 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "26d0d060-336f-4a1a-8fb6-6c9448b74e3b" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38752 10.134.0.28:443 10.134.0.9:58268 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:24.593Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "3c7da178-0ee9-4413-904d-84d6574482bf" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38758 10.134.0.28:443 10.134.0.9:58270 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-16T18:40:24.618Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 12 - "34.228.250.194,10.134.0.9" "curl/7.76.1" "d7f9b5da-13ca-4556-bce6-de9dc033ab20" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38752 10.134.0.28:443 10.134.0.9:58272 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:40:36.739434Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:40:36.739462Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-09-16T18:40:36.815852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T18:40:36.852119Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T18:40:36.884193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-09-16T18:40:36.893769Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T18:40:36.893884Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:40:36.894036Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-09-16T18:40:36.940283Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T18:40:36.940434Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 2026-09-16T18:40:36.959952Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T18:40:37.126204Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T18:40:37.162592Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:40:37.224685Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T18:40:36.734Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 4 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "5f72d4f9-072a-4f24-8930-eeed69f7b580" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38752 10.134.0.28:443 10.134.0.9:35490 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-16T18:40:36.769Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 0 6 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "5b3adf02-ea2a-423f-a2cf-8235aa48e198" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.28:443 10.134.0.9:35498 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:36.802Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 13 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "d65e8a55-dd3e-9512-9eaf-fcbb2a3a4982" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38758 10.134.0.28:443 10.134.0.9:35502 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:36.837Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 14 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "42179e51-222c-4ad6-a8b2-d03766ff2c70" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38758 10.134.0.28:443 10.134.0.9:35512 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:36.880Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 13 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "a8a25e9f-804f-4113-8ac6-b320111b0d37" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38758 10.134.0.28:443 10.134.0.9:35526 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:36.871Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 111 126 22 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "c9d4d0b7-23d2-4e1b-9791-4b0a861a3d27" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56794 10.134.0.28:443 10.134.0.9:35516 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-16T18:40:36.917Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 10 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "1be7c982-db76-4145-bae1-41c292e92fcf" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.28:443 10.134.0.9:35528 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:36.923Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 16 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "800f0d08-6063-9b47-81ba-9b27274f7152" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56810 10.134.0.28:443 10.134.0.9:35532 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:40:36.946Z] "DELETE /v1/api-keys/857c5030-5db6-43f5-8918-b016e426bb47 HTTP/1.1" 200 - via_upstream - "-" 0 370 13 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "8ac8901e-f48d-4bc7-b71c-40b5a6b7db58" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38758 10.134.0.28:443 10.134.0.9:35538 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:37.111Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "ed3aac44-0436-4d2b-be14-1fff95bead43" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38758 10.134.0.28:443 10.134.0.9:35554 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:37.144Z] "DELETE /v1/api-keys/14847913-34ac-4028-90c4-5231d3cc4ba8 HTTP/1.1" 200 - via_upstream - "-" 0 321 18 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "7c68f2fe-f55a-451d-8733-7905a5045f1f" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38752 10.134.0.28:443 10.134.0.9:35564 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:37.182Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 10 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "b3312404-4ef2-4317-ab70-cc543cf1a27d" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.28:443 10.134.0.9:35568 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:37.211Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 13 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "149f847f-45cd-461f-9234-0254d68023c2" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38758 10.134.0.28:443 10.134.0.9:35584 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:40:37.257216Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T18:40:37.422563Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:40:37.456721Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:40:37.534312Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:40:37.568866Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T18:40:37.734076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:40:37.768022Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:40:37.833387Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:40:37.873247Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T18:40:37.964193Z info ads ADS: new connection for node:4 2026-09-16T18:40:37.968279Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-09-16T18:40:37.968324Z info cache read certificate from file resource=file-root:system 2026-09-16T18:40:38.030488Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:40:38.217768Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:40:37.243Z] "DELETE /v1/api-keys/7cf81d35-12f0-4fa3-813b-f35b34acd5a1 HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "7054b978-20e7-42b6-bfc1-86f90a91c441" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38758 10.134.0.28:443 10.134.0.9:35588 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:37.408Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "fd138390-6c63-4cc9-a17d-9a655cd7d34c" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38752 10.134.0.28:443 10.134.0.9:35604 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:37.440Z] "DELETE /v1/api-keys/b55c2ba4-24f5-4cee-beac-81435173c918 HTTP/1.1" 200 - via_upstream - "-" 0 321 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "332a5e83-2828-40fc-9db9-5ab2646ea428" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38752 10.134.0.28:443 10.134.0.9:35612 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:37.477Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 20 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "bc7b8bf2-21a5-4f20-9518-0488808e521f" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.28:443 10.134.0.9:35622 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:37.517Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "725a0d16-9151-4411-a527-a4a58b8cbeb8" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38752 10.134.0.28:443 10.134.0.9:35628 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:37.554Z] "DELETE /v1/api-keys/bf008334-f0d6-4ac3-8ae6-a2893e54ab6c HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "2636f2a2-7279-4c99-aa95-e1f9917b023b" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38758 10.134.0.28:443 10.134.0.9:35632 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:37.717Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "80be3248-015c-4dfc-b6af-1ba4c61161ff" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38752 10.134.0.28:443 10.134.0.9:35648 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:37.752Z] "DELETE /v1/api-keys/179dd743-17c4-4bb5-91b5-23c0703b4602 HTTP/1.1" 200 - via_upstream - "-" 0 321 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "f7922854-2778-4f81-8c21-c8f9faf2b642" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38752 10.134.0.28:443 10.134.0.9:35660 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:37.785Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 12 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "16ebc85b-a916-4570-8d78-b18886ffe2c2" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.28:443 10.134.0.9:35676 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:37.816Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "ebf040be-8143-4fb1-b900-f8e741080627" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38752 10.134.0.28:443 10.134.0.9:35686 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:37.855Z] "DELETE /v1/api-keys/38434a7f-c2c2-4539-ae40-c677c7905bea HTTP/1.1" 200 - via_upstream - "-" 0 321 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "c6862ba6-8e9c-4dbc-bd63-09f0ae8cd43a" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38758 10.134.0.28:443 10.134.0.9:35692 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:38.016Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "3e5aff49-89d0-422e-a064-13e4c7b0579f" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38752 10.134.0.28:443 10.134.0.9:35700 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:38.049Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 13 10 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "178641f9-89c2-46d1-8f2c-c1e96acfec61" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:35716 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:40:38.203Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "8581e2ce-8385-4026-a9a3-afbedf15f2f8" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38752 10.134.0.28:443 10.134.0.9:35732 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:40:38.337076Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T18:40:38.237Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 18 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "ee77a6a3-4dac-475e-bb2b-7b161612b419" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56794 10.134.0.28:443 10.134.0.9:35738 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:40:38.278Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 20 - "34.228.250.194,10.134.0.9" "-" "ebdac869-2e41-4ee5-a8a5-ad773a7acf38" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56794 10.134.0.28:443 10.134.0.9:35742 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:40:38.320Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 16 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "7a892b94-ea67-4d13-a8d9-939178d1af9a" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38758 10.134.0.28:443 10.134.0.9:35752 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:40:41.801871Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:40:42.508287Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T18:40:42.490Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "d9ee6957-cecb-4299-ad36-f835abd7e13d" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38758 10.134.0.28:443 10.134.0.9:34464 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:40:42.872Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 403 - - "-" 83 0 11 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "366f8fe2-3f28-486d-b412-ff523dcdd846" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.28:443 10.134.0.9:34468 - llm.e2e-external-model.0 [2026-09-16T18:40:42.908Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 6 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "5333977e-b343-945f-a76d-b5b0c8e1613e" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.28:443 10.134.0.9:34470 - llm.e2e-external-model.0 [2026-09-16T18:40:43.360Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 11 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "68465f43-fa3e-4357-a44d-a353a7d72d3d" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:34482 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T18:40:43.773341Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T18:40:43.773487Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-09-16T18:40:42.937Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 836 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "b6bbc6a2-b921-41d4-a660-5ac657f48f24" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.28:46680 10.134.0.28:443 10.134.0.9:34478 - llm.e2e-external-model.1 [2026-09-16T18:40:47.037Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 7 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "07987e65-d955-40fb-97f2-db7b032829a3" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" - - 10.134.0.28:443 10.134.0.9:34484 - - 2026-09-16T18:40:49.223092Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-16T18:40:56.525Z] "POST /llm/nonexistent-model-xyz/v1/chat/completions HTTP/1.1" 404 NR route_not_found - "-" 86 0 8 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "4694cae5-98e7-41e4-b67f-e7c950935d79" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" - - 10.134.0.28:443 10.134.0.9:41024 - - 2026-09-16T18:40:59.352810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:41:00.483539Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T18:41:00.469Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "1f420b94-d519-4870-af8b-0174129392b5" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38758 10.134.0.28:443 10.134.0.9:57588 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:41:00.508Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 13 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "a5671aee-915d-4b57-afcd-d5d718048de2" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:57594 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-16T18:41:01.366636Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T18:41:01.366957Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-09-16T18:41:00.229Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 1137 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "c97a920e-6101-4371-b3c0-a362248fbc4c" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.28:44794 10.134.0.28:443 10.134.0.9:57586 - llm.e2e-external-model.1 2026-09-16T18:41:02.497638Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:41:02.497897Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-09-16T18:41:02.595666Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T18:41:02.595943Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-16T18:41:01.401Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 82 39 1096 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "2d720c51-5ed8-4b35-a400-3d422d1cf235" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.28:44796 10.134.0.28:443 10.134.0.9:57604 - llm.e2e-external-model.2 [2026-09-16T18:41:02.525Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 52 39 70 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "ce9fc259-00d2-49c5-944a-f3f689c9494c" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.28:44796 10.134.0.28:443 10.134.0.9:57620 - llm.e2e-external-model.2 2026-09-16T18:41:03.841826Z info ads ADS: "" 4 terminated with stream closed 2026-09-16T18:41:06.940526Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T18:41:06.926Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 13 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "75dd039e-7e59-4977-948c-ad89bcde191d" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38758 10.134.0.28:443 10.134.0.9:57634 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T18:41:06.961Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 20 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "95b60e81-fb85-4e66-b73b-49c561480ff0" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56794 10.134.0.28:443 10.134.0.9:57636 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T18:41:07.979062Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-16T18:41:07.002Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 24 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "d3f67386-8fcb-4a50-8c0a-db4aa4587663" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56810 10.134.0.28:443 10.134.0.9:57640 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:41:07.049Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 20 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "8c867d82-e9a0-455d-84f4-4a3bfa9f92a7" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56794 10.134.0.28:443 10.134.0.9:57654 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T18:41:07.086Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 21 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "a6923a3d-3db6-4c01-b1d3-cefe3e842105" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56810 10.134.0.28:443 10.134.0.9:57660 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T18:41:36.646979Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T18:41:36.807412Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T18:41:36.280Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 8 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "3b361e0a-4777-423d-81de-e5e98c86189f" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" - - 10.134.0.28:443 10.134.0.9:35896 - - [2026-09-16T18:41:36.449Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 5 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "f4a9b914-cdfb-4da9-8dd7-b52fa28b6547" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" - - 10.134.0.28:443 10.134.0.9:35902 - - [2026-09-16T18:41:36.612Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 5 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "85c0cf22-3b15-4134-bc66-6f3b2db034a1" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" - - 10.134.0.28:443 10.134.0.9:35906 - - [2026-09-16T18:41:36.642Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 4 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "99373688-325b-441c-95f9-5c4cb5d0b1ca" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38758 10.134.0.28:443 10.134.0.9:35908 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-16T18:41:36.792Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "bd06f2d7-7fb8-4d38-90af-96bbebcac806" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38752 10.134.0.28:443 10.134.0.9:35924 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T18:45:12.442386Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T18:45:25.801689Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:01:53.276521Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T19:01:53.247Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 312 28 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "4909d906-8567-4254-9728-97a5a37b32c7" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:36468 10.134.0.28:443 10.134.0.9:42154 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:01:53.301Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 328 30 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "37895c36-957f-4df4-8a61-898780f61c29" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56794 10.134.0.28:443 10.134.0.9:42156 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-16T19:01:53.355Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 322 29 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "22dda313-6acb-4231-add5-2587facf8877" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56810 10.134.0.28:443 10.134.0.9:42170 - llm.facebook-opt-125m-simulated-kserve-route.2 2026-09-16T19:06:07.698880Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T19:06:07.673Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 25 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "aa4851ce-8c30-4243-80bc-f2db6d26c1dd" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:48604 10.134.0.28:443 10.134.0.9:38680 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T19:06:10.400063Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:06:12.034102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T19:06:12.017Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "c4fb713f-3928-4781-942e-b9f759acb444" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:41172 10.134.0.28:443 10.134.0.9:56646 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T19:07:34.689895Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:07:35.609651Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T19:07:35.594Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "e828f097-3e61-498d-af56-a05fa065451a" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:41242 10.134.0.28:443 10.134.0.9:37446 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T19:08:00.909455Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:08:04.227068Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T19:08:04.210Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 330 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "93bcf83d-57dc-4933-8d44-be68092d6779" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:41242 10.134.0.28:443 10.134.0.9:33664 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:08:04.255Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 44 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "b739dedf-08c7-44c3-9ac5-af80344c8b72" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.132.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:34218 10.134.0.28:443 10.134.0.9:33676 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:08:04.423Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 294 19 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "7a84d4d3-1b1c-4162-892a-fdf9eb7d80d1" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.132.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:34218 10.134.0.28:443 10.134.0.9:33686 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:08:04.564Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 21 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "d6272f11-a663-40b5-ab75-eceb1aed13dd" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.132.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:34230 10.134.0.28:443 10.134.0.9:33702 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:08:04.709Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 18 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "876a526e-3a35-48ff-8174-a0f1b5e58eef" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.132.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:34218 10.134.0.28:443 10.134.0.9:33712 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:08:04.864Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 18 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "89cc9314-f0d6-418a-8e55-a5b8e2a485cb" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.132.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:34218 10.134.0.28:443 10.134.0.9:33726 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:08:05.003Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "60689e14-03f1-4502-8873-255b0c520bec" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:33728 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-16T19:08:08.789629Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:08:12.996921Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:08:19.919122Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T19:08:20.110534Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T19:08:19.902Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 336 16 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "4b645666-e381-4c96-8b23-2ff11d9c2a03" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:41242 10.134.0.28:443 10.134.0.9:38500 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:08:19.943Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 20 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "25725cdc-2468-4017-a1c0-ca4ba47a3a19" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.132.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:34218 10.134.0.28:443 10.134.0.9:38514 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:08:19.984Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 16 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "77842bdd-a6ea-4897-948f-960a695f94b4" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.132.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:34218 10.134.0.28:443 10.134.0.9:38526 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:08:20.025Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "a2cd939f-ae44-4e5f-9084-751a61a2f7e2" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:38532 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:08:20.062Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "b7cf01fa-9123-47a2-bdba-602fc0dea141" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:40612 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:08:20.096Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 14 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "ab4a6115-7d90-4dd6-8446-6b618e4d034e" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.132.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:34218 10.134.0.28:443 10.134.0.9:40616 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.6 2026-09-16T19:08:20.920383Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T19:08:20.902Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 317 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "d988d98c-0f21-40ae-8a2d-0477e5628bb3" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:41242 10.134.0.28:443 10.134.0.9:40620 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:08:20.939Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "a39ae558-884d-4542-8546-fb56712dae19" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56794 10.134.0.28:443 10.134.0.9:40630 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T19:08:23.403978Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-16T19:08:24.032Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 281 18 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "fc6a2dce-f680-4bc9-a604-03e4f3d66cdc" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56810 10.134.0.28:443 10.134.0.9:40636 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:08:24.798Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 18 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "e07e5183-ec1b-4cca-b546-a63085a9350a" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56794 10.134.0.28:443 10.134.0.9:40650 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:08:25.877Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 292 19 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "963bca76-b513-4e0c-b173-40e502d72240" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56794 10.134.0.28:443 10.134.0.9:40662 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T19:08:28.492504Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:08:32.685972Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-16T19:08:33.500Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 10 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "64f19a16-8552-42f6-90b3-c71fee21a9ff" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:51438 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:08:36.561Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 11 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "66698c8c-05dc-489e-adb7-78612bb185f1" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:51448 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-16T19:08:37.441283Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T19:08:37.425Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "f9d19de8-112f-44e6-b05d-5a0deb4ca3e4" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:39388 10.134.0.28:443 10.134.0.9:51450 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:08:37.810Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 10 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "0d8739e0-a7c6-437b-92a3-8900fae1ad40" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:51458 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T19:08:41.090974Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:08:46.198181Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:08:47.940277Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T19:08:47.925Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 327 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "b14ea285-425a-48a6-bf3c-4d2c92fa2b5f" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:41242 10.134.0.28:443 10.134.0.9:57668 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:08:47.958Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 20 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "56578370-4277-44b5-931a-2b421611ffb5" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.39:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:56810 10.134.0.28:443 10.134.0.9:57674 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T19:08:49.252292Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T19:08:49.236Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "7d195400-c562-47e4-8e6e-965535970d16" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:41242 10.134.0.28:443 10.134.0.9:57678 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:08:49.608Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 10 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "a928d52e-cf00-4b7f-b60a-9eb4aeabb901" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:57690 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T19:08:50.481193Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:09:11.010291Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-09-16T19:09:57.862345Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T19:09:57.835Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 27 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "20feb0c5-2f5a-4aa9-a919-2afab20d8092" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:37342 10.134.0.28:443 10.134.0.9:50320 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:09:57.881Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 49 22 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "2de23ec2-a698-4f02-a2e6-ed50deff319a" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:50334 - llm.e2e-trlp-test-simulated-kserve-route.0 2026-09-16T19:10:21.189333Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-16T19:10:23.526Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 289 34 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "cb2786f6-3168-4e4a-9a1c-0cc3ec6c1a77" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.38:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:35928 10.134.0.28:443 10.134.0.9:39296 - llm.e2e-trlp-test-simulated-kserve-route.0 2026-09-16T19:10:24.169678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T19:10:24.154Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "9ff89043-d6e2-4c6d-ae62-bedc56e6a1c1" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:58030 10.134.0.28:443 10.134.0.9:39310 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T19:10:28.080524Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:10:28.726646Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T19:10:28.875685Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T19:10:28.711Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 40 329 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "b293fa50-9bf2-4c47-a625-109754d51c8a" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:37342 10.134.0.28:443 10.134.0.9:39318 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:10:28.864Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 479 11 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "1024db1a-ecdb-455c-99c6-8158f176de6f" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:58030 10.134.0.28:443 10.134.0.9:39324 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T19:10:32.578091Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:10:56.702698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:11:06.663623Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:11:39.653342Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T19:11:39.707075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T19:11:39.627Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 26 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "b116931e-c995-418b-bf30-780c71eebeae" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40972 10.134.0.28:443 10.134.0.9:57732 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:11:39.683Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 670 24 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "e54a6d70-f54b-4300-a596-31bba620d437" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40982 10.134.0.28:443 10.134.0.9:57746 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T19:11:43.931975Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:11:49.320086Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:11:51.113947Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T19:11:51.149006Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T19:11:51.095Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 18 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "7986d884-eef4-4ef4-be45-066ef5293069" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40982 10.134.0.28:443 10.134.0.9:50438 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:11:51.137Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 11 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "41f7d355-a393-4d41-a0c1-62ebb4c6e9bc" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40972 10.134.0.28:443 10.134.0.9:50450 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T19:11:53.700275Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:11:58.252429Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:12:05.406168Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T19:12:05.440167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T19:12:05.623744Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T19:12:05.382Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 23 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "0918eb5d-904b-4115-83a4-a77df0f42e8b" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40972 10.134.0.28:443 10.134.0.9:47424 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:12:05.428Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 11 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "2158f974-30dd-4778-af77-59e2ba05d9a1" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40982 10.134.0.28:443 10.134.0.9:47432 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:12:05.462Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 19 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "96adb336-32d7-4709-abce-a83281b3d908" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.132.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:34218 10.134.0.28:443 10.134.0.9:47440 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:12:05.502Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 297 17 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "1516999f-6dfc-45b4-8d36-dfad978792b1" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.132.0.28:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:34218 10.134.0.28:443 10.134.0.9:47454 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:12:05.539Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "1a5deedd-e71e-4d4c-a619-b7f3b9276604" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:47458 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:12:05.575Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 15 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "136db6e9-a3d9-4888-9333-d13d8cbf1d34" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:47466 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T19:12:05.613Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 10 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "75b920be-9d5a-46eb-a68a-7aa855a469ea" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40972 10.134.0.28:443 10.134.0.9:47478 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T19:12:08.821708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-16T19:12:13.414Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 39 22 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "94237c9c-2625-4a48-8aac-45d3eb5b9d54" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:50124 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-16T19:12:16.353841Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:12:21.770975Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T19:12:21.749Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 21 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "59f5e113-be1f-4bda-b651-0ae3dbe450d2" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.134.0.35:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40972 10.134.0.28:443 10.134.0.9:36180 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:12:21.789Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 37 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "ce5ef470-d2b5-4992-b71d-4fbec543c47a" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.132.0.27:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:46486 10.134.0.28:443 10.134.0.9:36186 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-16T19:12:21.946Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 20 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "83d12460-b25f-4a2e-81c4-98aa1c4cc095" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.132.0.27:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:46498 10.134.0.28:443 10.134.0.9:36188 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-16T19:12:22.090Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 19 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "2c688ed5-7fa5-435b-a937-be79d19bd294" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.132.0.27:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:46498 10.134.0.28:443 10.134.0.9:36202 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-16T19:12:22.230Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 16 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "26236e1f-ae68-4a0f-8b7b-193032cc4b70" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.134.0.9:36206 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-16T19:12:24.920669Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:12:31.113977Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T19:12:35.084102Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T19:12:35.054Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 316 29 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "63e03b65-e599-405c-862b-68b32e369a47" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.133.0.78:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:45178 10.134.0.28:443 10.134.0.9:46242 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T19:12:35.102Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 33 - "34.228.250.194,10.134.0.9" "python-requests/2.32.5" "35d2dcd0-49e1-4b64-88ca-c1fdaffbecd7" "maas.apps.23b38d92-af18-4fc0-94b2-b76e66556ed1.prod.konfluxeaas.com" "10.132.0.27:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:46486 10.134.0.28:443 10.134.0.9:46244 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-16T19:12:37.693931Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8