2026-09-16T13:18:15.948882Z info FLAG: --concurrency="0" 2026-09-16T13:18:15.948899Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-09-16T13:18:15.948903Z info FLAG: --help="false" 2026-09-16T13:18:15.948905Z info FLAG: --log_as_json="false" 2026-09-16T13:18:15.948907Z info FLAG: --log_caller="" 2026-09-16T13:18:15.948909Z info FLAG: --log_output_level="default:info" 2026-09-16T13:18:15.948912Z info FLAG: --log_stacktrace_level="default:none" 2026-09-16T13:18:15.948917Z info FLAG: --log_target="[stdout]" 2026-09-16T13:18:15.948919Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-09-16T13:18:15.948921Z info FLAG: --outlierLogPath="" 2026-09-16T13:18:15.948923Z info FLAG: --profiling="true" 2026-09-16T13:18:15.948926Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-09-16T13:18:15.948928Z info FLAG: --proxyLogLevel="warning" 2026-09-16T13:18:15.948930Z info FLAG: --serviceCluster="istio-proxy" 2026-09-16T13:18:15.948932Z info FLAG: --stsPort="0" 2026-09-16T13:18:15.948934Z info FLAG: --templateFile="" 2026-09-16T13:18:15.948936Z info FLAG: --tokenManagerPlugin="" 2026-09-16T13:18:15.948939Z info FLAG: --vklog="0" 2026-09-16T13:18:15.948941Z info Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean 2026-09-16T13:18:15.949087Z info Proxy role ips=[10.134.0.32] type=router id=maas-default-gateway-openshift-default-78bb78ff78-v5cfk.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-09-16T13:18:15.949172Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-09-16T13:18:15.950261Z info cpu limit detected as 2, setting concurrency 2026-09-16T13:18:15.950492Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-09-16T13:18:15.950504Z info JWT policy is third-party-jwt 2026-09-16T13:18:15.950507Z info using credential fetcher of JWT type in cluster.local trust domain 2026-09-16T13:18:15.952608Z info Opening status port 15020 2026-09-16T13:18:15.953246Z info Starting default Istio SDS Server 2026-09-16T13:18:15.953274Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-09-16T13:18:15.953296Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-09-16T13:18:15.954194Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-09-16T13:18:15.955493Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-09-16T13:18:15.956374Z info Starting proxy agent 2026-09-16T13:18:15.956404Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-09-16T13:18:15.964241Z info sds Starting SDS grpc server 2026-09-16T13:18:15.964262Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-09-16T13:18:16.011790Z warning envoy main external/envoy/source/server/server.cc:901 Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future. thread=9 2026-09-16T13:18:16.012118Z warning envoy main external/envoy/source/server/server.cc:997 There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. thread=9 2026-09-16T13:18:16.017870Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-09-16T13:18:16.082958Z info cache generated new workload certificate resourceName=default latency=128.560518ms ttl=23h59m59.917049853s 2026-09-16T13:18:16.083003Z info cache Root cert has changed, start rotating root cert 2026-09-16T13:18:16.083050Z info cache returned workload trust anchor from cache ttl=23h59m59.916950703s 2026-09-16T13:18:16.107428Z info ads ADS: new connection for node:1 2026-09-16T13:18:16.107598Z info cache returned workload certificate from cache ttl=23h59m59.892404715s 2026-09-16T13:18:16.107731Z info ads ADS: new connection for node:2 2026-09-16T13:18:16.107812Z info cache returned workload trust anchor from cache ttl=23h59m59.892189226s 2026-09-16T13:18:16.152810Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T13:18:22.310691Z info Readiness succeeded in 6.364088879s 2026-09-16T13:18:22.310992Z info Envoy proxy is ready 2026-09-16T13:18:29.050689Z info ads ADS: new connection for node:3 2026-09-16T13:18:29.050832Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-16T13:18:29.050874Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-16T13:18:29.348756Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T13:18:38.155484Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T13:18:49.262800Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T13:18:57.274793Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T13:19:08.092566Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T13:19:14.091467Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T13:19:34.600697Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T13:20:42.561450Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T13:20:42.532Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 29 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "2ecd77ba-7900-4ff8-9fe7-8701c57ba9a2" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42694 10.134.0.32:443 10.132.0.10:37120 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T13:20:42.645752Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T13:20:42.607Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 37 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "8a566a96-dced-4fd8-b8ea-475b981e3d42" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42706 10.134.0.32:443 10.132.0.10:37136 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:20:42.701Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 473 57 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "e7011ef8-4539-4b4a-b878-97d93fb264b0" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.133.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.32:60572 10.134.0.32:443 10.132.0.10:37138 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T13:20:42.806Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 422 21 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "8927947a-aa4a-4560-be8e-3666d3216c09" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.133.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.32:60584 10.134.0.32:443 10.132.0.10:37146 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T13:20:42.858Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 362 16 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "882a1831-5594-94db-b9fa-e9451491972a" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.133.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.32:60572 10.134.0.32:443 10.132.0.10:37156 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T13:20:42.911Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "e3c77f00-f726-4494-b7b9-b6ff8c902cfe" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.32:443 10.132.0.10:37164 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T13:20:42.955Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "d0ab50f7-2749-41c4-a530-efcf956a3909" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.32:443 10.132.0.10:37180 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T13:20:42.997Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "7fcaaebd-cf2b-4d0a-9162-4be2fe36f867" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.32:443 10.132.0.10:37182 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T13:20:43.036Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "c18c9f57-04be-40f8-a101-eca145ed0953" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.32:443 10.132.0.10:37188 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T13:20:43.079Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "0c9a2a0e-b25f-4488-bad7-a414b84a5a8e" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.32:443 10.132.0.10:37190 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T13:20:43.117Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "fa5199bd-3476-4878-b342-d374d094756c" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.32:443 10.132.0.10:37204 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T13:20:43.157Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "47e011f7-3d95-42ef-a523-4dd02675e164" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.32:443 10.132.0.10:37216 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T13:20:43.200Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "0b666b21-9ceb-4baf-b8e8-b8ac2d17d9ec" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.32:443 10.132.0.10:37224 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T13:20:43.250Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 0 5 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "36705f3d-b3a5-4906-83e2-16f1d86b850d" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.32:443 10.132.0.10:37232 - llm.facebook-opt-125m-simulated-kserve-route.3 2026-09-16T13:20:43.296598Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T13:20:43.599982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T13:20:43.640007Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T13:20:43.282Z] "DELETE /v1/api-keys/3f9fc367-07ae-4afe-8ceb-ea167d559272 HTTP/1.1" 200 - via_upstream - "-" 0 365 13 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "afe95ece-3765-4e28-8e86-3095b8846fe6" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42706 10.134.0.32:443 10.132.0.10:37244 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:20:43.596Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "8d8b0a75-0a12-4564-89a3-c4ad8b7318c5" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42706 10.134.0.32:443 10.132.0.10:37256 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-16T13:20:43.627Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 12 - "52.71.36.72,10.132.0.10" "curl/7.76.1" "a14b5206-0ad8-47d0-b8ea-20da7d3384ff" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42694 10.134.0.32:443 10.132.0.10:37262 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T13:20:58.610031Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T13:20:58.680559Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T13:20:58.719662Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T13:20:58.762680Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=26 2026-09-16T13:20:58.762804Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T13:20:58.762981Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 2026-09-16T13:20:58.777778Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-09-16T13:20:58.779872Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T13:20:58.811339Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T13:20:58.811489Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-09-16T13:20:58.847796Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T13:20:59.034378Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T13:20:59.071788Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T13:20:59.136787Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T13:20:59.176252Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T13:20:59.252504Z info ads ADS: new connection for node:4 2026-09-16T13:20:59.255378Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-09-16T13:20:59.255427Z info cache read certificate from file resource=file-root:system [2026-09-16T13:20:58.605Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 4 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "b8e31105-4d54-40d9-9310-7b74846eb82b" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42706 10.134.0.32:443 10.132.0.10:55704 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-16T13:20:58.635Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 0 5 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "2e1cd886-fe92-44ce-bc52-51006d3ecb6c" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.32:443 10.132.0.10:55716 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:20:58.665Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 14 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "f9fa4463-04a2-4416-826b-9a65cfb76253" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42706 10.134.0.32:443 10.132.0.10:55724 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:20:58.705Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 14 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "44a290b7-decc-46f2-8fd3-601987663f64" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42694 10.134.0.32:443 10.132.0.10:55734 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:20:58.743Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 111 126 19 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "c529bc88-8d28-4c89-844c-976a26699046" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.133.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.32:60572 10.134.0.32:443 10.132.0.10:55742 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-16T13:20:58.766Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 13 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "6ce48849-1d8e-4f7c-a404-25ee42ec6080" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42706 10.134.0.32:443 10.132.0.10:55756 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:20:58.792Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 19 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "0f4f2f34-1464-49ef-8d93-8baa1d8ae2dc" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.133.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.32:60584 10.134.0.32:443 10.132.0.10:55770 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T13:20:58.803Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 9 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "0089a54c-5cf6-4b9b-bd19-1b138774974d" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.32:443 10.132.0.10:55784 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:20:58.834Z] "DELETE /v1/api-keys/9e6aac55-2fd6-4fb3-bd97-d39db5de6282 HTTP/1.1" 200 - via_upstream - "-" 0 370 13 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "67e2e053-e802-4b01-ac71-268f045beb42" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42706 10.134.0.32:443 10.132.0.10:55800 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:20:59.020Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "77b6d97e-7ce4-4031-9f45-d65559376054" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42694 10.134.0.32:443 10.132.0.10:55804 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:20:59.058Z] "DELETE /v1/api-keys/e03f2d2e-d3a8-4a9b-b57a-45b149c97537 HTTP/1.1" 200 - via_upstream - "-" 0 321 12 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "40947c07-fbeb-4cd5-adb4-f9bd2edb0140" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42694 10.134.0.32:443 10.132.0.10:55816 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:20:59.092Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 9 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "6f4fc354-4c73-4cb0-8f0d-d8e5fe39bb76" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.32:443 10.132.0.10:55818 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:20:59.123Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 13 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "a2e4d4bb-7a81-4b85-8808-4c854109f6e8" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42694 10.134.0.32:443 10.132.0.10:55832 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:20:59.163Z] "DELETE /v1/api-keys/6fe83baf-e881-43af-9a32-8a44a936f72c HTTP/1.1" 200 - via_upstream - "-" 0 321 13 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "75e2cce1-ddf1-4630-8383-60de9300862f" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42706 10.134.0.32:443 10.132.0.10:55838 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T13:20:59.354612Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T13:20:59.389734Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T13:20:59.460167Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T13:20:59.492896Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T13:20:59.674947Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T13:20:59.869224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T13:20:59.991566Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T13:20:59.336Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 17 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "e5fa4813-c8b7-4a35-85de-e6648b5483a1" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42706 10.134.0.32:443 10.132.0.10:55844 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:20:59.375Z] "DELETE /v1/api-keys/c5b38391-fc4f-462a-b991-edb4037c5597 HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "edb195a9-9327-49ce-b834-6081048211fc" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42694 10.134.0.32:443 10.132.0.10:55852 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:20:59.412Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 12 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "8dfe8219-83c4-42a1-a8c3-8aa4db5ce98b" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.32:443 10.132.0.10:55858 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:20:59.444Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "d66277bc-a9d7-48d5-adab-6b425254522e" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42694 10.134.0.32:443 10.132.0.10:55862 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:20:59.478Z] "DELETE /v1/api-keys/9a1764d5-0107-4a91-bd36-9927687949d3 HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "c168df32-c04b-4467-94cb-6e06e83a74aa" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42706 10.134.0.32:443 10.132.0.10:55866 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:20:59.659Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "6f837688-cfe6-439e-9d6a-a94a1c3022bc" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42694 10.134.0.32:443 10.132.0.10:55872 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:20:59.696Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 13 11 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "2a10e4ae-0dff-4c78-a4a3-8012dd77360e" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.32:443 10.132.0.10:55882 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T13:20:59.855Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 13 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "1bef7ffe-8e15-4aef-a1b0-3de91beac200" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42694 10.134.0.32:443 10.132.0.10:55888 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:20:59.888Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 21 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "7ca60502-7b6e-400d-9eb2-d34396430279" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.133.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.32:60584 10.134.0.32:443 10.132.0.10:55890 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T13:20:59.929Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 287 24 - "52.71.36.72,10.132.0.10" "-" "eb247ba6-03d8-46fc-b1ac-725404fad778" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.133.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.32:60572 10.134.0.32:443 10.132.0.10:55898 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T13:20:59.977Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 14 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "92f62a23-4612-4d9c-8405-5f14309c20bd" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42694 10.134.0.32:443 10.132.0.10:55902 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T13:21:03.559676Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T13:21:04.266566Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T13:21:04.251Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 320 14 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "ee436e5d-5326-4d39-9d69-688e6190aafa" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42706 10.134.0.32:443 10.132.0.10:60346 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:21:04.651Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 403 - - "-" 83 0 11 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "cc4630e9-457a-421d-97ca-cb87d480636d" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.32:443 10.132.0.10:60358 - llm.e2e-external-model.0 [2026-09-16T13:21:04.691Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 6 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "4c38b2e4-22f6-4b6b-b72a-d03dd9edf6aa" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.32:443 10.132.0.10:60370 - llm.e2e-external-model.0 [2026-09-16T13:21:05.019Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 14 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "c6c166d0-2c55-4755-89de-4e2fa0fde102" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.32:443 10.132.0.10:60400 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T13:21:06.646694Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T13:21:06.646839Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-09-16T13:21:06.590Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 5 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "cd2d1890-43f4-4f98-bbf3-0a36b576c5c5" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" - - 10.134.0.32:443 10.132.0.10:60412 - - [2026-09-16T13:21:04.725Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 1921 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "a271120a-07d9-4094-b8f3-b6ef808dd7a9" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.32:55998 10.134.0.32:443 10.132.0.10:60386 - llm.e2e-external-model.1 2026-09-16T13:21:11.156552Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 [2026-09-16T13:21:19.317Z] "POST /llm/nonexistent-model-xyz/v1/chat/completions HTTP/1.1" 404 NR route_not_found - "-" 86 0 9 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "57fcd8b5-d3b4-447e-974c-2506fd0d45f0" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" - - 10.134.0.32:443 10.132.0.10:57564 - - 2026-09-16T13:21:24.486687Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T13:21:24.486881Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-16T13:21:23.021Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 1465 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "619bb256-8e0f-4320-90ff-d2046346cb7d" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.32:52934 10.134.0.32:443 10.132.0.10:45482 - llm.e2e-external-model.1 2026-09-16T13:21:25.111115Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T13:21:26.485791Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T13:21:26.486166Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-09-16T13:21:24.512Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 82 39 1973 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "d7b5ecec-7563-46da-9507-0b5f5f5c906b" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.32:52936 10.134.0.32:443 10.132.0.10:45488 - llm.e2e-external-model.2 2026-09-16T13:21:27.948770Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 2026-09-16T13:21:27.949044Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=26 [2026-09-16T13:21:26.513Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 52 39 1435 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "0793b4fb-3323-4a7e-a766-10dd832cc491" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.32:52936 10.134.0.32:443 10.132.0.10:45504 - llm.e2e-external-model.2 2026-09-16T13:21:37.648731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T13:21:39.202678Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T13:21:39.187Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 15 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "bc71b683-b3d2-4d27-a6c7-621f680b0e86" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42706 10.134.0.32:443 10.132.0.10:41522 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:21:39.255Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 29 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "f33df6f9-e751-4f32-8b23-35686b1b17d3" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.32:443 10.132.0.10:41526 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-16T13:21:46.442951Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T13:21:58.976191Z info ads ADS: "" 4 terminated 2026-09-16T13:22:01.403132Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T13:22:11.168002Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T13:22:11.154Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 13 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "3899ecdb-248b-450a-a2fa-acd945868228" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42706 10.134.0.32:443 10.132.0.10:54924 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:22:11.196Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 21 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "e4dbf9ff-35ce-4e30-980a-01f92b126b65" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.133.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.32:60584 10.134.0.32:443 10.132.0.10:54936 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T13:22:11.247Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 282 20 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "9bd9b4ed-fc04-43f5-af6a-d9f2a903bab9" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.133.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.32:60584 10.134.0.32:443 10.132.0.10:54944 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T13:22:11.291Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 18 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "bb797642-48b2-42a6-a50b-f3d7d9230d9f" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.133.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.32:60584 10.134.0.32:443 10.132.0.10:54946 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T13:22:11.328Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 20 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "eb04b4a0-8aa2-4e4c-afb7-e0e2a11299a1" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.133.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.32:60572 10.134.0.32:443 10.132.0.10:54958 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T13:22:12.491590Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T13:22:24.660989Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T13:22:24.849160Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T13:22:24.269Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 7 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "a5d2ac95-6b2f-4938-aad7-f96cd7ecb9c5" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" - - 10.134.0.32:443 10.132.0.10:58674 - - [2026-09-16T13:22:24.421Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 5 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "3383fb90-b429-469e-b5da-d2d6ad041c82" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" - - 10.134.0.32:443 10.132.0.10:58676 - - [2026-09-16T13:22:24.604Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 5 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "2caf3c22-2000-4449-a5c0-0b0e73bfa8c2" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "-" - - 10.134.0.32:443 10.132.0.10:58684 - - [2026-09-16T13:22:24.651Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 9 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "936a873d-dc27-4849-a011-9ca13c9bcb67" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42706 10.134.0.32:443 10.132.0.10:58688 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-16T13:22:24.826Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 22 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "d0c7c241-8513-4655-b762-7ebff9d96acf" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:42706 10.134.0.32:443 10.132.0.10:58698 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T13:24:13.162910Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T13:24:19.446880Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=9 2026-09-16T13:50:57.665118Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=2 2026-09-16T13:54:55.672843Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T13:54:55.647Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 25 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "8e7150b2-1f9a-4f90-8e5c-ebe73dc16232" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:45576 10.134.0.32:443 10.132.0.10:53986 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T13:56:30.587596Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T13:56:30.573Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 14 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "d0daf87a-244c-4e2d-a099-d4977670db81" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:59062 10.134.0.32:443 10.132.0.10:34410 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T13:59:59.120539Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=26 [2026-09-16T13:59:59.089Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 31 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "8b4da949-d7fb-4505-b9ee-26ecfef6e006" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.134.0.39:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.32:49904 10.134.0.32:443 10.132.0.10:38256 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T13:59:59.143Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 35 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "855cf08b-ac6d-4bb1-9220-3780a79897c6" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.133.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.32:60572 10.134.0.32:443 10.132.0.10:38258 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T14:00:00.058Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 19 - "52.71.36.72,10.132.0.10" "python-requests/2.32.5" "73962135-10c7-49cf-8529-0865f88a489d" "maas.apps.52e29412-bb05-42e5-b2cc-67bf69d1c3bb.prod.konfluxeaas.com" "10.133.0.49:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.32:60584 10.134.0.32:443 10.132.0.10:38274 - llm.facebook-opt-125m-simulated-kserve-route.0