2026-09-16T12:17:01.545035Z info FLAG: --concurrency="0" 2026-09-16T12:17:01.545055Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-09-16T12:17:01.545058Z info FLAG: --help="false" 2026-09-16T12:17:01.545061Z info FLAG: --log_as_json="false" 2026-09-16T12:17:01.545063Z info FLAG: --log_caller="" 2026-09-16T12:17:01.545065Z info FLAG: --log_output_level="default:info" 2026-09-16T12:17:01.545068Z info FLAG: --log_stacktrace_level="default:none" 2026-09-16T12:17:01.545075Z info FLAG: --log_target="[stdout]" 2026-09-16T12:17:01.545078Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-09-16T12:17:01.545080Z info FLAG: --outlierLogPath="" 2026-09-16T12:17:01.545083Z info FLAG: --profiling="true" 2026-09-16T12:17:01.545085Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-09-16T12:17:01.545087Z info FLAG: --proxyLogLevel="warning" 2026-09-16T12:17:01.545089Z info FLAG: --serviceCluster="istio-proxy" 2026-09-16T12:17:01.545091Z info FLAG: --stsPort="0" 2026-09-16T12:17:01.545093Z info FLAG: --templateFile="" 2026-09-16T12:17:01.545095Z info FLAG: --tokenManagerPlugin="" 2026-09-16T12:17:01.545098Z info FLAG: --vklog="0" 2026-09-16T12:17:01.545100Z info Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean 2026-09-16T12:17:01.545255Z info Proxy role ips=[10.134.0.42] type=router id=maas-default-gateway-openshift-default-78bb78ff78-h6qjt.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-09-16T12:17:01.545300Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-09-16T12:17:01.546476Z info cpu limit detected as 2, setting concurrency 2026-09-16T12:17:01.546753Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-09-16T12:17:01.546765Z info JWT policy is third-party-jwt 2026-09-16T12:17:01.546768Z info using credential fetcher of JWT type in cluster.local trust domain 2026-09-16T12:17:01.548640Z info Starting default Istio SDS Server 2026-09-16T12:17:01.548684Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-09-16T12:17:01.548707Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-09-16T12:17:01.548912Z info Opening status port 15020 2026-09-16T12:17:01.549787Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-09-16T12:17:01.550268Z info sds Starting SDS grpc server 2026-09-16T12:17:01.550285Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-09-16T12:17:01.551009Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-09-16T12:17:01.551851Z info Starting proxy agent 2026-09-16T12:17:01.551882Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-09-16T12:17:01.607541Z warning envoy main external/envoy/source/server/server.cc:901 Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future. thread=8 2026-09-16T12:17:01.607852Z warning envoy main external/envoy/source/server/server.cc:997 There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. thread=8 2026-09-16T12:17:01.613719Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-09-16T12:17:01.700649Z info ads ADS: new connection for node:1 2026-09-16T12:17:01.701089Z info ads ADS: new connection for node:2 2026-09-16T12:17:01.780181Z info cache generated new workload certificate resourceName=default latency=229.77594ms ttl=23h59m59.219824301s 2026-09-16T12:17:01.780217Z info cache Root cert has changed, start rotating root cert 2026-09-16T12:17:01.780305Z info cache returned workload trust anchor from cache ttl=23h59m59.219695702s 2026-09-16T12:17:01.780591Z info cache returned workload certificate from cache ttl=23h59m59.219410735s 2026-09-16T12:17:01.781265Z info cache returned workload trust anchor from cache ttl=23h59m59.218736761s 2026-09-16T12:17:01.781450Z info cache returned workload trust anchor from cache ttl=23h59m59.218551763s 2026-09-16T12:17:01.825570Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:17:07.995554Z info Readiness succeeded in 6.452654104s 2026-09-16T12:17:07.995850Z info Envoy proxy is ready 2026-09-16T12:17:11.094181Z info ads ADS: new connection for node:3 2026-09-16T12:17:11.094312Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-16T12:17:11.094340Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-16T12:17:11.462033Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:17:36.265259Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:17:48.905015Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:18:00.585935Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:18:11.098273Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:18:19.717283Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:18:27.026789Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:19:46.601713Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T12:19:46.570Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 321 30 - "34.228.250.194,10.133.0.12" "curl/7.76.1" "6c426331-b835-9e88-9901-651355c150e2" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50172 10.134.0.42:443 10.133.0.12:42966 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T12:19:46.689600Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T12:19:46.652Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 37 - "34.228.250.194,10.133.0.12" "curl/7.76.1" "df0c6f71-d98f-4c9a-809a-ca59501da09c" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50172 10.134.0.42:443 10.133.0.12:42978 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T12:19:46.989997Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-09-16T12:19:47.310532Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T12:19:47.559998Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T12:19:47.596104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T12:19:46.746Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 334 57 - "34.228.250.194,10.133.0.12" "curl/7.76.1" "ff3f2d72-ffce-48e3-9b12-b65603c77845" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:40798 10.134.0.42:443 10.133.0.12:42982 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T12:19:46.844Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 346 16 - "34.228.250.194,10.133.0.12" "curl/7.76.1" "39341a69-97e8-4608-95cd-aef14a08994c" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:40798 10.134.0.42:443 10.133.0.12:42996 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T12:19:46.885Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 544 16 - "34.228.250.194,10.133.0.12" "curl/7.76.1" "2902f194-4c99-4683-9114-8c259502531e" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:40798 10.134.0.42:443 10.133.0.12:43006 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T12:19:46.931Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 333 16 - "34.228.250.194,10.133.0.12" "curl/7.76.1" "839c512e-ae97-4422-9285-aa53d4f7d786" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:40798 10.134.0.42:443 10.133.0.12:43018 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T12:19:46.974Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 336 16 - "34.228.250.194,10.133.0.12" "curl/7.76.1" "473c31bb-7be1-4423-bac3-22cd767a76e4" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:40798 10.134.0.42:443 10.133.0.12:43034 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T12:19:47.018Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 17 - "34.228.250.194,10.133.0.12" "curl/7.76.1" "a06aa22b-cf62-4331-9718-eb155389fa81" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:43048 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T12:19:47.060Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.133.0.12" "curl/7.76.1" "440668db-fa6d-4b00-9930-2049dc56093a" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:43060 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T12:19:47.105Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.133.0.12" "curl/7.76.1" "e373a47d-5b33-4d12-b4fc-798c4f80aac9" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:43062 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T12:19:47.144Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "34.228.250.194,10.133.0.12" "curl/7.76.1" "d987398c-e5c2-4a27-a264-1fa09bf325d9" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:43066 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T12:19:47.185Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.133.0.12" "curl/7.76.1" "d9890d7a-1a23-4af7-8526-b2c1104c9494" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:43068 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T12:19:47.229Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 14 - "34.228.250.194,10.133.0.12" "curl/7.76.1" "a7d87928-f04d-4aeb-898d-363c62c0e7e5" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:43072 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T12:19:47.267Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 0 5 - "34.228.250.194,10.133.0.12" "curl/7.76.1" "ee6dbad3-fd81-4460-afb0-9334b44157af" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:43074 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-16T12:19:47.296Z] "DELETE /v1/api-keys/56faeb3c-ba8b-4327-a6c0-1b98499f7d6c HTTP/1.1" 200 - via_upstream - "-" 0 365 13 - "34.228.250.194,10.133.0.12" "curl/7.76.1" "56209020-5b96-4d8a-8db2-4a1fc902a08c" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50172 10.134.0.42:443 10.133.0.12:43086 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:19:47.556Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 4 - "34.228.250.194,10.133.0.12" "curl/7.76.1" "96e6e86b-1bc9-43e0-8769-fa11e5bc228d" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50172 10.134.0.42:443 10.133.0.12:43098 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-16T12:19:47.582Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 13 - "34.228.250.194,10.133.0.12" "curl/7.76.1" "c1b4f8e2-1611-4c83-b1f3-487b45356a3a" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50174 10.134.0.42:443 10.133.0.12:43102 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T12:20:00.112162Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T12:20:00.195092Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T12:20:00.236407Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T12:20:00.262948Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T12:20:00.279518Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T12:20:00.279693Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-09-16T12:20:00.323880Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T12:20:00.324066Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-09-16T12:20:00.325777Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T12:20:00.503193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T12:20:00.537450Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T12:20:00.598829Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T12:20:00.630724Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T12:20:00.662159Z info ads ADS: new connection for node:4 2026-09-16T12:20:00.666701Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-09-16T12:20:00.666744Z info cache read certificate from file resource=file-root:system [2026-09-16T12:20:00.106Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 5 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "932e3823-5cb2-47d5-a574-71eaaec2c10d" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50172 10.134.0.42:443 10.133.0.12:46982 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-16T12:20:00.141Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 0 6 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "99c6492f-36e3-4f8f-9679-1399ae9433b4" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.42:443 10.133.0.12:46986 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:00.182Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 12 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "34a583de-6b96-4bf9-8ccb-8b1ce3280979" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50172 10.134.0.42:443 10.133.0.12:46994 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:00.222Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 13 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "532bd7cb-9afd-40e9-950f-bfec9852bded" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50174 10.134.0.42:443 10.133.0.12:46996 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:00.247Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 15 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "4fcb8eac-58d6-40fd-8208-9e30b99bdb5d" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50172 10.134.0.42:443 10.133.0.12:47010 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:00.257Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 111 126 22 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "e546734b-1f15-4422-ae80-3af7b4a01151" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:40798 10.134.0.42:443 10.133.0.12:47026 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-16T12:20:00.284Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 7 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "2bff5d21-247e-4b95-b772-5b1ab6ce790d" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.42:443 10.133.0.12:47036 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:00.303Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 20 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "5cf96c1f-80e1-936f-bf07-eed855b0713b" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:55008 10.134.0.42:443 10.133.0.12:47048 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:20:00.311Z] "DELETE /v1/api-keys/0f85d162-dc56-4e7b-9a6b-3883520eace8 HTTP/1.1" 200 - via_upstream - "-" 0 370 14 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "48ffbd68-eeab-4cf9-8444-91fb4a131468" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50172 10.134.0.42:443 10.133.0.12:47060 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:00.489Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 13 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "b5182e21-1a64-44a3-bceb-f251c4ba7da5" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50174 10.134.0.42:443 10.133.0.12:47074 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:00.523Z] "DELETE /v1/api-keys/ca46d904-8ce1-41a3-941e-30014cd40564 HTTP/1.1" 200 - via_upstream - "-" 0 321 13 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "9bff4eb3-7ed1-4448-aefd-bcf6da95c2a4" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50174 10.134.0.42:443 10.133.0.12:47090 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:00.556Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 9 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "6839736a-f859-43fd-a38d-ba17dd1f78cb" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.42:443 10.133.0.12:47100 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:00.585Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 13 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "e62609c2-8ebb-401f-93f7-b6fcb9b623e1" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50174 10.134.0.42:443 10.133.0.12:47104 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:00.617Z] "DELETE /v1/api-keys/174043d3-90ff-480a-a6ef-d4ee656329f0 HTTP/1.1" 200 - via_upstream - "-" 0 321 13 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "9dfd9283-3ac5-4d6f-81da-e5756ba7f3c8" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50172 10.134.0.42:443 10.133.0.12:47120 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T12:20:00.808723Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T12:20:00.845274Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T12:20:00.924481Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T12:20:00.959536Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T12:20:01.124096Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T12:20:01.151218Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-09-16T12:20:01.320837Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T12:20:01.460417Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T12:20:00.794Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "b127b641-1527-4543-b0a9-bddc301ed5ff" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50172 10.134.0.42:443 10.133.0.12:47126 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:00.828Z] "DELETE /v1/api-keys/9e68cac6-6536-4b0c-9ada-28bd7dd90e16 HTTP/1.1" 200 - via_upstream - "-" 0 321 16 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "8bc17f3b-5d2d-4529-bd29-905e660c7bd9" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50172 10.134.0.42:443 10.133.0.12:47134 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:00.869Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 10 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "37096872-030c-4c09-88a0-2f86bf705b49" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.42:443 10.133.0.12:47148 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:00.900Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 23 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "088422fd-db4b-446b-987f-322bc11cfcdb" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50172 10.134.0.42:443 10.133.0.12:47154 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:00.945Z] "DELETE /v1/api-keys/543992a3-57ac-4a50-973f-0779b616278a HTTP/1.1" 200 - via_upstream - "-" 0 321 13 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "aac118b2-a223-441a-94af-ebb1334abaa7" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50174 10.134.0.42:443 10.133.0.12:47156 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:01.105Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 18 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "fcd0d1cc-b023-4c98-9552-7cb7ac3a159c" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50172 10.134.0.42:443 10.133.0.12:47162 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:01.146Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 13 12 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "63147c27-b189-4029-980d-b17fa1f1bd48" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:47174 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:20:01.306Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "c57f51f9-650a-46b0-9e2c-9b046ca9dd28" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50172 10.134.0.42:443 10.133.0.12:47190 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:01.339Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 20 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "2ae1c08a-ee87-4e69-8133-142fb9c2e613" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:55008 10.134.0.42:443 10.133.0.12:47206 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:20:01.381Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 19 - "34.228.250.194,10.133.0.12" "-" "84ef818e-28f8-4189-945e-437e0d811845" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:55008 10.134.0.42:443 10.133.0.12:47212 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:20:01.445Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 14 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "1d1aa773-e571-44b3-a58e-979fe5911b1f" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50172 10.134.0.42:443 10.133.0.12:47228 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T12:20:04.152943Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:20:05.599446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T12:20:05.583Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 15 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "58571b64-66f4-4adf-bee3-4c1e2afdcedd" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50172 10.134.0.42:443 10.133.0.12:53418 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:05.947Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 403 - - "-" 83 0 10 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "14c6b699-c6f9-4865-86ae-44173e3e3243" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.42:443 10.133.0.12:53434 - llm.e2e-external-model.0 [2026-09-16T12:20:05.978Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 5 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "d61237f2-83f9-431b-b177-d7a71c55729f" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.42:443 10.133.0.12:53450 - llm.e2e-external-model.0 [2026-09-16T12:20:06.488Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 12 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "acb28b0b-8b3d-467d-a0f1-e2c957e36999" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:53468 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T12:20:08.647555Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T12:20:08.647738Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-09-16T12:20:08.151Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 5 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "b21e9647-6cc1-4db9-bb69-de8e8644a71b" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" - - 10.134.0.42:443 10.133.0.12:53480 - - [2026-09-16T12:20:06.006Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 2641 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "bebc21fa-ee02-44ff-8048-3fec284feb75" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.42:33830 10.134.0.42:443 10.133.0.12:53456 - llm.e2e-external-model.1 2026-09-16T12:20:11.844272Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-16T12:20:21.328Z] "POST /llm/nonexistent-model-xyz/v1/chat/completions HTTP/1.1" 404 NR route_not_found - "-" 86 0 9 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "c9f89a3f-e7ae-4beb-b232-652563907ed8" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" - - 10.134.0.42:443 10.133.0.12:60648 - - 2026-09-16T12:20:22.205589Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:20:23.622483Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T12:20:23.604Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 18 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "b8f396df-b63a-4d2b-998e-36c0532244de" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50174 10.134.0.42:443 10.133.0.12:37414 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:23.645Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 22 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "2e01b3d6-5d2f-455d-bca5-7fd5c23cc144" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:37430 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-16T12:20:25.658577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T12:20:25.630Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 27 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "422ecc41-8eb7-4248-98f6-b9aa454c5a8c" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50174 10.134.0.42:443 10.133.0.12:37458 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:20:25.697Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 280 44 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "fe9a30c6-c8bf-4e42-bf2d-f6bed129e3d7" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:40798 10.134.0.42:443 10.133.0.12:37466 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:20:25.769Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 44 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "15079a04-a092-4b62-bfca-24c407d8db48" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:55008 10.134.0.42:443 10.133.0.12:37482 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:20:25.846Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 55 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "2e42b0aa-369f-4303-8a29-916acea18c4b" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:55008 10.134.0.42:443 10.133.0.12:37490 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:20:25.925Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 48 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "72117ba6-3b02-48d4-a6d2-312c9d90c6db" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:55008 10.134.0.42:443 10.133.0.12:37504 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T12:20:28.562471Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T12:20:28.562741Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-16T12:20:25.097Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 3465 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "c4f5961b-7992-42e5-9c94-536671d07143" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.42:50536 10.134.0.42:443 10.133.0.12:37442 - llm.e2e-external-model.1 2026-09-16T12:20:30.895602Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T12:20:30.895883Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-16T12:20:28.587Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 82 39 2308 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "cad2c5c4-abac-4d38-8acb-b1ef4e894e0e" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.42:50536 10.134.0.42:443 10.133.0.12:37510 - llm.e2e-external-model.2 2026-09-16T12:20:33.130466Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T12:20:33.130622Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-09-16T12:20:30.919Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 52 39 2211 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "9f1838d3-1b89-4236-8d87-4f72820368e8" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.42:41360 10.134.0.42:443 10.133.0.12:37518 - llm.e2e-external-model.2 2026-09-16T12:20:34.330043Z info ads ADS: "" 4 terminated 2026-09-16T12:20:39.238746Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T12:20:39.391010Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T12:20:38.876Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 19 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "6715d1c8-8261-4147-b94a-928b325a1a6f" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" - - 10.134.0.42:443 10.133.0.12:44386 - - [2026-09-16T12:20:39.042Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 5 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "73929c32-9f5c-4c9e-a4f5-5cd9c710a58a" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" - - 10.134.0.42:443 10.133.0.12:44388 - - [2026-09-16T12:20:39.187Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 14 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "a886a563-37c8-4062-b581-e3259e25657b" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" - - 10.134.0.42:443 10.133.0.12:44398 - - [2026-09-16T12:20:39.231Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 7 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "61cec1c9-95d7-472d-b3d3-45f14dfd54b7" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50174 10.134.0.42:443 10.133.0.12:44400 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-16T12:20:39.371Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 19 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "d5479fab-c239-48f6-bd9c-d0d6e44662a6" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:50174 10.134.0.42:443 10.133.0.12:44406 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T12:20:40.551856Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:24:13.660228Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:24:28.246842Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:30:20.807959Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:30:41.362516Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:38:18.701316Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T12:38:18.675Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 311 26 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "3a427c35-9c83-46c1-b2c7-778653612f2b" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:55388 10.134.0.42:443 10.133.0.12:53022 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:38:18.724Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 322 34 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "67fc36ab-00fb-4881-8f2c-a7b7d878158f" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:40798 10.134.0.42:443 10.133.0.12:53038 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-16T12:38:18.779Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 329 18 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "1580e1c5-e9fa-472d-bfcc-f4947afe2fcc" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:55008 10.134.0.42:443 10.133.0.12:53048 - llm.facebook-opt-125m-simulated-kserve-route.2 2026-09-16T12:41:57.205069Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T12:41:57.187Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 17 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "e7a606d1-054a-49b6-b574-2b2251485c63" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:45230 10.134.0.42:443 10.133.0.12:50644 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T12:41:59.363869Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-16T12:41:59.545421Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-16T12:41:59.349Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 14 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "c704d837-156b-41ac-9926-61521afa314a" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:45230 10.134.0.42:443 10.133.0.12:50648 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T12:43:23.616861Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:43:24.001363Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T12:43:23.983Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 17 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "5f94b422-fa6b-4a52-8d29-767ba00ca109" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:54652 10.134.0.42:443 10.133.0.12:34788 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T12:43:49.723558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:43:53.269852Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T12:43:53.243Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 26 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "c2303e40-6842-4aa8-b0ba-6924aaff4a12" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:54652 10.134.0.42:443 10.133.0.12:54300 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:43:53.292Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 45 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "18c4bf9d-5431-4b2f-8f9a-7a5453abe96f" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:36376 10.134.0.42:443 10.133.0.12:54304 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:43:53.459Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 293 17 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "75368b08-87c8-432c-add8-5405997f5b27" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:36376 10.134.0.42:443 10.133.0.12:54316 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:43:53.596Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 291 20 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "a47457c2-a4e1-4ed7-ac03-f9f7447a5695" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:36378 10.134.0.42:443 10.133.0.12:54322 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:43:53.737Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 18 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "26da2042-0d29-435c-bfcf-4b6df827fc50" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:36378 10.134.0.42:443 10.133.0.12:54332 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:43:53.872Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 18 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "2b4e91db-de5e-4091-9e0e-0cfb1f210b44" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:36376 10.134.0.42:443 10.133.0.12:54338 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:43:54.014Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 15 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "f363075c-934e-43d7-8af4-4aa6dfe7a865" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:54348 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-16T12:43:57.534934Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:44:02.564308Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T12:44:02.722010Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T12:44:02.547Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 16 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "cdf0af71-6001-449f-b4b2-46c44b87b3f7" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:33286 10.134.0.42:443 10.133.0.12:43390 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:44:02.583Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 298 20 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "65334890-2897-47f2-8dbd-cfca20e3d292" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:36376 10.134.0.42:443 10.133.0.12:43392 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:44:02.623Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 17 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "de5f9588-da17-4710-9684-8c3c954e6d89" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:43396 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:44:02.669Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "8567a849-0c3e-4fc8-ba17-1d6936efc372" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:43398 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:44:02.706Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 15 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "2969d428-8069-45b4-9bee-a1d78c7e58d0" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:36376 10.134.0.42:443 10.133.0.12:43408 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.6 2026-09-16T12:44:03.427882Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T12:44:03.412Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 316 14 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "72948983-9ec7-4bdd-a3b8-246637a26af8" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:54652 10.134.0.42:443 10.133.0.12:43420 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:44:03.444Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 18 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "300e75a6-b806-4513-9d6d-9709ae05b898" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:55008 10.134.0.42:443 10.133.0.12:43422 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:44:04.336Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 18 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "234d38d6-c412-407a-b186-9acf6c7eed15" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:40798 10.134.0.42:443 10.133.0.12:43428 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T12:44:05.632387Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:44:16.739494Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-16T12:44:20.058Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 20 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "7d3d50a4-6e0d-4c99-ba17-66836981860b" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:40798 10.134.0.42:443 10.133.0.12:42558 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T12:44:22.941806Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-16T12:44:31.112Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 26 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "d781950c-2a6a-4582-9ebd-fd67b40345c2" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:55008 10.134.0.42:443 10.133.0.12:52356 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:44:36.563Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 11 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "0a011cda-87b4-4d38-bc78-1dc6277361de" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:56124 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:44:41.630Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 10 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "10c630c3-782b-4b5e-8df3-a039d5be7bf5" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:56140 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-16T12:44:42.437016Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T12:44:42.422Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 14 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "2f3be939-2a5e-4a9a-a2d3-597644705738" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:54652 10.134.0.42:443 10.133.0.12:60164 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:44:42.792Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 10 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "de470757-475c-43d6-b28e-a386614d7238" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:60176 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T12:44:48.940343Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:44:50.737831Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T12:44:50.720Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 327 17 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "60538401-5149-442e-a770-1f0a115d2feb" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:33286 10.134.0.42:443 10.133.0.12:60178 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:44:50.756Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 19 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "c904c831-dc92-4b4f-8694-ea4e41bc1389" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.37:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:40798 10.134.0.42:443 10.133.0.12:60184 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T12:44:52.024996Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T12:44:52.010Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 14 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "f9106707-bdf2-4d91-bc43-f685450bd03c" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:33286 10.134.0.42:443 10.133.0.12:60194 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:44:52.382Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 10 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "974c785f-0a8c-4571-8e3b-e9206902e0f7" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:55816 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-16T12:44:54.722445Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:45:56.170107Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T12:45:56.152Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 313 18 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "3dd142db-fe3b-4271-af36-3de5a703b1ff" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:33812 10.134.0.42:443 10.133.0.12:52482 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:45:56.194Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 49 20 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "43e8ca2d-2059-4825-9539-a6694485b7e0" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:52496 - llm.e2e-trlp-test-simulated-kserve-route.0 2026-09-16T12:46:17.159357Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-16T12:46:19.429Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 302 31 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "7e97b259-fbbe-47fe-beda-341d1ff51094" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.133.0.36:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:47880 10.134.0.42:443 10.133.0.12:53788 - llm.e2e-trlp-test-simulated-kserve-route.0 2026-09-16T12:46:20.055351Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T12:46:20.041Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 13 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "650ff981-a916-4242-bacb-f3d001fe8a95" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:33812 10.134.0.42:443 10.133.0.12:53794 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T12:46:23.763916Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:46:24.420153Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T12:46:24.571444Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T12:46:24.405Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 40 329 14 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "282df8f6-ed6b-4fa8-8f8a-c9f7b43dfd9a" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:33812 10.134.0.42:443 10.133.0.12:57386 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:46:24.558Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 479 13 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "09e08501-14d3-480c-81df-08cd367e48bb" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:45784 10.134.0.42:443 10.133.0.12:57398 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T12:46:28.179244Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:46:41.585934Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:46:51.580103Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:47:26.244061Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T12:47:26.288320Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T12:47:26.227Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 322 16 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "9728bb4b-5e54-4534-82a4-b071605cfea3" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:49838 10.134.0.42:443 10.133.0.12:53838 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:47:26.266Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 670 21 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "34c678e2-9869-4214-9402-1b311aa60437" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:49846 10.134.0.42:443 10.133.0.12:53840 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T12:47:30.003247Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:47:35.029160Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:47:36.287846Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T12:47:36.319255Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T12:47:36.271Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 16 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "19eb299b-e8ff-4015-a903-ae36da139fa9" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:49838 10.134.0.42:443 10.133.0.12:42014 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:47:36.308Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 10 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "543c58cf-d978-4a4a-acb8-f99a25f92461" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:49838 10.134.0.42:443 10.133.0.12:42016 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T12:47:38.884831Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:47:46.185522Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T12:47:46.213782Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-16T12:47:46.341741Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-16T12:47:46.170Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 331 14 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "376537a5-60ae-425d-afb3-2ec6b5093741" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:49838 10.134.0.42:443 10.133.0.12:57358 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:47:46.203Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 10 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "d5720287-c2ff-4cb8-b83a-e99067e30c6a" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:49838 10.134.0.42:443 10.133.0.12:57374 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:47:46.232Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 297 18 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "6d3c8d19-73b3-462a-8bd1-ce3084304e43" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.133.0.37:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:36378 10.134.0.42:443 10.133.0.12:57388 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:47:46.267Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "89551703-fd20-40da-96e3-1cebbfdf650c" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:57394 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:47:46.298Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "08ec0480-1579-4882-8a5d-3538164bfc86" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:57408 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-16T12:47:46.332Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 9 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "edc701db-9a0f-499d-bfe7-f529f3e0888a" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:49846 10.134.0.42:443 10.133.0.12:57414 - odh-ai-gateway-infra.maas-api-route.3 2026-09-16T12:47:48.567191Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-16T12:47:53.837Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 39 16 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "1d473595-9fe1-4372-ac02-5f15f4dc5aa0" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:45486 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-16T12:47:56.258212Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:47:59.909727Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T12:47:59.893Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 16 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "78fcb88d-d6b1-4135-bbf1-243e4fba7134" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.34:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:49838 10.134.0.42:443 10.133.0.12:45492 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:47:59.927Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 31 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "0cde9e06-b47a-47d1-975e-bb0bf7c61c54" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:42962 10.134.0.42:443 10.133.0.12:45498 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-16T12:48:00.088Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 18 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "5451eb31-1926-4352-bd30-f71ebae86ad0" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:42962 10.134.0.42:443 10.133.0.12:45510 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-16T12:48:00.229Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 20 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "81674d5e-0874-4f93-a778-eea58247db68" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:42974 10.134.0.42:443 10.133.0.12:45516 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-16T12:48:00.371Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 15 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "50f1e257-d290-4016-9c32-5f9dcbc4e5e2" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.42:443 10.133.0.12:45518 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-16T12:48:03.269261Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:48:07.363639Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-16T12:48:14.098180Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-16T12:48:14.075Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 22 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "36ff617d-5ea8-4fb7-8261-23b5e2a5c800" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.132.0.88:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.42:51072 10.134.0.42:443 10.133.0.12:57708 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-16T12:48:14.120Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 31 - "34.228.250.194,10.133.0.12" "python-requests/2.32.5" "1200c664-8856-4d97-8c34-9e5d10a27255" "maas.apps.f28f7a17-0ae3-4004-8e14-54964f0e9541.prod.konfluxeaas.com" "10.134.0.44:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.42:42962 10.134.0.42:443 10.133.0.12:57720 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-16T12:48:15.782935Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8