2026-09-19T09:22:44.952288Z info FLAG: --concurrency="0" 2026-09-19T09:22:44.952314Z info FLAG: --domain="openshift-ingress.svc.cluster.local" 2026-09-19T09:22:44.952318Z info FLAG: --help="false" 2026-09-19T09:22:44.952320Z info FLAG: --log_as_json="false" 2026-09-19T09:22:44.952322Z info FLAG: --log_caller="" 2026-09-19T09:22:44.952324Z info FLAG: --log_output_level="default:info" 2026-09-19T09:22:44.952326Z info FLAG: --log_stacktrace_level="default:none" 2026-09-19T09:22:44.952331Z info FLAG: --log_target="[stdout]" 2026-09-19T09:22:44.952333Z info FLAG: --meshConfig="./etc/istio/config/mesh" 2026-09-19T09:22:44.952335Z info FLAG: --outlierLogPath="" 2026-09-19T09:22:44.952337Z info FLAG: --profiling="true" 2026-09-19T09:22:44.952339Z info FLAG: --proxyComponentLogLevel="misc:error" 2026-09-19T09:22:44.952341Z info FLAG: --proxyLogLevel="warning" 2026-09-19T09:22:44.952343Z info FLAG: --serviceCluster="istio-proxy" 2026-09-19T09:22:44.952345Z info FLAG: --stsPort="0" 2026-09-19T09:22:44.952346Z info FLAG: --templateFile="" 2026-09-19T09:22:44.952348Z info FLAG: --tokenManagerPlugin="" 2026-09-19T09:22:44.952351Z info FLAG: --vklog="0" 2026-09-19T09:22:44.952353Z info Version 1.27.8-05659db4d2c3082fe25be2712780475d56cc782c-Clean 2026-09-19T09:22:44.952496Z info Proxy role ips=[10.134.0.28] type=router id=maas-default-gateway-openshift-default-78bb78ff78-4fvmc.openshift-ingress domain=openshift-ingress.svc.cluster.local 2026-09-19T09:22:44.952544Z info Apply proxy config from env {"discoveryAddress":"istiod-openshift-gateway.openshift-ingress.svc:15012","proxyHeaders":{"server":{"disabled":true},"envoyDebugHeaders":{"disabled":true},"metadataExchangeHeaders":{"mode":"IN_MESH"}}} 2026-09-19T09:22:44.953606Z info cpu limit detected as 2, setting concurrency 2026-09-19T09:22:44.953831Z info Effective config: binaryPath: /usr/local/bin/envoy concurrency: 2 configPath: ./etc/istio/proxy controlPlaneAuthPolicy: MUTUAL_TLS discoveryAddress: istiod-openshift-gateway.openshift-ingress.svc:15012 drainDuration: 45s proxyAdminPort: 15000 proxyHeaders: envoyDebugHeaders: disabled: true metadataExchangeHeaders: mode: IN_MESH server: disabled: true serviceCluster: istio-proxy statNameLength: 189 statusPort: 15020 terminationDrainDuration: 5s 2026-09-19T09:22:44.953842Z info JWT policy is third-party-jwt 2026-09-19T09:22:44.953846Z info using credential fetcher of JWT type in cluster.local trust domain 2026-09-19T09:22:44.955599Z info Starting default Istio SDS Server 2026-09-19T09:22:44.955651Z info Opening status port 15020 2026-09-19T09:22:44.955961Z info CA Endpoint istiod-openshift-gateway.openshift-ingress.svc:15012, provider Citadel 2026-09-19T09:22:44.955998Z info Using CA istiod-openshift-gateway.openshift-ingress.svc:15012 cert with certs: var/run/secrets/istio/root-cert.pem 2026-09-19T09:22:44.957171Z info xdsproxy Initializing with upstream address "istiod-openshift-gateway.openshift-ingress.svc:15012" and cluster "Kubernetes" 2026-09-19T09:22:44.958287Z info Pilot SAN: [istiod-openshift-gateway.openshift-ingress.svc] 2026-09-19T09:22:44.959099Z info Starting proxy agent 2026-09-19T09:22:44.959129Z info Envoy command: [-c etc/istio/proxy/envoy-rev.json --drain-time-s 45 --drain-strategy immediate --local-address-ip-version v4 --file-flush-interval-msec 1000 --disable-hot-restart --allow-unknown-static-fields -l warning --component-log-level misc:error --skip-deprecated-logs --concurrency 2] 2026-09-19T09:22:44.967537Z info sds Starting SDS grpc server 2026-09-19T09:22:44.967561Z info sds Starting SDS server for workload certificates, will listen on "var/run/secrets/workload-spiffe-uds/socket" 2026-09-19T09:22:45.014150Z warning envoy main external/envoy/source/server/server.cc:901 Usage of the deprecated runtime key overload.global_downstream_max_connections, consider switching to `envoy.resource_monitors.global_downstream_max_connections` instead.This runtime key will be removed in future. thread=8 2026-09-19T09:22:45.014471Z warning envoy main external/envoy/source/server/server.cc:997 There is no configured limit to the number of allowed active downstream connections. Configure a limit in `envoy.resource_monitors.global_downstream_max_connections` resource monitor. thread=8 2026-09-19T09:22:45.020074Z info xdsproxy connected to delta upstream XDS server: istiod-openshift-gateway.openshift-ingress.svc:15012 id=1 2026-09-19T09:22:45.104379Z info ads ADS: new connection for node:1 2026-09-19T09:22:45.104820Z info ads ADS: new connection for node:2 2026-09-19T09:22:45.137911Z info cache generated new workload certificate resourceName=default latency=180.434026ms ttl=23h59m59.862093579s 2026-09-19T09:22:45.137971Z info cache Root cert has changed, start rotating root cert 2026-09-19T09:22:45.138004Z info cache returned workload trust anchor from cache ttl=23h59m59.861996077s 2026-09-19T09:22:45.138028Z info cache returned workload certificate from cache ttl=23h59m59.861972314s 2026-09-19T09:22:45.138139Z info cache returned workload trust anchor from cache ttl=23h59m59.861863551s 2026-09-19T09:22:45.138347Z info cache returned workload trust anchor from cache ttl=23h59m59.86165395s 2026-09-19T09:22:45.179990Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:22:50.808812Z info Readiness succeeded in 5.858878355s 2026-09-19T09:22:50.809104Z info Envoy proxy is ready 2026-09-19T09:23:02.727271Z info ads ADS: new connection for node:3 2026-09-19T09:23:02.727748Z info cache adding watcher for file certificate /var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-19T09:23:02.727877Z info cache read certificate from file resource=file-root:/var/run/secrets/kubernetes.io/serviceaccount/service-ca.crt 2026-09-19T09:23:03.108580Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:23:06.894795Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:23:21.282699Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:23:29.998882Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:23:41.399338Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:24:02.721386Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:24:18.028194Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:25:37.755301Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T09:25:37.725Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 55 320 29 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "33cd827f-0507-450a-8bc1-df5e5a522252" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:57662 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T09:25:37.839381Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:25:38.561408Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T09:25:37.806Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 32 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "d1c67e27-3a32-41bd-a37c-be1c9b15b282" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:57674 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:37.906Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 346 58 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "313b17ac-d08b-42a6-bff0-1c2e0f335e97" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45078 10.134.0.28:443 10.133.0.9:57682 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T09:25:38.007Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 520 20 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "afe4e600-2e7a-4659-bad0-c02bdba93cd4" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45086 10.134.0.28:443 10.133.0.9:57694 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T09:25:38.063Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 122 439 16 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "2bb46c07-8f2e-49a2-8c65-f12f889b6d5b" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45078 10.134.0.28:443 10.133.0.9:57706 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T09:25:38.130Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "58477289-de8c-4b64-8cd1-b6507206e299" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:57710 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T09:25:38.173Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "22377613-8f3b-960b-8734-dfd34638da13" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:57722 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T09:25:38.232Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "272797c7-9153-4867-b146-d692f7489580" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:57730 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T09:25:38.281Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "e7925b8d-d0c2-4d1f-a154-7d3072b883b0" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:57744 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T09:25:38.320Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "521cf412-5560-4ca0-a4a6-dc8f2a8f7fa5" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:57748 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T09:25:38.381Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "083d6467-fc1d-46e0-9e51-19cb7c853245" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:57764 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T09:25:38.440Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 13 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "a6f616e9-6fb6-4d3a-9592-26d5d6fcd4bc" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:57780 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T09:25:38.479Z] "POST /v1/chat/completions HTTP/1.1" 429 - - "-" 122 18 12 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "9438f7ab-4551-4110-830f-ded6124644aa" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:57796 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T09:25:38.515Z] "POST /v1/chat/completions HTTP/1.1" 401 - - "-" 122 0 4 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "d7567aba-464b-4cc3-804a-cfec1ec73c83" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:57812 - llm.facebook-opt-125m-simulated-kserve-route.3 [2026-09-19T09:25:38.545Z] "DELETE /v1/api-keys/a27ef5cd-f9d8-4730-8824-582384038341 HTTP/1.1" 200 - via_upstream - "-" 0 365 16 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "2ad296d1-5280-4e95-bb40-7ce78ef528c9" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40310 10.134.0.28:443 10.133.0.9:57822 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T09:25:38.821511Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:25:38.865289Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T09:25:38.817Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 3 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "62330c4b-0d20-4afe-9755-c51245a1a195" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:57826 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-19T09:25:38.853Z] "GET /v1/subscriptions HTTP/1.1" 200 - via_upstream - "-" 0 488 12 - "52.71.36.72,10.133.0.9" "curl/7.76.1" "82b6c39a-cffe-426b-b795-e6efc38bdd33" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:57828 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T09:25:51.289604Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T09:25:51.353887Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:25:51.390906Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:25:51.427427Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=25 2026-09-19T09:25:51.445037Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:25:51.445218Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-09-19T09:25:51.450982Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T09:25:51.493573Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:25:51.493719Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 2026-09-19T09:25:51.514504Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T09:25:51.284Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 5 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "f5bf8e0d-9c22-4f5f-9652-a2f0ed403ad4" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40310 10.134.0.28:443 10.133.0.9:57774 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-19T09:25:51.311Z] "POST /maas-api/v1/tokens HTTP/1.1" 401 - - "-" 20 0 6 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "d030f333-e8de-4759-beb7-b162e226498f" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.28:443 10.133.0.9:57786 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:51.340Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 13 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "60afeae7-bed5-4870-8daf-025dbc90749c" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:57794 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:51.376Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 321 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "904e3cfb-d8b1-4993-b960-b579aa31adf2" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:57804 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:51.423Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 111 126 22 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "d1d69d47-169d-4ff1-83be-e43e3d006e0f" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45086 10.134.0.28:443 10.133.0.9:57816 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-19T09:25:51.436Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 326 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "5975b539-f5a2-4ab9-a64e-28c44fdb4141" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40310 10.134.0.28:443 10.133.0.9:57818 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:51.473Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 83 0 8 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "d8e33ded-7d6c-4976-8a3a-783d2f3c2f01" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.28:443 10.133.0.9:57828 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:51.473Z] "POST /v1/completions HTTP/1.1" 404 - via_upstream - "-" 94 126 20 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "72450a9a-a18a-4a42-b864-1a74e6f3505e" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45086 10.134.0.28:443 10.133.0.9:57826 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:25:51.500Z] "DELETE /v1/api-keys/76e44510-b4cf-4e53-90de-5f155d382d10 HTTP/1.1" 200 - via_upstream - "-" 0 370 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "8eefb093-651b-48a3-923c-90f82af6dcde" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:57844 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T09:25:51.677447Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:25:51.715175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T09:25:51.715197Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Tracing span buffer full (100), dropping oldest spans to prevent memory growth thread=24 2026-09-19T09:25:51.779994Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:25:51.817610Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:25:52.004104Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:25:52.044454Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:25:52.120110Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:25:52.154193Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:25:52.320577Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:25:52.358091Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T09:25:52.431470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:25:52.446846Z info ads ADS: new connection for node:4 2026-09-19T09:25:52.451331Z info cache adding watcher for file certificate /etc/pki/tls/certs/ca-bundle.crt 2026-09-19T09:25:52.451386Z info cache read certificate from file resource=file-root:system 2026-09-19T09:25:52.468962Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:25:52.625226Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T09:25:51.663Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "f50ffa0b-310f-4873-ba36-38cbc876c52e" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:57860 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:51.700Z] "DELETE /v1/api-keys/22e94489-3785-4d83-b0b3-3b21f9869dcc HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "4c881a6b-f43e-48a7-ab68-4787c4ed368a" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40310 10.134.0.28:443 10.133.0.9:57862 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:51.735Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 9 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "8a9d51cd-764f-431e-a53e-0d7a473164ab" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.28:443 10.133.0.9:57864 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:51.766Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 13 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "88e23342-fc9a-49b6-8960-883e515d943f" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:57870 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:51.803Z] "DELETE /v1/api-keys/640aafc6-f522-4862-b0e1-7f5e2d9a69dd HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "d852c84d-70f9-4ed3-b7ed-1e486789c9eb" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:57874 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:51.986Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "259bae2c-368f-4ae5-8569-ebd374cfd470" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:57890 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:52.023Z] "DELETE /v1/api-keys/11415427-5394-4e27-86e1-505fe7063b64 HTTP/1.1" 200 - via_upstream - "-" 0 321 20 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "e10df4eb-ba9e-43bc-b471-b0b74c233c20" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:57894 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:52.065Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 19 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "1fd065d7-e3c2-43f9-8d77-e8586f38f0ee" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.28:443 10.133.0.9:57896 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:52.103Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 16 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "803e7657-1a48-44ce-a78b-b3fa2ccb9d45" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:57912 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:52.139Z] "DELETE /v1/api-keys/722aadcc-1cf6-4f78-8d17-277ab5ec3b12 HTTP/1.1" 200 - via_upstream - "-" 0 321 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "5f8c90ff-f168-4a04-8358-35485c9ef986" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:57924 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:52.305Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 15 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "cb71000d-7447-4368-87eb-5e13e9028862" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:60264 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:52.341Z] "DELETE /v1/api-keys/79ce1315-ec75-43a9-8ce3-b03a9787cd93 HTTP/1.1" 200 - via_upstream - "-" 0 321 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "0bfc1124-c624-4905-9850-ac593f3ec81a" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40310 10.134.0.28:443 10.133.0.9:60276 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:52.378Z] "POST /maas-api/v1/api-keys HTTP/1.1" 403 - - "-" 77 0 11 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "09e2b049-c11b-4d03-87a8-32ac29a94e36" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local - 10.134.0.28:443 10.133.0.9:60290 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:52.410Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 20 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "0353c446-2530-4caf-8eb6-e8af2a08ff89" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:60304 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:52.450Z] "DELETE /v1/api-keys/c5ea9295-8a72-4c65-a865-1869e186c8f7 HTTP/1.1" 200 - via_upstream - "-" 0 321 18 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "e454daa5-035a-4e95-b51a-7d07979b4948" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:60320 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:52.610Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "5efd8625-1613-4754-aca9-1ea42a3ea621" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40310 10.134.0.28:443 10.133.0.9:60332 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:52.643Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 13 13 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "a4229b43-8668-4861-aa28-ecd3fd3cecbd" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:60336 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T09:25:52.814265Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T09:25:52.799Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "e61c78de-7c77-47d6-81b9-5852ea757220" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:60342 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T09:25:56.362246Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:25:57.055185Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T09:25:57.039Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 79 322 15 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "6bec59c8-d6f7-444f-8dfc-4c92bec49485" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:60346 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:25:57.409Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 403 - - "-" 83 0 11 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "d72f85ab-fef1-44fd-8eaa-e0ef1fb73c98" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.28:443 10.133.0.9:60358 - llm.e2e-external-model.0 [2026-09-19T09:25:57.444Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 401 - - "-" 83 0 6 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "7b3d7246-ac88-4ac2-a1b4-8ec16d1732a1" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|443||httpbingo.org - 10.134.0.28:443 10.133.0.9:60366 - llm.e2e-external-model.0 [2026-09-19T09:25:59.684Z] "GET /v1/tenants HTTP/1.1" 404 NR route_not_found - "-" 0 0 4 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "0fbdf028-f227-4156-a244-fd58bf3e1706" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" - - 10.134.0.28:443 10.133.0.9:60384 - - 2026-09-19T09:26:00.166010Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T09:26:00.166188Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 2026-09-19T09:26:00.941554Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T09:25:57.474Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 2691 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "538d16f8-8914-4d11-b1b9-169be029bffd" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.28:57762 10.134.0.28:443 10.133.0.9:60368 - llm.e2e-external-model.1 [2026-09-19T09:26:00.844Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 20 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "11119b69-ffd7-46db-8f2b-24324fdf2d83" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45078 10.134.0.28:443 10.133.0.9:60386 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:26:00.884Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 278 21 - "52.71.36.72,10.133.0.9" "-" "993a1e26-d351-4606-91e8-5e726f35503d" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45086 10.134.0.28:443 10.133.0.9:60394 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:26:00.926Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 316 15 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "9336389e-7530-4776-b627-0f93590e1fd5" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:60410 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T09:26:04.708452Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-19T09:26:05.967Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 0 11 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "bedddb21-0773-4553-bc97-b6100e1558f8" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:59566 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:26:12.830Z] "POST /llm/nonexistent-model-xyz/v1/chat/completions HTTP/1.1" 404 NR route_not_found - "-" 86 0 6 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "135bb18b-0cdd-44a9-882e-fbab622f8674" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" - - 10.134.0.28:443 10.133.0.9:38860 - - 2026-09-19T09:26:13.593870Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:26:14.593823Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T09:26:14.578Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "b9428677-8d6a-4e0e-82f1-8372f652e756" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40304 10.134.0.28:443 10.133.0.9:38868 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:26:14.627Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 20 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "dab7fbef-0c8f-4e35-88dc-ad2df8540c2e" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:38874 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-19T09:26:16.560552Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T09:26:16.544Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 314 16 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "e193ff32-8eec-445b-bf16-cd4338f6ef49" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40310 10.134.0.28:443 10.133.0.9:38886 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:26:16.585Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 19 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "712f0528-645d-4729-8083-9234f043903e" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45086 10.134.0.28:443 10.133.0.9:38902 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:26:16.634Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 283 23 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "42cf73db-739a-4922-9571-a0c4317a7e45" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45086 10.134.0.28:443 10.133.0.9:38914 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:26:16.676Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 16 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "b27f5f7b-b979-4427-9a7e-d1162c77383d" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45086 10.134.0.28:443 10.133.0.9:38926 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:26:16.724Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 290 30 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "bde62af9-3a58-4abc-b499-e8722da36925" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45086 10.134.0.28:443 10.133.0.9:38928 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T09:26:17.946879Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:26:17.947151Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-19T09:26:16.491Z] "POST /v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 83 39 1455 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "7997b25f-0f46-4371-b495-8c89f5f55047" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.28:57856 10.134.0.28:443 10.133.0.9:38882 - llm.e2e-external-model.1 2026-09-19T09:26:18.498955Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T09:26:18.499201Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=24 [2026-09-19T09:26:17.977Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 82 39 521 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "cf79b8b4-71e1-4741-b7b6-08d9fa6859ae" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.28:57866 10.134.0.28:443 10.133.0.9:38942 - llm.e2e-external-model.2 2026-09-19T09:26:20.032903Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:26:20.033259Z error envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1155 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Task failed: Some("2") thread=25 [2026-09-19T09:26:18.528Z] "POST /llm/e2e-external-model/v1/chat/completions HTTP/1.1" 404 - via_upstream - "-" 52 39 1504 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "bb9fb63b-24ea-43d9-904a-9d07b4a0e855" "httpbingo.org" "66.241.125.232:443" outbound|443||httpbingo.org 10.134.0.28:57856 10.134.0.28:443 10.133.0.9:38946 - llm.e2e-external-model.2 2026-09-19T09:26:21.208161Z info ads ADS: "" 4 terminated with stream closed 2026-09-19T09:26:26.585271Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:26:31.879284Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T09:26:32.023357Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T09:26:31.554Z] "POST /maas-api/internal/v1/subscriptions/select HTTP/1.1" 404 NR route_not_found - "-" 56 0 13 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "71f0e7e8-7bb0-4fe2-95cd-6da8746bed43" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" - - 10.134.0.28:443 10.133.0.9:52712 - - [2026-09-19T09:26:31.705Z] "POST /maas-api/internal/v1/api-keys/cleanup HTTP/1.1" 404 NR route_not_found - "-" 2 0 4 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "9f705c9b-a541-481e-9bdc-64a999ec4cc2" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" - - 10.134.0.28:443 10.133.0.9:52714 - - [2026-09-19T09:26:31.847Z] "POST /maas-api/internal/v1/api-keys/validate HTTP/1.1" 404 NR route_not_found - "-" 31 0 4 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "f43c275b-63c5-4268-ae2c-2c690e28003b" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" - - 10.134.0.28:443 10.133.0.9:52730 - - [2026-09-19T09:26:31.874Z] "GET /health HTTP/1.1" 200 - via_upstream - "-" 0 20 4 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "5333d7fd-1cea-42b7-ab18-5bf48353bd2e" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40310 10.134.0.28:443 10.133.0.9:52732 - odh-ai-gateway-infra.maas-api-route.4 [2026-09-19T09:26:32.009Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 588 13 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "349119b8-7176-414a-81c2-e0a594e58f31" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:40310 10.134.0.28:443 10.133.0.9:52740 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T09:29:55.055461Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:30:05.014500Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:43:35.303218Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T09:43:35.277Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 69 312 25 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "e44b55b8-2edc-45d4-b21a-7108a1503a5f" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:57354 10.134.0.28:443 10.133.0.9:42586 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:43:35.328Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 320 28 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "f6cf820e-d48e-427a-8f66-743f93dbc525" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45078 10.134.0.28:443 10.133.0.9:42602 - llm.facebook-opt-125m-simulated-kserve-route.2 [2026-09-19T09:43:35.380Z] "POST /v1/chat/completions HTTP/1.1" 200 - via_upstream - "-" 110 316 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "37999163-ab46-4903-9fe4-65d66bd93e6f" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45078 10.134.0.28:443 10.133.0.9:42614 - llm.facebook-opt-125m-simulated-kserve-route.2 2026-09-19T09:47:23.883695Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T09:47:23.863Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 30 314 20 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "d637a894-f203-4d66-8844-1b83c95f3709" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:42050 10.134.0.28:443 10.133.0.9:35334 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T09:47:26.025460Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T09:47:26.605731Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-19T09:47:26.009Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 16 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "a1b7a3ba-ddc8-4e31-a565-c2612dea77ca" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:42050 10.134.0.28:443 10.133.0.9:35344 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T09:48:48.232818Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:48:49.584258Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T09:48:49.568Z] "POST /v1/api-keys HTTP/1.1" 400 - via_upstream - "-" 80 94 15 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "1079b40d-f733-4d1e-bf70-1b71404eb5fc" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:59634 10.134.0.28:443 10.133.0.9:37724 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T09:49:02.887567Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T09:49:02.862Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 81 323 24 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "a43cb796-fb0b-4303-943d-2ffaef45d8d5" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:36406 10.134.0.28:443 10.133.0.9:32920 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:49:08.451Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 285 31 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "4092f887-9a8d-4b90-8b90-4422de3179c0" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45078 10.134.0.28:443 10.133.0.9:32922 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:49:08.502Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 0 5 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "91cc1bb4-7128-4094-9dc0-d709bf19d7cf" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:32930 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:49:08.568Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "7bb72e13-ff66-4584-92b4-f1f837f1fd06" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45086 10.134.0.28:443 10.133.0.9:32936 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:49:08.610Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 0 5 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "b0dd89fb-ba71-4985-98bb-ee38c788dc54" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:32944 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:49:08.638Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 401 - - "-" 66 0 5 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "ce83bed2-ee87-454f-b696-2d03d07b1c75" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:32948 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:49:08.673Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 284 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "a19d732d-badb-40a2-b317-ad53b0e4a22c" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45078 10.134.0.28:443 10.133.0.9:32958 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T09:49:28.235828Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:49:31.537358Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T09:49:31.518Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 87 329 18 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "4b31fdaa-828c-4116-a0d6-f318bb641805" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:59634 10.134.0.28:443 10.133.0.9:34058 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:49:31.560Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 30 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "e9bfa348-62c5-4d12-b98d-1e0d763a2754" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.134.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:49622 10.134.0.28:443 10.133.0.9:34062 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:49:31.710Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 18 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "cc354f5a-7c39-4745-ade1-29e39f290ea5" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.134.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:49638 10.134.0.28:443 10.133.0.9:34076 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:49:31.853Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 16 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "a1ba4af2-fc3b-4633-874c-82e39682785d" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.134.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:49622 10.134.0.28:443 10.133.0.9:34084 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:49:31.988Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 290 16 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "bbaf8851-6b60-4217-a07f-bb4980557aca" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.134.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:49638 10.134.0.28:443 10.133.0.9:34086 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:49:32.133Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 292 18 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "bebbb1dc-7202-4d50-8d59-8779464dacf5" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.134.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:49622 10.134.0.28:443 10.133.0.9:34096 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:49:32.271Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "ce88e17b-2cb3-490f-bf32-14ad7423dd36" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:34110 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-19T09:49:35.845708Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:49:39.852238Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:49:47.152637Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T09:49:47.302981Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T09:49:47.129Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 93 335 23 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "a3989e71-1653-48cf-bd16-bfa171849c90" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:36406 10.134.0.28:443 10.133.0.9:45114 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:49:47.173Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 295 21 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "c48a3145-7284-49eb-8cb2-6da22d71673b" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.134.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:49622 10.134.0.28:443 10.133.0.9:45116 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:49:47.215Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "b5ce3adc-2741-4f01-b54a-0237383dbf71" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:45124 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:49:47.252Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 15 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "546a5c42-9b71-41c0-bc13-5135374a9950" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:45132 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:49:47.286Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 170 16 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "ed5638ed-5fcd-4e87-95dd-15d9e5271ec0" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.134.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:49638 10.134.0.28:443 10.133.0.9:45146 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.6 2026-09-19T09:49:48.060075Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T09:49:48.042Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 74 317 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "a15ca349-cc91-4b5f-b55e-d37c5f27bc46" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:36406 10.134.0.28:443 10.133.0.9:45152 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:49:48.079Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "a4cd25f3-34e6-4567-aa0c-44c501412c0b" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45078 10.134.0.28:443 10.133.0.9:45168 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:49:49.063Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 289 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "ec23ffb5-a760-472d-aba3-5d8643861e6a" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45086 10.134.0.28:443 10.133.0.9:45178 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:49:49.776Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 292 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "a2bd832c-3ae4-4fed-8bdf-ed24f6194ceb" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45086 10.134.0.28:443 10.133.0.9:45184 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T09:49:51.225432Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-19T09:49:50.816Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 279 18 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "bddbc388-9033-457f-96cb-9d8b017dae39" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45078 10.134.0.28:443 10.133.0.9:45198 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:49:56.229Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 10 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "22fecd1f-3e4f-4ec7-a659-0013bc25cf57" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:59638 - llm.facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:50:01.270Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 76 107 10 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "6df65fcc-d084-4b38-b318-fd1cf915b758" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:59654 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 2026-09-19T09:50:02.111446Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T09:50:02.095Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 71 313 15 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "ba6b51cc-ed03-4e94-b308-bb4946dd22ad" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:36406 10.134.0.28:443 10.133.0.9:59666 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:50:02.474Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 11 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "b95f663e-68f9-44a1-8353-434b84418358" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:38874 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T09:50:05.151251Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:50:09.125558Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:50:10.464718Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T09:50:10.447Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 33 328 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "4eeaef08-7f7b-4e15-87ec-2bf4a199ea17" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:59634 10.134.0.28:443 10.133.0.9:38882 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:50:10.487Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 66 299 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "8da1ea71-b0bc-4dc8-bea8-bb6debb6cc07" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.29:8000" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:45078 10.134.0.28:443 10.133.0.9:38890 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T09:50:11.779833Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T09:50:11.766Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 321 13 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "00bf9d3d-1752-4e55-a98c-0746f4dd5918" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:59634 10.134.0.28:443 10.133.0.9:38894 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:50:12.124Z] "POST /llm/facebook-opt-125m-simulated/v1/completions HTTP/1.1" 403 - - "-" 66 32 10 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "7391cd19-3f78-4897-a18e-a82187d0e0cd" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||facebook-opt-125m-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:38904 - llm.facebook-opt-125m-simulated-kserve-route.0 2026-09-19T09:50:13.036123Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:51:20.340088Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T09:51:20.323Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 70 312 16 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "f2d3205f-fe43-4f0a-9d01-6f25578b6489" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38884 10.134.0.28:443 10.133.0.9:39692 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:51:20.364Z] "POST /llm/e2e-trlp-test-simulated/v1/completions HTTP/1.1" 403 - - "-" 73 49 19 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "81ae0f1c-053b-40bb-89ee-4adfbc133cbc" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:39704 - llm.e2e-trlp-test-simulated-kserve-route.0 2026-09-19T09:51:43.621625Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:51:44.855332Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T09:51:44.236Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 73 302 31 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "eb258510-0f6f-49c9-ba3d-9f04d314c09d" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.28:8000" outbound|8000||e2e-trlp-test-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:41192 10.134.0.28:443 10.133.0.9:57816 - llm.e2e-trlp-test-simulated-kserve-route.0 [2026-09-19T09:51:44.841Z] "DELETE /v1/api-keys/e2e-trlp-test-key HTTP/1.1" 404 - via_upstream - "-" 0 29 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "010e6200-827c-40ff-b4af-4870ad46651b" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38884 10.134.0.28:443 10.133.0.9:57828 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T09:51:47.469185Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:51:51.932921Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:51:53.193470Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T09:51:53.339736Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T09:51:53.176Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 40 329 16 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "317146a9-310d-4aa0-a566-29a20853cbc5" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:43120 10.134.0.28:443 10.133.0.9:46358 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:51:53.329Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 479 10 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "a0ae9715-4761-4e36-bd0e-1ecccb78a47e" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:38884 10.134.0.28:443 10.133.0.9:46364 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T09:51:55.684213Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:52:17.932043Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:52:30.147617Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:53:01.509331Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:53:01.556537Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T09:53:01.492Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 80 323 17 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "33bd5314-717e-451d-9c5a-c05aa8b083f6" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:39482 10.134.0.28:443 10.133.0.9:50930 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:53:01.537Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 670 19 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "3bdf6221-9f16-44d1-aeed-0a8888952ac0" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:39482 10.134.0.28:443 10.133.0.9:50938 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T09:53:05.040698Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:53:09.940164Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:53:11.159895Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 2026-09-19T09:53:11.192642Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T09:53:11.144Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 84 327 15 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "98b8a21c-d0c8-45b9-b6b0-4db2137fbe53" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:39660 10.134.0.28:443 10.133.0.9:41838 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:53:11.182Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 27 9 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "f7850c25-5893-4f33-882a-0addb9d653bc" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:39482 10.134.0.28:443 10.133.0.9:41846 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T09:53:13.728388Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:53:17.933471Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:53:25.206455Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:53:25.244224Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 2026-09-19T09:53:25.399218Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=25 [2026-09-19T09:53:25.191Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 88 330 15 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "602ae417-35bf-4354-b62a-c79557872272" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:39482 10.134.0.28:443 10.133.0.9:47418 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:53:25.233Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 11 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "3d8cb600-1bf1-4bb0-97b6-a8eb23aa8a6a" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:39482 10.134.0.28:443 10.133.0.9:47426 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:53:25.262Z] "POST /v1/completions HTTP/1.1" 200 - via_upstream - "-" 76 309 18 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "48279dad-b65d-40d9-9434-5d4bd00c6a07" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.134.0.32:8000" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:49638 10.134.0.28:443 10.133.0.9:47428 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:53:25.322Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "7fd7f6dc-d3c4-4733-b193-521aac214e24" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:47432 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:53:25.355Z] "POST /llm/e2e-unconfigured-facebook-opt-125m-simulated/v1/completions HTTP/1.1" 429 - - "-" 76 18 13 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "0df538a2-d2c1-44db-b59a-9a75113faac0" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||e2e-unconfiab60ef4d3a239b5143b412cab04acac3-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:47442 - llm.e2e-unconfigured-facebook-opt-125m-simulated-kserve-route.0 [2026-09-19T09:53:25.389Z] "GET /v1/models HTTP/1.1" 200 - via_upstream - "-" 0 538 9 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "5dc65f13-4e89-4c0c-81a3-1a2ff57d487c" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:39482 10.134.0.28:443 10.133.0.9:47450 - odh-ai-gateway-infra.maas-api-route.3 2026-09-19T09:53:27.334756Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 [2026-09-19T09:53:32.851Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 403 - - "-" 61 39 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "f358db30-d38c-46ae-9abc-34492e5f4561" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:51144 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-19T09:53:35.313262Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:53:38.888987Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T09:53:38.873Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 75 317 15 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "d9511640-b1cd-4437-bb0b-a682aa14693a" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.53:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:39660 10.134.0.28:443 10.133.0.9:51150 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:53:38.907Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 31 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "eace6205-0307-43fc-a2bf-ff6485ff7471" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.55:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:34096 10.134.0.28:443 10.133.0.9:51154 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-19T09:53:39.062Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 20 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "1e09fe48-7ae3-4098-a0f3-713ef05b0bd2" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.55:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:34102 10.134.0.28:443 10.133.0.9:51168 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-19T09:53:39.202Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 20 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "904e9ed3-b0bb-470a-ad8d-9aae510eaa9c" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.55:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:34096 10.134.0.28:443 10.133.0.9:51180 - llm.e2e-embedding-simulated-kserve-route.6 [2026-09-19T09:53:39.341Z] "POST /llm/e2e-embedding-simulated/v1/embeddings HTTP/1.1" 429 - - "-" 61 18 14 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "6402ac63-ef40-47e2-8490-1d1cb3945deb" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "-" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local - 10.134.0.28:443 10.133.0.9:51184 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-19T09:53:41.926310Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:53:47.552321Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8 2026-09-19T09:53:51.975175Z warning envoy wasm external/envoy/source/extensions/common/wasm/context.cc:1152 wasm log kuadrant-wasm-shim kuadrant_wasm_shim: Missing json property: /usage/total_tokens thread=24 [2026-09-19T09:53:51.953Z] "POST /v1/api-keys HTTP/1.1" 201 - via_upstream - "-" 73 315 21 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "eb9a119e-2623-4db4-8c5a-cf235946614e" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.132.0.96:8443" outbound|8443||maas-api.odh-ai-gateway-infra.svc.cluster.local 10.134.0.28:45440 10.134.0.28:443 10.133.0.9:34216 - odh-ai-gateway-infra.maas-api-route.3 [2026-09-19T09:53:51.998Z] "POST /v1/embeddings HTTP/1.1" 200 - via_upstream - "-" 61 4185 34 - "52.71.36.72,10.133.0.9" "python-requests/2.32.5" "c93a45fc-b9d0-45e3-9504-bc98b2695d22" "maas.apps.f017000b-5598-40ae-af27-7b1faa3ea3f7.prod.konfluxeaas.com" "10.133.0.55:8000" outbound|8000||e2e-embedding-simulated-kserve-workload-svc.llm.svc.cluster.local 10.134.0.28:34102 10.134.0.28:443 10.133.0.9:34220 - llm.e2e-embedding-simulated-kserve-route.6 2026-09-19T09:53:54.347553Z warning envoy wasm external/envoy/source/extensions/common/wasm/wasm.cc:317 Wasm remote code fetch is unstable and may cause a crash thread=8